2024-02-23T06:16:04.885 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-23T06:16:04.885 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi --owner scheduled_cbodley@teuthology --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} --archive /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577 -- /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/orig.config.yaml 2024-02-23T06:16:04.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T06:16:05.017 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577 branch: wip-cbodley-testing description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7571577' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cbodley-testing ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 rgw: compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley-testing sha1: 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2 sha1: 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 targets: smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtw7yASYzEi18PB03+iYR3wW8O2k0vgRhFW47QLqh5Fe+UYojbO+UdVn3vtLVbVheAykvClTqOGdq99HciDkHo= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcPMBWamP5QnJutz8FBXYnvE50hjNHuIdoXso9FT4S9wiSh/XUmvQROu75rXkeJdcx5znjykPgFtVnkEyXA9Q= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-23_03:36:00 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-23T06:16:05.018 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa; will attempt to use it 2024-02-23T06:16:05.019 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks 2024-02-23T06:16:05.019 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-23T06:16:05.020 INFO:teuthology.task.internal:Checking packages... 2024-02-23T06:16:05.044 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4' 2024-02-23T06:16:05.044 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-23T06:16:05.044 INFO:teuthology.packaging:ref: None 2024-02-23T06:16:05.044 INFO:teuthology.packaging:tag: None 2024-02-23T06:16:05.044 INFO:teuthology.packaging:branch: wip-cbodley-testing 2024-02-23T06:16:05.044 INFO:teuthology.packaging:sha1: 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:16:05.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cbodley-testing 2024-02-23T06:16:05.209 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1668.g1fb7413e 2024-02-23T06:16:05.210 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-23T06:16:05.217 INFO:teuthology.task.internal:no buildpackages task found 2024-02-23T06:16:05.217 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-23T06:16:05.224 INFO:teuthology.task.internal:Saving configuration 2024-02-23T06:16:05.240 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-23T06:16:05.247 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-23T06:16:05.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-23 06:10:57.743114', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtw7yASYzEi18PB03+iYR3wW8O2k0vgRhFW47QLqh5Fe+UYojbO+UdVn3vtLVbVheAykvClTqOGdq99HciDkHo='} 2024-02-23T06:16:05.293 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-23 06:10:57.741412', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcPMBWamP5QnJutz8FBXYnvE50hjNHuIdoXso9FT4S9wiSh/XUmvQROu75rXkeJdcx5znjykPgFtVnkEyXA9Q='} 2024-02-23T06:16:05.294 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-23T06:16:05.300 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-02-23T06:16:05.300 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-02-23T06:16:05.300 INFO:teuthology.run_tasks:Running task console_log... 2024-02-23T06:16:05.365 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff2872000d0>, signals=[15]) 2024-02-23T06:16:05.365 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-23T06:16:05.371 INFO:teuthology.task.internal:Opening connections... 2024-02-23T06:16:05.372 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:16:05.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:16:05.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:16:05.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:16:05.558 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-23T06:16:05.565 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-02-23T06:16:05.581 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-02-23T06:16:05.582 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-02-23T06:16:05.638 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-23T06:16:05.639 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-23T06:16:05.640 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-02-23T06:16:05.664 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-02-23T06:16:05.681 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-02-23T06:16:05.682 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-02-23T06:16:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-02-23T06:16:05.739 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-23T06:16:05.739 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-02-23T06:16:05.739 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-23T06:16:05.739 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-23T06:16:05.739 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-23T06:16:05.739 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-02-23T06:16:05.764 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-23T06:16:05.773 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-23T06:16:05.779 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-23T06:16:05.779 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-02-23T06:16:05.782 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-02-23T06:16:05.797 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-23T06:16:05.803 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-23T06:16:05.803 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-02-23T06:16:05.837 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-02-23T06:16:05.862 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-23T06:16:05.916 INFO:teuthology.run_tasks:Running task kernel... 2024-02-23T06:16:05.930 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-23T06:16:05.930 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-23T06:16:05.930 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-23T06:16:05.930 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-23T06:16:05.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:16:05.946 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-23T06:16:05.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:16:05.947 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-02-23T06:16:06.003 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-02-23T06:16:06.003 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-361.el9.x86_64 2024-02-23T06:16:06.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-02-23T06:16:06.004 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-361.el9.x86_64 2024-02-23T06:16:06.005 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-361.el9.x86_64 2024-02-23T06:16:06.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-02-23T06:16:08.024 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-02-23T06:16:08.265 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-02-23T06:16:09.658 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 7.9 MB/s | 2.5 MB 00:00 2024-02-23T06:16:09.949 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.5 MB 00:00 2024-02-23T06:16:10.607 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-02-23T06:16:11.456 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-02-23T06:16:12.633 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-02-23T06:16:16.642 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.1 MB 00:00 2024-02-23T06:16:18.092 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2024-02-23T06:16:23.573 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 19 MB 00:10 2024-02-23T06:16:24.362 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 3.3 MB/s | 20 MB 00:06 2024-02-23T06:16:27.782 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-02-23T06:16:29.417 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-02-23T06:16:29.816 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 15 kB 00:00 2024-02-23T06:16:31.659 INFO:teuthology.orchestra.run.smithi142.stderr:Modular dependency problems: 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 1: conflicting requests 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 2: conflicting requests 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 3: conflicting requests 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 4: conflicting requests 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 5: conflicting requests 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.660 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 6: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 7: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 8: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 9: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 10: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 11: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 12: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 13: conflicting requests 2024-02-23T06:16:31.661 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 14: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 15: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 16: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 17: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 18: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 19: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 20: conflicting requests 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.662 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 21: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 22: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 23: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 24: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 25: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 26: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 27: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 28: conflicting requests 2024-02-23T06:16:31.663 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 29: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 30: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 31: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 32: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 33: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 34: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 35: conflicting requests 2024-02-23T06:16:31.664 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 36: conflicting requests 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 37: cannot install the best candidate for the job 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 38: conflicting requests 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.665 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 39: cannot install the best candidate for the job 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 40: cannot install the best candidate for the job 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 41: cannot install the best candidate for the job 2024-02-23T06:16:31.666 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 42: cannot install the best candidate for the job 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 43: cannot install the best candidate for the job 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 44: cannot install the best candidate for the job 2024-02-23T06:16:31.667 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.668 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.668 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-23T06:16:31.668 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-23T06:16:32.066 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-23T06:16:32.067 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-23T06:16:32.165 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-23T06:16:32.169 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-23T06:16:32.169 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-419.el9 baseos 6.0 M 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-419.el9 baseos 21 M 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-419.el9 baseos 39 M 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-419.el9 baseos 33 M 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-02-23T06:16:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:16:32.171 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 99 M 2024-02-23T06:16:32.171 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 122 M 2024-02-23T06:16:32.171 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-23T06:16:32.754 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 20 MB 00:02 2024-02-23T06:16:36.110 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 1.5 MB/s | 6.0 MB 00:03 2024-02-23T06:16:37.717 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-02-23T06:16:39.947 INFO:teuthology.orchestra.run.smithi152.stderr:Modular dependency problems: 2024-02-23T06:16:39.947 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 1: conflicting requests 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 2: conflicting requests 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 3: conflicting requests 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 4: conflicting requests 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 5: conflicting requests 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 6: conflicting requests 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.948 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 7: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 8: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 9: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 10: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 11: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 12: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 13: conflicting requests 2024-02-23T06:16:39.949 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 14: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 15: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 16: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 17: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 18: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 19: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 20: conflicting requests 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.950 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 21: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 22: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 23: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 24: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 25: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 26: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 27: conflicting requests 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.951 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 28: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 29: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 30: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 31: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 32: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 33: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 34: conflicting requests 2024-02-23T06:16:39.952 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 35: conflicting requests 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 36: conflicting requests 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 37: cannot install the best candidate for the job 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 38: conflicting requests 2024-02-23T06:16:39.953 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 39: cannot install the best candidate for the job 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 40: cannot install the best candidate for the job 2024-02-23T06:16:39.954 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 41: cannot install the best candidate for the job 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 42: cannot install the best candidate for the job 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 43: cannot install the best candidate for the job 2024-02-23T06:16:39.955 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 44: cannot install the best candidate for the job 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-23T06:16:39.956 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-23T06:16:40.367 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-23T06:16:40.421 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-23T06:16:40.491 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-419.el9 baseos 6.0 M 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-419.el9 baseos 21 M 2024-02-23T06:16:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-419.el9 baseos 39 M 2024-02-23T06:16:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-419.el9 baseos 33 M 2024-02-23T06:16:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:16:40.503 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-02-23T06:16:40.503 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-02-23T06:16:40.503 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-02-23T06:16:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:16:40.504 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 99 M 2024-02-23T06:16:40.504 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 122 M 2024-02-23T06:16:40.504 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-02-23T06:16:41.794 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 5.1 MB/s | 6.0 MB 00:01 2024-02-23T06:16:42.243 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 3.9 MB/s | 39 MB 00:10 2024-02-23T06:16:43.151 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-core-5.14.0-419.el9.x86_64.rpm 1.9 MB/s | 21 MB 00:10 2024-02-23T06:16:44.144 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-419.el9.x86_64.rpm 5.9 MB/s | 21 MB 00:03 2024-02-23T06:16:45.336 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-core-5.14.0-419.el9.x86_6 9.4 MB/s | 33 MB 00:03 2024-02-23T06:16:46.103 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 7.1 MB/s | 39 MB 00:05 2024-02-23T06:16:46.103 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-02-23T06:16:46.103 INFO:teuthology.orchestra.run.smithi152.stdout:Total 18 MB/s | 99 MB 00:05 2024-02-23T06:16:46.985 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-02-23T06:16:47.395 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-02-23T06:16:47.396 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-02-23T06:16:49.027 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-02-23T06:16:49.027 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-02-23T06:16:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-02-23T06:16:52.382 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-23T06:16:52.524 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-23T06:16:55.300 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-23T06:16:55.479 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-23T06:16:59.942 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-419.el9.x86_6 1.4 MB/s | 33 MB 00:23 2024-02-23T06:16:59.943 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-23T06:16:59.943 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.6 MB/s | 99 MB 00:27 2024-02-23T06:17:00.217 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-23T06:17:00.430 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:00.817 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-23T06:17:01.188 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-23T06:17:01.189 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-23T06:17:02.787 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-23T06:17:02.788 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-23T06:17:05.195 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:05.494 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-23T06:17:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-23T06:17:06.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-23T06:17:09.052 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-23T06:17:09.231 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-23T06:17:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-23T06:17:14.167 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:18.894 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:34.278 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:34.278 INFO:teuthology.orchestra.run.smithi152.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-23T06:17:34.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:17:34.362 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:34.854 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:34.854 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-23T06:17:34.854 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-23T06:17:34.854 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-23T06:17:35.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:17:35.338 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-02-23T06:17:35.857 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-02-23T06:17:35.998 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-23T06:17:35.999 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-23T06:17:36.000 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-23T06:17:36.000 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-23T06:17:36.000 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-23T06:17:36.000 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-23T06:17:36.000 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-02-23T06:17:36.000 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-02-23T06:17:36.123 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-23T06:17:36.124 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-23T06:17:36.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-02-23T06:17:36.161 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-02-23T06:17:36.161 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 68.el9 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8264254 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-02-23T06:17:36.162 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:17:36.163 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-02-23T06:17:36.164 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-23T06:17:36.164 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-419.el9.x86_64 2024-02-23T06:17:36.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-23T06:17:36.809 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-02-23T06:17:38.259 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-23T06:17:38.290 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-02-23T06:17:38.293 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-02-23T06:17:38.308 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.mlojHspmIf 2024-02-23T06:17:38.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mlojHspmIf 2024-02-23T06:17:38.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.mlojHspmIf 2024-02-23T06:17:38.510 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.mlojHspmIf is 6KB 2024-02-23T06:17:38.558 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.mlojHspmIf 2024-02-23T06:17:38.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-02-23T06:17:38.640 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-23T06:17:38.640 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-23T06:17:38.640 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-23T06:17:38.640 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-23T06:17:38.641 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-23T06:17:38.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-02-23T06:17:48.248 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:48.249 INFO:teuthology.orchestra.run.smithi142.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-23T06:17:48.249 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:17:48.334 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-23T06:17:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-23T06:17:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-23T06:17:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-23T06:17:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:17:49.251 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-23T06:17:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-23T06:17:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-23T06:17:49.792 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-23T06:17:49.935 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-23T06:17:49.936 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-23T06:17:49.936 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-23T06:17:49.936 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-23T06:17:49.937 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-23T06:17:49.937 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-23T06:17:49.937 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-02-23T06:17:49.937 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-23T06:17:50.060 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-23T06:17:50.060 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-23T06:17:50.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-02-23T06:17:50.107 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-23T06:17:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:17:50.109 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-02-23T06:17:50.110 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-23T06:17:50.110 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-419.el9.x86_64 2024-02-23T06:17:50.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-23T06:17:50.695 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-02-23T06:17:52.185 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-23T06:17:52.218 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-02-23T06:17:52.220 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-23T06:17:52.235 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.llkZvwNPVm 2024-02-23T06:17:52.236 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.llkZvwNPVm 2024-02-23T06:17:52.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.llkZvwNPVm 2024-02-23T06:17:52.443 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.llkZvwNPVm is 6KB 2024-02-23T06:17:52.492 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.llkZvwNPVm 2024-02-23T06:17:52.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-02-23T06:17:52.571 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-23T06:17:52.571 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-23T06:17:52.571 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-23T06:17:52.572 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-23T06:17:52.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-23T06:17:52.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-02-23T06:18:08.824 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-23T06:18:08.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-23T06:18:08.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:18:22.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-23T06:18:22.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-23T06:18:22.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:18:43.388 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-02-23T06:18:52.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-23T06:18:52.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:19:10.780 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-02-23T06:19:22.736 DEBUG:teuthology.orchestra.remote:timed out 2024-02-23T06:19:22.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-23T06:19:22.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:19:23.254 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-02-23T06:19:23.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-23T06:19:23.698 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-419.el9.x86_64"... 2024-02-23T06:19:23.698 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-02-23T06:19:23.712 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-419.el9.x86_64 2024-02-23T06:19:23.713 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-23T06:19:23.713 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-23T06:19:23.713 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-23T06:19:24.714 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-23T06:19:24.714 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-23T06:19:24.804 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-02-23T06:19:24.846 DEBUG:teuthology.parallel:result is None 2024-02-23T06:19:31.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-23T06:19:31.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:19:32.051 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-23T06:19:32.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-23T06:19:32.428 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-419.el9.x86_64"... 2024-02-23T06:19:32.428 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-23T06:19:32.442 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-419.el9.x86_64 2024-02-23T06:19:32.442 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-23T06:19:32.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-23T06:19:32.443 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-23T06:19:33.444 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-23T06:19:33.444 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-23T06:19:33.505 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-02-23T06:19:33.547 DEBUG:teuthology.parallel:result is None 2024-02-23T06:19:33.547 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-23T06:19:33.554 INFO:teuthology.task.internal:Creating test directory... 2024-02-23T06:19:33.554 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-23T06:19:33.556 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-23T06:19:33.576 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-23T06:19:33.586 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-23T06:19:33.595 INFO:teuthology.task.internal:Creating archive directory... 2024-02-23T06:19:33.595 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-23T06:19:33.609 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-23T06:19:33.676 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-23T06:19:33.683 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-23T06:19:33.683 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-23T06:19:33.686 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-23T06:19:33.714 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-23T06:19:33.720 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-23T06:19:33.727 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-23T06:19:33.735 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-23T06:19:33.736 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-23T06:19:33.743 INFO:teuthology.task.internal:Configuring sudo... 2024-02-23T06:19:33.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-23T06:19:33.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-23T06:19:33.807 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-23T06:19:33.819 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-23T06:19:33.820 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-23T06:19:33.832 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-23T06:19:33.862 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-23T06:19:33.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-23T06:19:33.967 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-23T06:19:34.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-23T06:19:34.084 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:19:34.084 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-23T06:19:34.147 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-23T06:19:34.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-23T06:19:34.246 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-23T06:19:34.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-23T06:19:34.375 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:19:34.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-23T06:19:34.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-02-23T06:19:34.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-02-23T06:19:34.501 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-23T06:19:34.539 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-23T06:19:34.800 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-23T06:19:34.813 INFO:teuthology.task.internal:Starting timer... 2024-02-23T06:19:34.813 INFO:teuthology.run_tasks:Running task pcp... 2024-02-23T06:19:34.836 INFO:teuthology.run_tasks:Running task selinux... 2024-02-23T06:19:35.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-02-23T06:19:35.140 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-02-23T06:19:35.142 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-02-23T06:19:35.203 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-02-23T06:19:35.205 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-23T06:19:35.205 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-02-23T06:19:35.224 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-02-23T06:19:35.224 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-02-23T06:19:35.242 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-02-23T06:19:35.242 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-02-23T06:19:35.242 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-23T06:19:35.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:19:35.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-23T06:19:35.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:19:35.315 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-23T06:19:35.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-02-23T06:19:35.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-02-23T06:19:35.402 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-23T06:19:35.412 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-23T06:19:35.432 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-23T06:19:35.433 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-23T06:24:06.377 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-02-23T06:24:06.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-23T06:24:06.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:24:06.505 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-23T06:24:06.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-23T06:24:06.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-23T06:24:06.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-23T06:24:06.677 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-02-23T06:24:06.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-23T06:24:06.761 INFO:teuthology.run_tasks:Running task clock... 2024-02-23T06:24:06.773 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-23T06:24:06.773 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-23T06:24:06.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-23T06:24:06.776 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-23T06:24:06.776 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-23T06:24:06.809 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-23T06:24:06.826 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-23T06:24:06.835 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-23T06:24:06.853 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-23T06:24:06.857 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-02-23T06:24:06.871 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-02-23T06:24:06.883 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-02-23T06:24:06.888 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-23T06:24:06.897 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-02-23T06:24:06.904 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-23T06:24:06.914 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-23T06:24:06.931 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-23T06:24:06.959 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-23T06:24:06.962 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-23T06:24:06.963 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-23T06:24:06.963 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.963 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.963 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.963 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.983 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-02-23T06:24:06.987 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-23T06:24:06.987 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-02-23T06:24:06.987 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.987 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.987 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.987 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T06:24:06.988 INFO:teuthology.run_tasks:Running task install... 2024-02-23T06:24:06.997 DEBUG:teuthology.task.install:project ceph 2024-02-23T06:24:06.998 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'}} 2024-02-23T06:24:06.998 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'} 2024-02-23T06:24:06.998 INFO:teuthology.task.install:Using flavor: default 2024-02-23T06:24:07.004 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-23T06:24:07.004 INFO:teuthology.task.install:extra packages: [] 2024-02-23T06:24:07.004 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4', 'tag': None, 'wait_for_package': False} 2024-02-23T06:24:07.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:24:07.007 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4', 'tag': None, 'wait_for_package': False} 2024-02-23T06:24:07.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:24:07.229 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/ 2024-02-23T06:24:07.229 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1668.g1fb7413e 2024-02-23T06:24:07.238 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/ 2024-02-23T06:24:07.238 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1668.g1fb7413e 2024-02-23T06:24:07.353 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-23T06:24:07.353 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:24:07.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-23T06:24:07.382 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-02-23T06:24:07.383 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-23T06:24:07.411 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-23T06:24:07.412 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:24:07.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-23T06:24:07.440 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-02-23T06:24:07.440 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-23T06:24:07.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-23T06:24:07.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-23T06:24:07.531 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-23T06:24:07.591 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-23T06:24:07.597 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-02-23T06:24:07.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-02-23T06:24:07.658 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-02-23T06:24:07.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-02-23T06:24:07.858 INFO:teuthology.orchestra.run.smithi152.stdout:74 files removed 2024-02-23T06:24:07.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-02-23T06:24:07.907 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-02-23T06:24:07.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-02-23T06:24:08.866 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 125 kB/s | 82 kB 00:00 2024-02-23T06:24:08.889 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 128 kB/s | 82 kB 00:00 2024-02-23T06:24:09.317 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-02-23T06:24:09.374 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-02-23T06:24:09.682 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 7.1 kB/s | 1.9 kB 00:00 2024-02-23T06:24:09.801 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-02-23T06:24:10.343 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-02-23T06:24:10.353 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - AppStream 16 MB/s | 8.1 MB 00:00 2024-02-23T06:24:11.968 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 8.4 MB/s | 2.5 MB 00:00 2024-02-23T06:24:12.329 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.5 MB 00:00 2024-02-23T06:24:13.109 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-02-23T06:24:13.703 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.0 MB 00:00 2024-02-23T06:24:15.837 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-02-23T06:24:20.063 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.1 MB 00:00 2024-02-23T06:24:21.656 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-02-23T06:24:21.692 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-02-23T06:24:27.818 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.1 MB 00:02 2024-02-23T06:24:29.593 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2024-02-23T06:24:30.879 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2024-02-23T06:24:35.803 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:Modular dependency problems: 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 1: conflicting requests 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 2: conflicting requests 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 3: conflicting requests 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.364 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 4: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 5: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 6: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 7: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 8: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 9: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 10: conflicting requests 2024-02-23T06:24:38.365 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 11: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 12: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 13: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 14: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 15: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 16: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 17: conflicting requests 2024-02-23T06:24:38.366 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 18: conflicting requests 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 19: conflicting requests 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 20: conflicting requests 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 21: conflicting requests 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 22: conflicting requests 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 23: conflicting requests 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.367 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 24: conflicting requests 2024-02-23T06:24:38.368 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.368 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 25: conflicting requests 2024-02-23T06:24:38.368 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.368 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 26: conflicting requests 2024-02-23T06:24:38.368 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 27: conflicting requests 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 28: conflicting requests 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 29: conflicting requests 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 30: conflicting requests 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 31: conflicting requests 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 32: conflicting requests 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.369 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 33: conflicting requests 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 34: conflicting requests 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 35: conflicting requests 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 36: conflicting requests 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 37: cannot install the best candidate for the job 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.370 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 38: conflicting requests 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.371 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 39: cannot install the best candidate for the job 2024-02-23T06:24:38.372 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.372 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.372 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.372 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.372 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 40: cannot install the best candidate for the job 2024-02-23T06:24:38.372 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 41: cannot install the best candidate for the job 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 42: cannot install the best candidate for the job 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.373 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 43: cannot install the best candidate for the job 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 44: cannot install the best candidate for the job 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.374 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-23T06:24:38.816 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-23T06:24:38.817 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-23T06:24:38.933 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-23T06:24:38.954 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================================== 2024-02-23T06:24:38.954 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-23T06:24:38.954 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================================== 2024-02-23T06:24:38.954 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-23T06:24:38.954 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 6.6 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 5.3 M 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 887 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 145 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 1.5 M 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 138 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 1.8 M 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 7.4 M 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 49 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 9.8 M 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 47 M 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 264 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 748 k 2024-02-23T06:24:38.955 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 31 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 744 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 127 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 162 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 320 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 299 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 100 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 85 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 3.1 M 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 170 k 2024-02-23T06:24:38.956 INFO:teuthology.orchestra.run.smithi142.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 3.4 M 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 3.1 M 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-02-23T06:24:38.957 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: bluez-libs x86_64 5.63-1.el8 CentOS-BaseOS 113 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: bubblewrap x86_64 0.4.1-6.el9 baseos 50 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 20 M 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 31 k 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 2.1 M 2024-02-23T06:24:38.958 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 248 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 4.7 M 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 17 M 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 15 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 25 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: cups-libs x86_64 1:2.3.3op2-23.el9 baseos 262 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2024-02-23T06:24:38.959 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 appstream 88 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-02-23T06:24:38.960 INFO:teuthology.orchestra.run.smithi142.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 appstream 35 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: hawtjni-runtime noarch 1.16-1.module_el8.0.0+82+8ee6c375 CentOS-AppStream 42 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: jansi noarch 1.17.1-1.module_el8.0.0+82+8ee6c375 CentOS-AppStream 78 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: jansi-native x86_64 1.7-5.module_el8.0.0+82+8ee6c375 CentOS-AppStream 37 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 appstream 440 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 appstream 40 M 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: javapackages-filesystem noarch 5.3.0-1.module_el8.0.0+11+5b8c10bd CentOS-AppStream 29 k 2024-02-23T06:24:38.961 INFO:teuthology.orchestra.run.smithi142.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-02-23T06:24:38.962 INFO:teuthology.orchestra.run.smithi142.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 163 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libepoxy x86_64 1.5.8-1.el8 CentOS-AppStream 224 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-02-23T06:24:38.963 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libiptcdata x86_64 1.0.5-9.el9 appstream 62 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libpciaccess x86_64 0.16-6.el9 baseos 28 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-23T06:24:38.964 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 501 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 5.1 M 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-ltdl x86_64 2.4.6-45.el9 appstream 37 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-02-23T06:24:38.965 INFO:teuthology.orchestra.run.smithi142.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-02-23T06:24:38.966 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libEGL x86_64 23.3.0-1.el9 appstream 127 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libGL x86_64 23.3.0-1.el9 appstream 168 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libgbm x86_64 23.3.0-1.el9 appstream 38 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libglapi x86_64 23.3.0-1.el9 appstream 46 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-23T06:24:38.967 INFO:teuthology.orchestra.run.smithi142.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: orc x86_64 0.4.31-6.el9 appstream 184 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: ostree-libs x86_64 2024.2-2.el9 appstream 484 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-02-23T06:24:38.968 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: poppler x86_64 21.01.0-19.el9 appstream 1.1 M 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: poppler-glib x86_64 21.01.0-19.el9 appstream 152 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 45 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 131 k 2024-02-23T06:24:38.969 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-23T06:24:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-23T06:24:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-23T06:24:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: rtkit x86_64 0.11-28.el9 appstream 56 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-02-23T06:24:38.973 INFO:teuthology.orchestra.run.smithi142.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: tzdata-java noarch 2024a-1.el8 CentOS-AppStream 186 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-02-23T06:24:38.974 INFO:teuthology.orchestra.run.smithi142.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: gtk3 x86_64 3.24.31-2.el9 appstream 4.9 M 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 appstream 3.3 M 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-02-23T06:24:38.975 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling module streams: 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout: javapackages-runtime 201801 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout: scala 2.10 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================================== 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout:Install 284 Packages 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-02-23T06:24:38.976 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:24:38.977 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 299 M 2024-02-23T06:24:38.977 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-23T06:24:39.447 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 20 MB 00:17 2024-02-23T06:24:39.920 INFO:teuthology.orchestra.run.smithi142.stdout:(1/286): ceph-19.0.0-1668.g1fb7413e.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-02-23T06:24:40.345 INFO:teuthology.orchestra.run.smithi142.stdout:(2/286): ceph-fuse-19.0.0-1668.g1fb7413e.el9.x8 2.0 MB/s | 887 kB 00:00 2024-02-23T06:24:40.604 INFO:teuthology.orchestra.run.smithi142.stdout:(3/286): ceph-base-19.0.0-1668.g1fb7413e.el9.x8 6.0 MB/s | 5.3 MB 00:00 2024-02-23T06:24:40.905 INFO:teuthology.orchestra.run.smithi142.stdout:(4/286): ceph-mds-19.0.0-1668.g1fb7413e.el9.x86 7.1 MB/s | 2.1 MB 00:00 2024-02-23T06:24:41.013 INFO:teuthology.orchestra.run.smithi142.stdout:(5/286): ceph-immutable-object-cache-19.0.0-166 218 kB/s | 145 kB 00:00 2024-02-23T06:24:41.221 INFO:teuthology.orchestra.run.smithi142.stdout:(6/286): ceph-mgr-19.0.0-1668.g1fb7413e.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-02-23T06:24:41.963 INFO:teuthology.orchestra.run.smithi142.stdout:(7/286): ceph-mon-19.0.0-1668.g1fb7413e.el9.x86 4.9 MB/s | 4.7 MB 00:00 2024-02-23T06:24:42.997 INFO:teuthology.orchestra.run.smithi142.stdout:(8/286): ceph-common-19.0.0-1668.g1fb7413e.el9. 6.1 MB/s | 20 MB 00:03 2024-02-23T06:24:43.055 INFO:teuthology.orchestra.run.smithi142.stdout:(9/286): ceph-selinux-19.0.0-1668.g1fb7413e.el9 433 kB/s | 25 kB 00:00 2024-02-23T06:24:43.372 INFO:teuthology.orchestra.run.smithi142.stdout:(10/286): ceph-osd-19.0.0-1668.g1fb7413e.el9.x8 7.8 MB/s | 17 MB 00:02 2024-02-23T06:24:43.422 INFO:teuthology.orchestra.run.smithi142.stdout:(11/286): libcephfs-devel-19.0.0-1668.g1fb7413e 626 kB/s | 31 kB 00:00 2024-02-23T06:24:43.564 INFO:teuthology.orchestra.run.smithi142.stdout:(12/286): ceph-radosgw-19.0.0-1668.g1fb7413e.el 6.1 MB/s | 9.8 MB 00:01 2024-02-23T06:24:43.698 INFO:teuthology.orchestra.run.smithi142.stdout:(13/286): libcephfs2-19.0.0-1668.g1fb7413e.el9. 2.6 MB/s | 744 kB 00:00 2024-02-23T06:24:43.723 INFO:teuthology.orchestra.run.smithi142.stdout:(14/286): libcephsqlite-19.0.0-1668.g1fb7413e.e 1.0 MB/s | 163 kB 00:00 2024-02-23T06:24:43.765 INFO:teuthology.orchestra.run.smithi142.stdout:(15/286): librados-devel-19.0.0-1668.g1fb7413e. 1.9 MB/s | 127 kB 00:00 2024-02-23T06:24:43.832 INFO:teuthology.orchestra.run.smithi142.stdout:(16/286): libradosstriper1-19.0.0-1668.g1fb7413 4.5 MB/s | 501 kB 00:00 2024-02-23T06:24:43.916 INFO:teuthology.orchestra.run.smithi142.stdout:(17/286): python3-ceph-argparse-19.0.0-1668.g1f 542 kB/s | 45 kB 00:00 2024-02-23T06:24:43.991 INFO:teuthology.orchestra.run.smithi142.stdout:(18/286): python3-ceph-common-19.0.0-1668.g1fb7 1.7 MB/s | 131 kB 00:00 2024-02-23T06:24:44.058 INFO:teuthology.orchestra.run.smithi142.stdout:(19/286): python3-cephfs-19.0.0-1668.g1fb7413e. 2.4 MB/s | 162 kB 00:00 2024-02-23T06:24:44.142 INFO:teuthology.orchestra.run.smithi142.stdout:(20/286): python3-rados-19.0.0-1668.g1fb7413e.e 3.7 MB/s | 320 kB 00:00 2024-02-23T06:24:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:(21/286): python3-rbd-19.0.0-1668.g1fb7413e.el9 3.9 MB/s | 299 kB 00:00 2024-02-23T06:24:44.284 INFO:teuthology.orchestra.run.smithi142.stdout:(22/286): python3-rgw-19.0.0-1668.g1fb7413e.el9 1.5 MB/s | 100 kB 00:00 2024-02-23T06:24:44.351 INFO:teuthology.orchestra.run.smithi142.stdout:(23/286): rbd-fuse-19.0.0-1668.g1fb7413e.el9.x8 1.3 MB/s | 85 kB 00:00 2024-02-23T06:24:44.460 INFO:teuthology.orchestra.run.smithi142.stdout:(24/286): librgw2-19.0.0-1668.g1fb7413e.el9.x86 7.4 MB/s | 5.1 MB 00:00 2024-02-23T06:24:44.526 INFO:teuthology.orchestra.run.smithi142.stdout:(25/286): rbd-nbd-19.0.0-1668.g1fb7413e.el9.x86 2.5 MB/s | 170 kB 00:00 2024-02-23T06:24:44.622 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-23T06:24:44.690 INFO:teuthology.orchestra.run.smithi142.stdout:(26/286): ceph-grafana-dashboards-19.0.0-1668.g 192 kB/s | 31 kB 00:00 2024-02-23T06:24:44.777 INFO:teuthology.orchestra.run.smithi142.stdout:(27/286): ceph-mgr-cephadm-19.0.0-1668.g1fb7413 1.6 MB/s | 138 kB 00:00 2024-02-23T06:24:44.902 INFO:teuthology.orchestra.run.smithi142.stdout:(28/286): rbd-mirror-19.0.0-1668.g1fb7413e.el9. 5.6 MB/s | 3.1 MB 00:00 2024-02-23T06:24:45.052 INFO:teuthology.orchestra.run.smithi142.stdout:(29/286): ceph-mgr-dashboard-19.0.0-1668.g1fb74 6.5 MB/s | 1.8 MB 00:00 2024-02-23T06:24:45.136 INFO:teuthology.orchestra.run.smithi142.stdout:(30/286): ceph-mgr-modules-core-19.0.0-1668.g1f 2.9 MB/s | 248 kB 00:00 2024-02-23T06:24:45.211 INFO:teuthology.orchestra.run.smithi142.stdout:(31/286): ceph-mgr-rook-19.0.0-1668.g1fb7413e.e 659 kB/s | 49 kB 00:00 2024-02-23T06:24:45.270 INFO:teuthology.orchestra.run.smithi142.stdout:(32/286): ceph-prometheus-alerts-19.0.0-1668.g1 263 kB/s | 15 kB 00:00 2024-02-23T06:24:45.345 INFO:teuthology.orchestra.run.smithi142.stdout:(33/286): ceph-volume-19.0.0-1668.g1fb7413e.el9 3.4 MB/s | 264 kB 00:00 2024-02-23T06:24:45.479 INFO:teuthology.orchestra.run.smithi142.stdout:(34/286): cephadm-19.0.0-1668.g1fb7413e.el9.noa 5.5 MB/s | 748 kB 00:00 2024-02-23T06:24:45.571 INFO:teuthology.orchestra.run.smithi142.stdout:(35/286): hawtjni-runtime-1.16-1.module_el8.0.0 457 kB/s | 42 kB 00:00 2024-02-23T06:24:45.612 INFO:teuthology.orchestra.run.smithi142.stdout:(36/286): jansi-1.17.1-1.module_el8.0.0+82+8ee6 1.8 MB/s | 78 kB 00:00 2024-02-23T06:24:45.638 INFO:teuthology.orchestra.run.smithi142.stdout:(37/286): jansi-native-1.7-5.module_el8.0.0+82+ 1.5 MB/s | 37 kB 00:00 2024-02-23T06:24:45.663 INFO:teuthology.orchestra.run.smithi142.stdout:(38/286): javapackages-filesystem-5.3.0-1.modul 1.1 MB/s | 29 kB 00:00 2024-02-23T06:24:45.713 INFO:teuthology.orchestra.run.smithi142.stdout:(39/286): libepoxy-1.5.8-1.el8.x86_64.rpm 4.4 MB/s | 224 kB 00:00 2024-02-23T06:24:45.755 INFO:teuthology.orchestra.run.smithi142.stdout:(40/286): tzdata-java-2024a-1.el8.noarch.rpm 4.4 MB/s | 186 kB 00:00 2024-02-23T06:24:45.789 INFO:teuthology.orchestra.run.smithi142.stdout:(41/286): bluez-libs-5.63-1.el8.x86_64.rpm 3.3 MB/s | 113 kB 00:00 2024-02-23T06:24:45.973 INFO:teuthology.orchestra.run.smithi142.stdout:(42/286): ceph-mgr-diskprediction-local-19.0.0- 6.9 MB/s | 7.4 MB 00:01 2024-02-23T06:24:46.298 INFO:teuthology.orchestra.run.smithi142.stdout:(43/286): ModemManager-glib-1.20.2-1.el9.x86_64 659 kB/s | 335 kB 00:00 2024-02-23T06:24:46.315 INFO:teuthology.orchestra.run.smithi142.stdout:(44/286): bubblewrap-0.4.1-6.el9.x86_64.rpm 147 kB/s | 50 kB 00:00 2024-02-23T06:24:46.415 INFO:teuthology.orchestra.run.smithi142.stdout:(45/286): cups-libs-2.3.3op2-23.el9.x86_64.rpm 2.2 MB/s | 262 kB 00:00 2024-02-23T06:24:46.499 INFO:teuthology.orchestra.run.smithi142.stdout:(46/286): fuse-2.9.9-15.el9.x86_64.rpm 437 kB/s | 80 kB 00:00 2024-02-23T06:24:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:(47/286): jq-1.6-16.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-02-23T06:24:46.632 INFO:teuthology.orchestra.run.smithi142.stdout:(48/286): libpciaccess-0.16-6.el9.x86_64.rpm 256 kB/s | 28 kB 00:00 2024-02-23T06:24:46.749 INFO:teuthology.orchestra.run.smithi142.stdout:(49/286): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-02-23T06:24:46.866 INFO:teuthology.orchestra.run.smithi142.stdout:(50/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 806 kB/s | 94 kB 00:00 2024-02-23T06:24:46.900 INFO:teuthology.orchestra.run.smithi142.stdout:(51/286): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr:Modular dependency problems: 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 1: conflicting requests 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 2: conflicting requests 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.192 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 3: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 4: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 5: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 6: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 7: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 8: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 9: conflicting requests 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.193 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 10: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 11: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 12: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 13: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 14: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 15: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 16: conflicting requests 2024-02-23T06:24:47.194 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 17: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 18: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 19: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 20: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 21: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 22: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 23: conflicting requests 2024-02-23T06:24:47.195 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 24: conflicting requests 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 25: conflicting requests 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 26: conflicting requests 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 27: conflicting requests 2024-02-23T06:24:47.196 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 28: conflicting requests 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 29: conflicting requests 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 30: conflicting requests 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 31: conflicting requests 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 32: conflicting requests 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.197 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 33: conflicting requests 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 34: conflicting requests 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 35: conflicting requests 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 36: conflicting requests 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 37: cannot install the best candidate for the job 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.198 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 38: conflicting requests 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.199 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 39: cannot install the best candidate for the job 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 40: cannot install the best candidate for the job 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 41: cannot install the best candidate for the job 2024-02-23T06:24:47.200 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 42: cannot install the best candidate for the job 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 43: cannot install the best candidate for the job 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.201 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 44: cannot install the best candidate for the job 2024-02-23T06:24:47.202 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.202 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.202 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.202 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-23T06:24:47.662 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-23T06:24:47.663 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-23T06:24:47.785 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================== 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================== 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 6.6 k 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 5.3 M 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 887 k 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 145 k 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 1.5 M 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 138 k 2024-02-23T06:24:47.822 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 1.8 M 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 7.4 M 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 49 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 9.8 M 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 47 M 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 264 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 748 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 31 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 744 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 127 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 162 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 320 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 299 k 2024-02-23T06:24:47.823 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 100 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 85 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 3.1 M 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 170 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 3.4 M 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 3.1 M 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-02-23T06:24:47.824 INFO:teuthology.orchestra.run.smithi152.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: bluez-libs x86_64 5.63-1.el8 CentOS-BaseOS 113 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: bubblewrap x86_64 0.4.1-6.el9 baseos 50 k 2024-02-23T06:24:47.825 INFO:teuthology.orchestra.run.smithi152.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 20 M 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 31 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 2.1 M 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 248 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 4.7 M 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 17 M 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1668.g1fb7413e.el9 ceph-noarch 15 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 25 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-02-23T06:24:47.826 INFO:teuthology.orchestra.run.smithi152.stdout: cups-libs x86_64 1:2.3.3op2-23.el9 baseos 262 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 appstream 88 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-02-23T06:24:47.827 INFO:teuthology.orchestra.run.smithi152.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 appstream 35 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: hawtjni-runtime noarch 1.16-1.module_el8.0.0+82+8ee6c375 CentOS-AppStream 42 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-02-23T06:24:47.828 INFO:teuthology.orchestra.run.smithi152.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jansi noarch 1.17.1-1.module_el8.0.0+82+8ee6c375 CentOS-AppStream 78 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jansi-native x86_64 1.7-5.module_el8.0.0+82+8ee6c375 CentOS-AppStream 37 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 appstream 440 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 appstream 40 M 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: javapackages-filesystem noarch 5.3.0-1.module_el8.0.0+11+5b8c10bd CentOS-AppStream 29 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2024-02-23T06:24:47.829 INFO:teuthology.orchestra.run.smithi152.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 163 k 2024-02-23T06:24:47.830 INFO:teuthology.orchestra.run.smithi152.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libepoxy x86_64 1.5.8-1.el8 CentOS-AppStream 224 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libiptcdata x86_64 1.0.5-9.el9 appstream 62 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-02-23T06:24:47.831 INFO:teuthology.orchestra.run.smithi152.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libpciaccess x86_64 0.16-6.el9 baseos 28 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 501 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 5.1 M 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-02-23T06:24:47.832 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-ltdl x86_64 2.4.6-45.el9 appstream 37 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-02-23T06:24:47.833 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libEGL x86_64 23.3.0-1.el9 appstream 127 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libGL x86_64 23.3.0-1.el9 appstream 168 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libgbm x86_64 23.3.0-1.el9 appstream 38 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libglapi x86_64 23.3.0-1.el9 appstream 46 k 2024-02-23T06:24:47.834 INFO:teuthology.orchestra.run.smithi152.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: orc x86_64 0.4.31-6.el9 appstream 184 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: ostree-libs x86_64 2024.2-2.el9 appstream 484 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-02-23T06:24:47.835 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: poppler x86_64 21.01.0-19.el9 appstream 1.1 M 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-glib x86_64 21.01.0-19.el9 appstream 152 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-23T06:24:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 45 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.0.0-1668.g1fb7413e.el9 ceph 131 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-23T06:24:47.837 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-23T06:24:47.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-23T06:24:47.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-23T06:24:47.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: rtkit x86_64 0.11-28.el9 appstream 56 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-23T06:24:47.841 INFO:teuthology.orchestra.run.smithi152.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: tzdata-java noarch 2024a-1.el8 CentOS-AppStream 186 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-02-23T06:24:47.842 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: gtk3 x86_64 3.24.31-2.el9 appstream 4.9 M 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 appstream 3.3 M 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: javapackages-runtime 201801 2024-02-23T06:24:47.843 INFO:teuthology.orchestra.run.smithi152.stdout: scala 2.10 2024-02-23T06:24:47.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:24:47.844 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-02-23T06:24:47.844 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================== 2024-02-23T06:24:47.844 INFO:teuthology.orchestra.run.smithi152.stdout:Install 284 Packages 2024-02-23T06:24:47.844 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2024-02-23T06:24:47.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:24:47.845 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 299 M 2024-02-23T06:24:47.845 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-02-23T06:24:47.892 INFO:teuthology.orchestra.run.smithi142.stdout:(52/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 255 kB/s | 253 kB 00:00 2024-02-23T06:24:47.942 INFO:teuthology.orchestra.run.smithi142.stdout:(53/286): oniguruma-6.9.6-1.el9.5.x86_64.rpm 203 kB/s | 218 kB 00:01 2024-02-23T06:24:48.050 INFO:teuthology.orchestra.run.smithi142.stdout:(54/286): python3-ply-3.11-14.el9.noarch.rpm 985 kB/s | 106 kB 00:00 2024-02-23T06:24:48.159 INFO:teuthology.orchestra.run.smithi142.stdout:(55/286): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-02-23T06:24:48.266 INFO:teuthology.orchestra.run.smithi152.stdout:(1/286): ceph-19.0.0-1668.g1fb7413e.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-02-23T06:24:48.290 INFO:teuthology.orchestra.run.smithi142.stdout:(56/286): python3-requests-2.25.1-8.el9.noarch. 958 kB/s | 125 kB 00:00 2024-02-23T06:24:48.360 INFO:teuthology.orchestra.run.smithi142.stdout:(57/286): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-02-23T06:24:48.393 INFO:teuthology.orchestra.run.smithi142.stdout:(58/286): python3-urllib3-1.26.5-5.el9.noarch.r 2.0 MB/s | 215 kB 00:00 2024-02-23T06:24:48.590 INFO:teuthology.orchestra.run.smithi152.stdout:(2/286): ceph-base-19.0.0-1668.g1fb7413e.el9.x8 9.7 MB/s | 5.3 MB 00:00 2024-02-23T06:24:48.635 INFO:teuthology.orchestra.run.smithi142.stdout:(59/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.3 MB/s | 650 kB 00:00 2024-02-23T06:24:48.641 INFO:teuthology.orchestra.run.smithi152.stdout:(3/286): ceph-immutable-object-cache-19.0.0-166 2.8 MB/s | 145 kB 00:00 2024-02-23T06:24:48.799 INFO:teuthology.orchestra.run.smithi152.stdout:(4/286): ceph-mds-19.0.0-1668.g1fb7413e.el9.x86 13 MB/s | 2.1 MB 00:00 2024-02-23T06:24:48.910 INFO:teuthology.orchestra.run.smithi142.stdout:(60/286): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.9 MB/s | 523 kB 00:00 2024-02-23T06:24:48.916 INFO:teuthology.orchestra.run.smithi152.stdout:(5/286): ceph-mgr-19.0.0-1668.g1fb7413e.el9.x86 13 MB/s | 1.5 MB 00:00 2024-02-23T06:24:49.027 INFO:teuthology.orchestra.run.smithi142.stdout:(61/286): apache-commons-cli-1.4-17.el9.noarch. 607 kB/s | 71 kB 00:00 2024-02-23T06:24:49.042 INFO:teuthology.orchestra.run.smithi152.stdout:(6/286): ceph-fuse-19.0.0-1668.g1fb7413e.el9.x8 1.1 MB/s | 887 kB 00:00 2024-02-23T06:24:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:(62/286): apache-commons-codec-1.15-7.el9.noarc 2.7 MB/s | 302 kB 00:00 2024-02-23T06:24:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:(7/286): ceph-mon-19.0.0-1668.g1fb7413e.el9.x86 15 MB/s | 4.7 MB 00:00 2024-02-23T06:24:49.261 INFO:teuthology.orchestra.run.smithi142.stdout:(63/286): apache-commons-io-2.8.0-8.el9.noarch. 2.2 MB/s | 283 kB 00:00 2024-02-23T06:24:49.545 INFO:teuthology.orchestra.run.smithi142.stdout:(64/286): apache-commons-lang3-3.12.0-6.el9.noa 1.9 MB/s | 559 kB 00:00 2024-02-23T06:24:49.653 INFO:teuthology.orchestra.run.smithi142.stdout:(65/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 802 kB/s | 87 kB 00:00 2024-02-23T06:24:49.771 INFO:teuthology.orchestra.run.smithi142.stdout:(66/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-02-23T06:24:49.851 INFO:teuthology.orchestra.run.smithi152.stdout:(8/286): ceph-radosgw-19.0.0-1668.g1fb7413e.el9 16 MB/s | 9.8 MB 00:00 2024-02-23T06:24:49.879 INFO:teuthology.orchestra.run.smithi142.stdout:(67/286): atinject-1.0.3-6.el9.noarch.rpm 215 kB/s | 23 kB 00:00 2024-02-23T06:24:49.901 INFO:teuthology.orchestra.run.smithi152.stdout:(9/286): ceph-selinux-19.0.0-1668.g1fb7413e.el9 504 kB/s | 25 kB 00:00 2024-02-23T06:24:50.279 INFO:teuthology.orchestra.run.smithi142.stdout:(68/286): ceph-test-19.0.0-1668.g1fb7413e.el9.x 6.6 MB/s | 47 MB 00:07 2024-02-23T06:24:50.304 INFO:teuthology.orchestra.run.smithi142.stdout:(69/286): atk-2.36.0-5.el9.x86_64.rpm 686 kB/s | 292 kB 00:00 2024-02-23T06:24:50.413 INFO:teuthology.orchestra.run.smithi142.stdout:(70/286): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-02-23T06:24:50.513 INFO:teuthology.orchestra.run.smithi142.stdout:(71/286): cdi-api-2.0.2-6.el9.noarch.rpm 534 kB/s | 53 kB 00:00 2024-02-23T06:24:50.539 INFO:teuthology.orchestra.run.smithi142.stdout:(72/286): avahi-glib-0.8-12.el9.x86_64.rpm 57 kB/s | 15 kB 00:00 2024-02-23T06:24:50.639 INFO:teuthology.orchestra.run.smithi142.stdout:(73/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 283 kB/s | 28 kB 00:00 2024-02-23T06:24:50.697 INFO:teuthology.orchestra.run.smithi142.stdout:(74/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-02-23T06:24:50.823 INFO:teuthology.orchestra.run.smithi142.stdout:(75/286): dconf-0.40.0-6.el9.x86_64.rpm 613 kB/s | 113 kB 00:00 2024-02-23T06:24:50.964 INFO:teuthology.orchestra.run.smithi142.stdout:(76/286): exempi-2.6.0-0.2.20211007gite23c213.e 1.9 MB/s | 525 kB 00:00 2024-02-23T06:24:51.182 INFO:teuthology.orchestra.run.smithi142.stdout:(77/286): exiv2-0.27.5-2.el9.x86_64.rpm 2.7 MB/s | 980 kB 00:00 2024-02-23T06:24:51.232 INFO:teuthology.orchestra.run.smithi142.stdout:(78/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 2.9 MB/s | 781 kB 00:00 2024-02-23T06:24:51.290 INFO:teuthology.orchestra.run.smithi142.stdout:(79/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.9 MB/s | 325 kB 00:00 2024-02-23T06:24:51.357 INFO:teuthology.orchestra.run.smithi142.stdout:(80/286): flac-libs-1.3.3-12.el9.x86_64.rpm 1.7 MB/s | 218 kB 00:00 2024-02-23T06:24:51.466 INFO:teuthology.orchestra.run.smithi142.stdout:(81/286): flatpak-selinux-1.12.8-1.el9.noarch.r 197 kB/s | 21 kB 00:00 2024-02-23T06:24:51.585 INFO:teuthology.orchestra.run.smithi142.stdout:(82/286): flatpak-session-helper-1.12.8-1.el9.x 621 kB/s | 74 kB 00:00 2024-02-23T06:24:51.619 INFO:teuthology.orchestra.run.smithi142.stdout:(83/286): flatpak-1.12.8-1.el9.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2024-02-23T06:24:51.694 INFO:teuthology.orchestra.run.smithi142.stdout:(84/286): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-02-23T06:24:51.802 INFO:teuthology.orchestra.run.smithi142.stdout:(85/286): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-02-23T06:24:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:(86/286): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 887 kB/s | 88 kB 00:00 2024-02-23T06:24:52.011 INFO:teuthology.orchestra.run.smithi142.stdout:(87/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.1 MB/s | 124 kB 00:00 2024-02-23T06:24:52.120 INFO:teuthology.orchestra.run.smithi142.stdout:(88/286): giflib-5.2.1-9.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-02-23T06:24:52.320 INFO:teuthology.orchestra.run.smithi142.stdout:(89/286): google-guice-4.2.3-9.el9.noarch.rpm 2.3 MB/s | 473 kB 00:00 2024-02-23T06:24:52.428 INFO:teuthology.orchestra.run.smithi142.stdout:(90/286): graphene-1.10.6-2.el9.x86_64.rpm 595 kB/s | 64 kB 00:00 2024-02-23T06:24:52.529 INFO:teuthology.orchestra.run.smithi142.stdout:(91/286): gsm-1.0.19-6.el9.x86_64.rpm 340 kB/s | 34 kB 00:00 2024-02-23T06:24:52.710 INFO:teuthology.orchestra.run.smithi152.stdout:(10/286): ceph-test-19.0.0-1668.g1fb7413e.el9.x 17 MB/s | 47 MB 00:02 2024-02-23T06:24:52.910 INFO:teuthology.orchestra.run.smithi152.stdout:(11/286): ceph-common-19.0.0-1668.g1fb7413e.el9 4.1 MB/s | 20 MB 00:04 2024-02-23T06:24:52.926 INFO:teuthology.orchestra.run.smithi152.stdout:(12/286): libcephfs-devel-19.0.0-1668.g1fb7413e 144 kB/s | 31 kB 00:00 2024-02-23T06:24:52.971 INFO:teuthology.orchestra.run.smithi142.stdout:(92/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-02-23T06:24:52.976 INFO:teuthology.orchestra.run.smithi152.stdout:(13/286): libcephsqlite-19.0.0-1668.g1fb7413e.e 3.2 MB/s | 163 kB 00:00 2024-02-23T06:24:53.035 INFO:teuthology.orchestra.run.smithi152.stdout:(14/286): librados-devel-19.0.0-1668.g1fb7413e. 2.1 MB/s | 127 kB 00:00 2024-02-23T06:24:53.069 INFO:teuthology.orchestra.run.smithi152.stdout:(15/286): libcephfs2-19.0.0-1668.g1fb7413e.el9. 4.6 MB/s | 744 kB 00:00 2024-02-23T06:24:53.120 INFO:teuthology.orchestra.run.smithi152.stdout:(16/286): libradosstriper1-19.0.0-1668.g1fb7413 5.9 MB/s | 501 kB 00:00 2024-02-23T06:24:53.146 INFO:teuthology.orchestra.run.smithi142.stdout:(93/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.0 MB/s | 3.0 MB 00:01 2024-02-23T06:24:53.178 INFO:teuthology.orchestra.run.smithi152.stdout:(17/286): python3-ceph-argparse-19.0.0-1668.g1f 772 kB/s | 45 kB 00:00 2024-02-23T06:24:53.253 INFO:teuthology.orchestra.run.smithi152.stdout:(18/286): python3-ceph-common-19.0.0-1668.g1fb7 1.7 MB/s | 131 kB 00:00 2024-02-23T06:24:53.320 INFO:teuthology.orchestra.run.smithi152.stdout:(19/286): python3-cephfs-19.0.0-1668.g1fb7413e. 2.4 MB/s | 162 kB 00:00 2024-02-23T06:24:53.355 INFO:teuthology.orchestra.run.smithi142.stdout:(94/286): adwaita-icon-theme-40.1.1-3.el9.noarc 2.4 MB/s | 12 MB 00:04 2024-02-23T06:24:53.371 INFO:teuthology.orchestra.run.smithi142.stdout:(95/286): gtk-update-icon-cache-3.24.31-2.el9.x 157 kB/s | 35 kB 00:00 2024-02-23T06:24:53.387 INFO:teuthology.orchestra.run.smithi152.stdout:(20/286): python3-rados-19.0.0-1668.g1fb7413e.e 4.7 MB/s | 320 kB 00:00 2024-02-23T06:24:53.630 INFO:teuthology.orchestra.run.smithi152.stdout:(21/286): librgw2-19.0.0-1668.g1fb7413e.el9.x86 9.1 MB/s | 5.1 MB 00:00 2024-02-23T06:24:53.647 INFO:teuthology.orchestra.run.smithi142.stdout:(96/286): gstreamer1-plugins-base-1.22.1-2.el9. 3.3 MB/s | 2.2 MB 00:00 2024-02-23T06:24:53.655 INFO:teuthology.orchestra.run.smithi152.stdout:(22/286): python3-rbd-19.0.0-1668.g1fb7413e.el9 1.1 MB/s | 299 kB 00:00 2024-02-23T06:24:53.688 INFO:teuthology.orchestra.run.smithi152.stdout:(23/286): python3-rgw-19.0.0-1668.g1fb7413e.el9 1.7 MB/s | 100 kB 00:00 2024-02-23T06:24:53.714 INFO:teuthology.orchestra.run.smithi152.stdout:(24/286): rbd-fuse-19.0.0-1668.g1fb7413e.el9.x8 1.4 MB/s | 85 kB 00:00 2024-02-23T06:24:53.764 INFO:teuthology.orchestra.run.smithi142.stdout:(97/286): hicolor-icon-theme-0.17-13.el9.noarch 1.8 MB/s | 219 kB 00:00 2024-02-23T06:24:53.773 INFO:teuthology.orchestra.run.smithi152.stdout:(25/286): rbd-nbd-19.0.0-1668.g1fb7413e.el9.x86 2.9 MB/s | 170 kB 00:00 2024-02-23T06:24:53.814 INFO:teuthology.orchestra.run.smithi152.stdout:(26/286): ceph-grafana-dashboards-19.0.0-1668.g 758 kB/s | 31 kB 00:00 2024-02-23T06:24:53.881 INFO:teuthology.orchestra.run.smithi142.stdout:(98/286): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-02-23T06:24:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:(27/286): ceph-mgr-cephadm-19.0.0-1668.g1fb7413 2.0 MB/s | 138 kB 00:00 2024-02-23T06:24:53.974 INFO:teuthology.orchestra.run.smithi152.stdout:(28/286): rbd-mirror-19.0.0-1668.g1fb7413e.el9. 11 MB/s | 3.1 MB 00:00 2024-02-23T06:24:54.014 INFO:teuthology.orchestra.run.smithi142.stdout:(99/286): httpcomponents-core-4.4.13-7.el9.noar 4.6 MB/s | 632 kB 00:00 2024-02-23T06:24:54.049 INFO:teuthology.orchestra.run.smithi152.stdout:(29/286): ceph-mgr-dashboard-19.0.0-1668.g1fb74 11 MB/s | 1.8 MB 00:00 2024-02-23T06:24:54.141 INFO:teuthology.orchestra.run.smithi152.stdout:(30/286): ceph-mgr-modules-core-19.0.0-1668.g1f 2.6 MB/s | 248 kB 00:00 2024-02-23T06:24:54.208 INFO:teuthology.orchestra.run.smithi152.stdout:(31/286): ceph-mgr-rook-19.0.0-1668.g1fb7413e.e 740 kB/s | 49 kB 00:00 2024-02-23T06:24:54.266 INFO:teuthology.orchestra.run.smithi152.stdout:(32/286): ceph-prometheus-alerts-19.0.0-1668.g1 264 kB/s | 15 kB 00:00 2024-02-23T06:24:54.350 INFO:teuthology.orchestra.run.smithi152.stdout:(33/286): ceph-volume-19.0.0-1668.g1fb7413e.el9 3.1 MB/s | 264 kB 00:00 2024-02-23T06:24:54.439 INFO:teuthology.orchestra.run.smithi142.stdout:(100/286): gtk3-3.24.31-2.el9.x86_64.rpm 4.5 MB/s | 4.9 MB 00:01 2024-02-23T06:24:54.467 INFO:teuthology.orchestra.run.smithi152.stdout:(34/286): ceph-mgr-diskprediction-local-19.0.0- 15 MB/s | 7.4 MB 00:00 2024-02-23T06:24:54.509 INFO:teuthology.orchestra.run.smithi152.stdout:(35/286): cephadm-19.0.0-1668.g1fb7413e.el9.noa 4.6 MB/s | 748 kB 00:00 2024-02-23T06:24:54.556 INFO:teuthology.orchestra.run.smithi142.stdout:(101/286): jakarta-annotations-1.3.5-13.el9.noa 387 kB/s | 45 kB 00:00 2024-02-23T06:24:54.617 INFO:teuthology.orchestra.run.smithi152.stdout:(36/286): hawtjni-runtime-1.16-1.module_el8.0.0 279 kB/s | 42 kB 00:00 2024-02-23T06:24:54.643 INFO:teuthology.orchestra.run.smithi152.stdout:(37/286): jansi-1.17.1-1.module_el8.0.0+82+8ee6 726 kB/s | 78 kB 00:00 2024-02-23T06:24:54.668 INFO:teuthology.orchestra.run.smithi152.stdout:(38/286): jansi-native-1.7-5.module_el8.0.0+82+ 748 kB/s | 37 kB 00:00 2024-02-23T06:24:54.673 INFO:teuthology.orchestra.run.smithi142.stdout:(102/286): java-11-openjdk-11.0.18.0.10-3.el9.x 3.7 MB/s | 440 kB 00:00 2024-02-23T06:24:54.694 INFO:teuthology.orchestra.run.smithi152.stdout:(39/286): javapackages-filesystem-5.3.0-1.modul 583 kB/s | 29 kB 00:00 2024-02-23T06:24:54.727 INFO:teuthology.orchestra.run.smithi152.stdout:(40/286): libepoxy-1.5.8-1.el8.x86_64.rpm 3.7 MB/s | 224 kB 00:00 2024-02-23T06:24:54.732 INFO:teuthology.orchestra.run.smithi142.stdout:(103/286): iso-codes-4.6.0-3.el9.noarch.rpm 4.9 MB/s | 3.5 MB 00:00 2024-02-23T06:24:54.753 INFO:teuthology.orchestra.run.smithi152.stdout:(41/286): tzdata-java-2024a-1.el8.noarch.rpm 3.1 MB/s | 186 kB 00:00 2024-02-23T06:24:54.778 INFO:teuthology.orchestra.run.smithi152.stdout:(42/286): bluez-libs-5.63-1.el8.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-02-23T06:24:54.887 INFO:teuthology.orchestra.run.smithi152.stdout:(43/286): bubblewrap-0.4.1-6.el9.x86_64.rpm 463 kB/s | 50 kB 00:00 2024-02-23T06:24:54.979 INFO:teuthology.orchestra.run.smithi152.stdout:(44/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.5 MB/s | 335 kB 00:00 2024-02-23T06:24:55.021 INFO:teuthology.orchestra.run.smithi152.stdout:(45/286): cups-libs-2.3.3op2-23.el9.x86_64.rpm 1.9 MB/s | 262 kB 00:00 2024-02-23T06:24:55.046 INFO:teuthology.orchestra.run.smithi152.stdout:(46/286): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-02-23T06:24:55.080 INFO:teuthology.orchestra.run.smithi152.stdout:(47/286): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-02-23T06:24:55.138 INFO:teuthology.orchestra.run.smithi152.stdout:(48/286): libpciaccess-0.16-6.el9.x86_64.rpm 475 kB/s | 28 kB 00:00 2024-02-23T06:24:55.205 INFO:teuthology.orchestra.run.smithi152.stdout:(49/286): libgfortran-11.4.1-3.el9.x86_64.rpm 4.9 MB/s | 803 kB 00:00 2024-02-23T06:24:55.231 INFO:teuthology.orchestra.run.smithi152.stdout:(50/286): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-02-23T06:24:55.256 INFO:teuthology.orchestra.run.smithi152.stdout:(51/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-02-23T06:24:55.290 INFO:teuthology.orchestra.run.smithi152.stdout:(52/286): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-02-23T06:24:55.290 INFO:teuthology.orchestra.run.smithi142.stdout:(104/286): java-11-openjdk-devel-11.0.18.0.10-3 5.4 MB/s | 3.3 MB 00:00 2024-02-23T06:24:55.340 INFO:teuthology.orchestra.run.smithi152.stdout:(53/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-02-23T06:24:55.399 INFO:teuthology.orchestra.run.smithi142.stdout:(105/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 490 kB/s | 53 kB 00:00 2024-02-23T06:24:55.407 INFO:teuthology.orchestra.run.smithi152.stdout:(54/286): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-02-23T06:24:55.466 INFO:teuthology.orchestra.run.smithi152.stdout:(55/286): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-02-23T06:24:55.499 INFO:teuthology.orchestra.run.smithi142.stdout:(106/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 240 kB/s | 24 kB 00:00 2024-02-23T06:24:55.533 INFO:teuthology.orchestra.run.smithi152.stdout:(56/286): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-02-23T06:24:55.558 INFO:teuthology.orchestra.run.smithi152.stdout:(57/286): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-02-23T06:24:55.592 INFO:teuthology.orchestra.run.smithi152.stdout:(58/286): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-02-23T06:24:55.633 INFO:teuthology.orchestra.run.smithi142.stdout:(107/286): jsoup-1.13.1-10.el9.noarch.rpm 2.8 MB/s | 377 kB 00:00 2024-02-23T06:24:55.741 INFO:teuthology.orchestra.run.smithi142.stdout:(108/286): jsr-305-3.0.2-6.el9.noarch.rpm 328 kB/s | 35 kB 00:00 2024-02-23T06:24:55.850 INFO:teuthology.orchestra.run.smithi142.stdout:(109/286): lcms2-2.12-3.el9.x86_64.rpm 1.5 MB/s | 168 kB 00:00 2024-02-23T06:24:55.942 INFO:teuthology.orchestra.run.smithi152.stdout:(59/286): adwaita-cursor-theme-40.1.1-3.el9.noa 1.7 MB/s | 650 kB 00:00 2024-02-23T06:24:55.942 INFO:teuthology.orchestra.run.smithi142.stdout:(110/286): libX11-xcb-1.7.0-8.el9.x86_64.rpm 119 kB/s | 11 kB 00:00 2024-02-23T06:24:55.984 INFO:teuthology.orchestra.run.smithi142.stdout:(111/286): guava-30.1-6.el9.noarch.rpm 907 kB/s | 2.3 MB 00:02 2024-02-23T06:24:56.051 INFO:teuthology.orchestra.run.smithi142.stdout:(112/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 222 kB/s | 24 kB 00:00 2024-02-23T06:24:56.085 INFO:teuthology.orchestra.run.smithi142.stdout:(113/286): libXcursor-1.2.0-7.el9.x86_64.rpm 306 kB/s | 31 kB 00:00 2024-02-23T06:24:56.152 INFO:teuthology.orchestra.run.smithi142.stdout:(114/286): libXdamage-1.1.5-7.el9.x86_64.rpm 228 kB/s | 23 kB 00:00 2024-02-23T06:24:56.185 INFO:teuthology.orchestra.run.smithi142.stdout:(115/286): libXfixes-5.0.3-16.el9.x86_64.rpm 197 kB/s | 20 kB 00:00 2024-02-23T06:24:56.252 INFO:teuthology.orchestra.run.smithi142.stdout:(116/286): libXi-1.7.10-8.el9.x86_64.rpm 395 kB/s | 40 kB 00:00 2024-02-23T06:24:56.276 INFO:teuthology.orchestra.run.smithi152.stdout:(60/286): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.5 MB/s | 523 kB 00:00 2024-02-23T06:24:56.294 INFO:teuthology.orchestra.run.smithi142.stdout:(117/286): libXinerama-1.1.4-10.el9.x86_64.rpm 139 kB/s | 15 kB 00:00 2024-02-23T06:24:56.353 INFO:teuthology.orchestra.run.smithi142.stdout:(118/286): libXrandr-1.5.2-8.el9.x86_64.rpm 284 kB/s | 28 kB 00:00 2024-02-23T06:24:56.395 INFO:teuthology.orchestra.run.smithi142.stdout:(119/286): libXtst-1.2.3-16.el9.x86_64.rpm 214 kB/s | 21 kB 00:00 2024-02-23T06:24:56.453 INFO:teuthology.orchestra.run.smithi142.stdout:(120/286): libXv-1.0.11-16.el9.x86_64.rpm 191 kB/s | 19 kB 00:00 2024-02-23T06:24:56.487 INFO:teuthology.orchestra.run.smithi142.stdout:(121/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 204 kB/s | 19 kB 00:00 2024-02-23T06:24:56.545 INFO:teuthology.orchestra.run.smithi142.stdout:(122/286): libasyncns-0.8-22.el9.x86_64.rpm 331 kB/s | 30 kB 00:00 2024-02-23T06:24:56.596 INFO:teuthology.orchestra.run.smithi142.stdout:(123/286): libcanberra-0.30-27.el9.x86_64.rpm 795 kB/s | 86 kB 00:00 2024-02-23T06:24:56.609 INFO:teuthology.orchestra.run.smithi152.stdout:(61/286): apache-commons-cli-1.4-17.el9.noarch. 213 kB/s | 71 kB 00:00 2024-02-23T06:24:56.646 INFO:teuthology.orchestra.run.smithi142.stdout:(124/286): libcanberra-gtk3-0.30-27.el9.x86_64. 317 kB/s | 32 kB 00:00 2024-02-23T06:24:56.754 INFO:teuthology.orchestra.run.smithi142.stdout:(125/286): libexif-0.6.22-6.el9.x86_64.rpm 3.9 MB/s | 435 kB 00:00 2024-02-23T06:24:56.796 INFO:teuthology.orchestra.run.smithi142.stdout:(126/286): libdrm-2.4.117-1.el9.x86_64.rpm 801 kB/s | 161 kB 00:00 2024-02-23T06:24:56.855 INFO:teuthology.orchestra.run.smithi142.stdout:(127/286): libfontenc-1.1.3-17.el9.x86_64.rpm 309 kB/s | 31 kB 00:00 2024-02-23T06:24:56.915 INFO:teuthology.orchestra.run.smithi142.stdout:(128/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 760 kB/s | 83 kB 00:00 2024-02-23T06:24:56.964 INFO:teuthology.orchestra.run.smithi142.stdout:(129/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 135 kB 00:00 2024-02-23T06:24:57.014 INFO:teuthology.orchestra.run.smithi142.stdout:(130/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 338 kB/s | 37 kB 00:00 2024-02-23T06:24:57.018 INFO:teuthology.orchestra.run.smithi152.stdout:(62/286): ceph-osd-19.0.0-1668.g1fb7413e.el9.x8 2.1 MB/s | 17 MB 00:07 2024-02-23T06:24:57.081 INFO:teuthology.orchestra.run.smithi142.stdout:(131/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 142 kB 00:00 2024-02-23T06:24:57.126 INFO:teuthology.orchestra.run.smithi152.stdout:(63/286): apache-commons-codec-1.15-7.el9.noarc 584 kB/s | 302 kB 00:00 2024-02-23T06:24:57.190 INFO:teuthology.orchestra.run.smithi142.stdout:(132/286): libgxps-0.3.2-3.el9.x86_64.rpm 728 kB/s | 79 kB 00:00 2024-02-23T06:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout:(133/286): libgsf-1.14.47-5.el9.x86_64.rpm 901 kB/s | 256 kB 00:00 2024-02-23T06:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout:(134/286): libiptcdata-1.0.5-9.el9.x86_64.rpm 465 kB/s | 62 kB 00:00 2024-02-23T06:24:57.393 INFO:teuthology.orchestra.run.smithi152.stdout:(64/286): apache-commons-io-2.8.0-8.el9.noarch. 756 kB/s | 283 kB 00:00 2024-02-23T06:24:57.407 INFO:teuthology.orchestra.run.smithi142.stdout:(135/286): libldac-2.0.2.3-10.el9.x86_64.rpm 381 kB/s | 41 kB 00:00 2024-02-23T06:24:57.433 INFO:teuthology.orchestra.run.smithi142.stdout:(136/286): libnotify-0.7.9-8.el9.x86_64.rpm 401 kB/s | 44 kB 00:00 2024-02-23T06:24:57.511 INFO:teuthology.orchestra.run.smithi152.stdout:(65/286): adwaita-icon-theme-40.1.1-3.el9.noarc 6.2 MB/s | 12 MB 00:01 2024-02-23T06:24:57.516 INFO:teuthology.orchestra.run.smithi142.stdout:(137/286): libogg-1.3.4-6.el9.x86_64.rpm 309 kB/s | 34 kB 00:00 2024-02-23T06:24:57.541 INFO:teuthology.orchestra.run.smithi142.stdout:(138/286): libosinfo-1.10.0-1.el9.x86_64.rpm 2.9 MB/s | 319 kB 00:00 2024-02-23T06:24:57.580 INFO:teuthology.orchestra.run.smithi152.stdout:(66/286): apache-commons-lang3-3.12.0-6.el9.noa 1.2 MB/s | 559 kB 00:00 2024-02-23T06:24:57.650 INFO:teuthology.orchestra.run.smithi142.stdout:(139/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-02-23T06:24:57.700 INFO:teuthology.orchestra.run.smithi142.stdout:(140/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 872 kB/s | 160 kB 00:00 2024-02-23T06:24:57.767 INFO:teuthology.orchestra.run.smithi142.stdout:(141/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-02-23T06:24:57.786 INFO:teuthology.orchestra.run.smithi152.stdout:(67/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 221 kB/s | 87 kB 00:00 2024-02-23T06:24:57.803 INFO:teuthology.orchestra.run.smithi152.stdout:(68/286): atinject-1.0.3-6.el9.noarch.rpm 116 kB/s | 23 kB 00:00 2024-02-23T06:24:57.809 INFO:teuthology.orchestra.run.smithi142.stdout:(142/286): libsbc-1.4-9.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-02-23T06:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout:(143/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.9 MB/s | 206 kB 00:00 2024-02-23T06:24:57.903 INFO:teuthology.orchestra.run.smithi152.stdout:(69/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 529 kB/s | 195 kB 00:00 2024-02-23T06:24:57.985 INFO:teuthology.orchestra.run.smithi142.stdout:(144/286): libtiff-4.4.0-12.el9.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2024-02-23T06:24:58.010 INFO:teuthology.orchestra.run.smithi142.stdout:(145/286): libtheora-1.1.1-31.el9.x86_64.rpm 817 kB/s | 164 kB 00:00 2024-02-23T06:24:58.020 INFO:teuthology.orchestra.run.smithi152.stdout:(70/286): avahi-glib-0.8-12.el9.x86_64.rpm 68 kB/s | 15 kB 00:00 2024-02-23T06:24:58.085 INFO:teuthology.orchestra.run.smithi142.stdout:(146/286): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 369 kB/s | 37 kB 00:00 2024-02-23T06:24:58.112 INFO:teuthology.orchestra.run.smithi152.stdout:(71/286): atk-2.36.0-5.el9.x86_64.rpm 896 kB/s | 292 kB 00:00 2024-02-23T06:24:58.171 INFO:teuthology.orchestra.run.smithi152.stdout:(72/286): boost-program-options-1.75.0-8.el9.x8 401 kB/s | 107 kB 00:00 2024-02-23T06:24:58.194 INFO:teuthology.orchestra.run.smithi142.stdout:(147/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.3 MB/s | 144 kB 00:00 2024-02-23T06:24:58.304 INFO:teuthology.orchestra.run.smithi142.stdout:(148/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.7 MB/s | 193 kB 00:00 2024-02-23T06:24:58.305 INFO:teuthology.orchestra.run.smithi152.stdout:(73/286): cdi-api-2.0.2-6.el9.noarch.rpm 188 kB/s | 53 kB 00:00 2024-02-23T06:24:58.403 INFO:teuthology.orchestra.run.smithi142.stdout:(149/286): libwayland-client-1.21.0-1.el9.x86_6 334 kB/s | 33 kB 00:00 2024-02-23T06:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout:(150/286): libtracker-sparql-3.1.2-3.el9.x86_64 775 kB/s | 324 kB 00:00 2024-02-23T06:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout:(151/286): libwayland-cursor-1.21.0-1.el9.x86_6 194 kB/s | 19 kB 00:00 2024-02-23T06:24:58.507 INFO:teuthology.orchestra.run.smithi152.stdout:(74/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 91 kB/s | 28 kB 00:00 2024-02-23T06:24:58.530 INFO:teuthology.orchestra.run.smithi152.stdout:(75/286): colord-libs-1.4.5-4.el9.x86_64.rpm 549 kB/s | 229 kB 00:00 2024-02-23T06:24:58.537 INFO:teuthology.orchestra.run.smithi142.stdout:(152/286): libwayland-egl-1.21.0-1.el9.x86_64.r 118 kB/s | 13 kB 00:00 2024-02-23T06:24:58.604 INFO:teuthology.orchestra.run.smithi142.stdout:(153/286): libwayland-server-1.21.0-1.el9.x86_6 416 kB/s | 42 kB 00:00 2024-02-23T06:24:58.647 INFO:teuthology.orchestra.run.smithi152.stdout:(76/286): dconf-0.40.0-6.el9.x86_64.rpm 354 kB/s | 113 kB 00:00 2024-02-23T06:24:58.713 INFO:teuthology.orchestra.run.smithi142.stdout:(154/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.2 MB/s | 133 kB 00:00 2024-02-23T06:24:58.813 INFO:teuthology.orchestra.run.smithi142.stdout:(155/286): libxshmfence-1.3-10.el9.x86_64.rpm 126 kB/s | 13 kB 00:00 2024-02-23T06:24:58.838 INFO:teuthology.orchestra.run.smithi142.stdout:(156/286): libwebp-1.2.0-8.el9.x86_64.rpm 921 kB/s | 277 kB 00:00 2024-02-23T06:24:58.864 INFO:teuthology.orchestra.run.smithi152.stdout:(77/286): exempi-2.6.0-0.2.20211007gite23c213.e 1.4 MB/s | 525 kB 00:00 2024-02-23T06:24:58.905 INFO:teuthology.orchestra.run.smithi142.stdout:(157/286): low-memory-monitor-2.1-4.el9.x86_64. 390 kB/s | 36 kB 00:00 2024-02-23T06:24:58.989 INFO:teuthology.orchestra.run.smithi152.stdout:(78/286): exiv2-0.27.5-2.el9.x86_64.rpm 2.1 MB/s | 980 kB 00:00 2024-02-23T06:24:59.089 INFO:teuthology.orchestra.run.smithi142.stdout:(158/286): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-02-23T06:24:59.156 INFO:teuthology.orchestra.run.smithi142.stdout:(159/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 922 kB/s | 292 kB 00:00 2024-02-23T06:24:59.198 INFO:teuthology.orchestra.run.smithi142.stdout:(160/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-02-23T06:24:59.198 INFO:teuthology.orchestra.run.smithi152.stdout:(79/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 1.4 MB/s | 781 kB 00:00 2024-02-23T06:24:59.223 INFO:teuthology.orchestra.run.smithi152.stdout:(80/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 906 kB/s | 325 kB 00:00 2024-02-23T06:24:59.340 INFO:teuthology.orchestra.run.smithi152.stdout:(81/286): flac-libs-1.3.3-12.el9.x86_64.rpm 624 kB/s | 218 kB 00:00 2024-02-23T06:24:59.466 INFO:teuthology.orchestra.run.smithi152.stdout:(82/286): flatpak-selinux-1.12.8-1.el9.noarch.r 88 kB/s | 21 kB 00:00 2024-02-23T06:24:59.606 INFO:teuthology.orchestra.run.smithi142.stdout:(161/286): java-11-openjdk-headless-11.0.18.0.1 8.1 MB/s | 40 MB 00:04 2024-02-23T06:24:59.631 INFO:teuthology.orchestra.run.smithi142.stdout:(162/286): maven-3.6.3-15.el9.noarch.rpm 37 kB/s | 18 kB 00:00 2024-02-23T06:24:59.641 INFO:teuthology.orchestra.run.smithi152.stdout:(83/286): flatpak-session-helper-1.12.8-1.el9.x 247 kB/s | 74 kB 00:00 2024-02-23T06:24:59.666 INFO:teuthology.orchestra.run.smithi152.stdout:(84/286): flexiblas-3.0.4-8.el9.x86_64.rpm 164 kB/s | 33 kB 00:00 2024-02-23T06:24:59.673 INFO:teuthology.orchestra.run.smithi142.stdout:(163/286): maven-lib-3.6.3-15.el9.noarch.rpm 3.1 MB/s | 1.5 MB 00:00 2024-02-23T06:24:59.708 INFO:teuthology.orchestra.run.smithi152.stdout:(85/286): flatpak-1.12.8-1.el9.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2024-02-23T06:24:59.715 INFO:teuthology.orchestra.run.smithi142.stdout:(164/286): maven-openjdk11-3.6.3-15.el9.noarch. 83 kB/s | 9.0 kB 00:00 2024-02-23T06:24:59.782 INFO:teuthology.orchestra.run.smithi142.stdout:(165/286): maven-shared-utils-3.3.4-3.el9.noarc 1.4 MB/s | 151 kB 00:00 2024-02-23T06:24:59.824 INFO:teuthology.orchestra.run.smithi142.stdout:(166/286): maven-resolver-1.6.1-10.el9.noarch.r 2.6 MB/s | 517 kB 00:00 2024-02-23T06:24:59.849 INFO:teuthology.orchestra.run.smithi142.stdout:(167/286): maven-wagon-3.4.2-7.el9.noarch.rpm 839 kB/s | 112 kB 00:00 2024-02-23T06:24:59.891 INFO:teuthology.orchestra.run.smithi142.stdout:(168/286): mesa-libEGL-23.3.0-1.el9.x86_64.rpm 1.1 MB/s | 127 kB 00:00 2024-02-23T06:24:59.925 INFO:teuthology.orchestra.run.smithi152.stdout:(86/286): flexiblas-openblas-openmp-3.0.4-8.el9 70 kB/s | 18 kB 00:00 2024-02-23T06:24:59.942 INFO:teuthology.orchestra.run.smithi142.stdout:(169/286): mesa-libGL-23.3.0-1.el9.x86_64.rpm 1.4 MB/s | 168 kB 00:00 2024-02-23T06:24:59.967 INFO:teuthology.orchestra.run.smithi142.stdout:(170/286): mesa-libgbm-23.3.0-1.el9.x86_64.rpm 323 kB/s | 38 kB 00:00 2024-02-23T06:24:59.992 INFO:teuthology.orchestra.run.smithi142.stdout:(171/286): mesa-libglapi-23.3.0-1.el9.x86_64.rp 460 kB/s | 46 kB 00:00 2024-02-23T06:25:00.009 INFO:teuthology.orchestra.run.smithi152.stdout:(87/286): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 350 kB/s | 88 kB 00:00 2024-02-23T06:25:00.043 INFO:teuthology.orchestra.run.smithi142.stdout:(172/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 320 kB/s | 32 kB 00:00 2024-02-23T06:25:00.068 INFO:teuthology.orchestra.run.smithi142.stdout:(173/286): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-02-23T06:25:00.160 INFO:teuthology.orchestra.run.smithi142.stdout:(174/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.4 MB/s | 163 kB 00:00 2024-02-23T06:25:00.185 INFO:teuthology.orchestra.run.smithi142.stdout:(175/286): opus-1.3.1-10.el9.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2024-02-23T06:25:00.187 INFO:teuthology.orchestra.run.smithi152.stdout:(88/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.5 MB/s | 3.0 MB 00:00 2024-02-23T06:25:00.234 INFO:teuthology.orchestra.run.smithi152.stdout:(89/286): geoclue2-2.6.0-7.el9.x86_64.rpm 403 kB/s | 124 kB 00:00 2024-02-23T06:25:00.284 INFO:teuthology.orchestra.run.smithi152.stdout:(90/286): giflib-5.2.1-9.el9.x86_64.rpm 176 kB/s | 49 kB 00:00 2024-02-23T06:25:00.288 INFO:teuthology.orchestra.run.smithi142.stdout:(176/286): orc-0.4.31-6.el9.x86_64.rpm 1.4 MB/s | 184 kB 00:00 2024-02-23T06:25:00.322 INFO:teuthology.orchestra.run.smithi142.stdout:(177/286): osinfo-db-20231215-1.el9.noarch.rpm 3.7 MB/s | 521 kB 00:00 2024-02-23T06:25:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:(178/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 680 kB/s | 74 kB 00:00 2024-02-23T06:25:00.430 INFO:teuthology.orchestra.run.smithi142.stdout:(179/286): ostree-libs-2024.2-2.el9.x86_64.rpm 4.4 MB/s | 484 kB 00:00 2024-02-23T06:25:00.493 INFO:teuthology.orchestra.run.smithi152.stdout:(91/286): graphene-1.10.6-2.el9.x86_64.rpm 275 kB/s | 64 kB 00:00 2024-02-23T06:25:00.518 INFO:teuthology.orchestra.run.smithi152.stdout:(92/286): gsm-1.0.19-6.el9.x86_64.rpm 146 kB/s | 34 kB 00:00 2024-02-23T06:25:00.573 INFO:teuthology.orchestra.run.smithi142.stdout:(180/286): p11-kit-server-0.24.1-2.el9.x86_64.r 1.1 MB/s | 199 kB 00:00 2024-02-23T06:25:00.598 INFO:teuthology.orchestra.run.smithi142.stdout:(181/286): pipewire-1.0.1-1.el9.x86_64.rpm 637 kB/s | 107 kB 00:00 2024-02-23T06:25:00.644 INFO:teuthology.orchestra.run.smithi152.stdout:(93/286): google-guice-4.2.3-9.el9.noarch.rpm 1.0 MB/s | 473 kB 00:00 2024-02-23T06:25:00.673 INFO:teuthology.orchestra.run.smithi142.stdout:(182/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 572 kB/s | 57 kB 00:00 2024-02-23T06:25:00.690 INFO:teuthology.orchestra.run.smithi142.stdout:(183/286): pipewire-jack-audio-connection-kit-1 99 kB/s | 9.1 kB 00:00 2024-02-23T06:25:00.782 INFO:teuthology.orchestra.run.smithi142.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-02-23T06:25:00.869 INFO:teuthology.orchestra.run.smithi152.stdout:(94/286): gtk-update-icon-cache-3.24.31-2.el9.x 158 kB/s | 35 kB 00:00 2024-02-23T06:25:00.882 INFO:teuthology.orchestra.run.smithi142.stdout:(185/286): openblas-openmp-0.3.21-2.el9.x86_64. 5.3 MB/s | 4.7 MB 00:00 2024-02-23T06:25:00.907 INFO:teuthology.orchestra.run.smithi142.stdout:(186/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.5 MB/s | 192 kB 00:00 2024-02-23T06:25:00.983 INFO:teuthology.orchestra.run.smithi142.stdout:(187/286): plexus-cipher-1.7-27.el9.noarch.rpm 258 kB/s | 26 kB 00:00 2024-02-23T06:25:00.994 INFO:teuthology.orchestra.run.smithi152.stdout:(95/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 2.9 MB/s | 1.4 MB 00:00 2024-02-23T06:25:01.025 INFO:teuthology.orchestra.run.smithi142.stdout:(188/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 5.8 MB/s | 1.9 MB 00:00 2024-02-23T06:25:01.050 INFO:teuthology.orchestra.run.smithi142.stdout:(189/286): plexus-classworlds-2.6.0-11.el9.noar 422 kB/s | 60 kB 00:00 2024-02-23T06:25:01.084 INFO:teuthology.orchestra.run.smithi142.stdout:(190/286): plexus-containers-component-annotati 183 kB/s | 18 kB 00:00 2024-02-23T06:25:01.134 INFO:teuthology.orchestra.run.smithi142.stdout:(191/286): plexus-interpolation-1.26-11.el9.noa 733 kB/s | 80 kB 00:00 2024-02-23T06:25:01.168 INFO:teuthology.orchestra.run.smithi142.stdout:(192/286): plexus-sec-dispatcher-1.4-37.el9.noa 287 kB/s | 34 kB 00:00 2024-02-23T06:25:01.201 INFO:teuthology.orchestra.run.smithi142.stdout:(193/286): plexus-utils-3.3.0-10.el9.noarch.rpm 2.1 MB/s | 254 kB 00:00 2024-02-23T06:25:01.245 INFO:teuthology.orchestra.run.smithi152.stdout:(96/286): gstreamer1-plugins-base-1.22.1-2.el9. 3.1 MB/s | 2.2 MB 00:00 2024-02-23T06:25:01.251 INFO:teuthology.orchestra.run.smithi142.stdout:(194/286): poppler-21.01.0-19.el9.x86_64.rpm 9.1 MB/s | 1.1 MB 00:00 2024-02-23T06:25:01.301 INFO:teuthology.orchestra.run.smithi142.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 14 MB/s | 1.9 MB 00:00 2024-02-23T06:25:01.318 INFO:teuthology.orchestra.run.smithi142.stdout:(196/286): poppler-glib-21.01.0-19.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-02-23T06:25:01.372 INFO:teuthology.orchestra.run.smithi142.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-02-23T06:25:01.419 INFO:teuthology.orchestra.run.smithi142.stdout:(198/286): publicsuffix-list-20210518-3.el9.noa 707 kB/s | 83 kB 00:00 2024-02-23T06:25:01.461 INFO:teuthology.orchestra.run.smithi142.stdout:(199/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 4.7 MB/s | 679 kB 00:00 2024-02-23T06:25:01.470 INFO:teuthology.orchestra.run.smithi152.stdout:(97/286): gtk3-3.24.31-2.el9.x86_64.rpm 8.1 MB/s | 4.9 MB 00:00 2024-02-23T06:25:01.569 INFO:teuthology.orchestra.run.smithi142.stdout:(200/286): python3-jinja2-2.11.3-5.el9.noarch.r 2.2 MB/s | 248 kB 00:00 2024-02-23T06:25:01.595 INFO:teuthology.orchestra.run.smithi152.stdout:(98/286): hicolor-icon-theme-0.17-13.el9.noarch 625 kB/s | 219 kB 00:00 2024-02-23T06:25:01.670 INFO:teuthology.orchestra.run.smithi142.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 256 kB/s | 26 kB 00:00 2024-02-23T06:25:01.695 INFO:teuthology.orchestra.run.smithi142.stdout:(202/286): python3-devel-3.9.17-2.el9.x86_64.rp 890 kB/s | 245 kB 00:00 2024-02-23T06:25:01.737 INFO:teuthology.orchestra.run.smithi152.stdout:(99/286): guava-30.1-6.el9.noarch.rpm 3.1 MB/s | 2.3 MB 00:00 2024-02-23T06:25:01.780 INFO:teuthology.orchestra.run.smithi142.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 176 kB/s | 19 kB 00:00 2024-02-23T06:25:01.896 INFO:teuthology.orchestra.run.smithi142.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 297 kB/s | 35 kB 00:00 2024-02-23T06:25:01.921 INFO:teuthology.orchestra.run.smithi142.stdout:(205/286): python3-mako-1.1.4-6.el9.noarch.rpm 763 kB/s | 172 kB 00:00 2024-02-23T06:25:01.971 INFO:teuthology.orchestra.run.smithi152.stdout:(100/286): httpcomponents-client-4.5.13-3.el9.n 1.3 MB/s | 657 kB 00:00 2024-02-23T06:25:02.104 INFO:teuthology.orchestra.run.smithi152.stdout:(101/286): httpcomponents-core-4.4.13-7.el9.noa 1.2 MB/s | 632 kB 00:00 2024-02-23T06:25:02.146 INFO:teuthology.orchestra.run.smithi142.stdout:(206/286): python3-babel-2.9.1-2.el9.noarch.rpm 7.7 MB/s | 6.0 MB 00:00 2024-02-23T06:25:02.238 INFO:teuthology.orchestra.run.smithi142.stdout:(207/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 790 kB/s | 250 kB 00:00 2024-02-23T06:25:02.255 INFO:teuthology.orchestra.run.smithi152.stdout:(102/286): jakarta-annotations-1.3.5-13.el9.noa 159 kB/s | 45 kB 00:00 2024-02-23T06:25:02.263 INFO:teuthology.orchestra.run.smithi142.stdout:(208/286): python3-oauthlib-3.1.1-5.el9.noarch. 1.9 MB/s | 222 kB 00:00 2024-02-23T06:25:02.330 INFO:teuthology.orchestra.run.smithi152.stdout:(103/286): iso-codes-4.6.0-3.el9.noarch.rpm 6.0 MB/s | 3.5 MB 00:00 2024-02-23T06:25:02.355 INFO:teuthology.orchestra.run.smithi142.stdout:(209/286): python3-packaging-20.9-5.el9.noarch. 662 kB/s | 77 kB 00:00 2024-02-23T06:25:02.380 INFO:teuthology.orchestra.run.smithi142.stdout:(210/286): python3-prettytable-0.7.2-27.el9.noa 361 kB/s | 42 kB 00:00 2024-02-23T06:25:02.489 INFO:teuthology.orchestra.run.smithi142.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.4 MB/s | 159 kB 00:00 2024-02-23T06:25:02.514 INFO:teuthology.orchestra.run.smithi152.stdout:(104/286): java-11-openjdk-11.0.18.0.10-3.el9.x 1.1 MB/s | 440 kB 00:00 2024-02-23T06:25:02.556 INFO:teuthology.orchestra.run.smithi142.stdout:(212/286): python3-numpy-1.20.1-5.el9.x86_64.rp 7.7 MB/s | 5.1 MB 00:00 2024-02-23T06:25:02.589 INFO:teuthology.orchestra.run.smithi142.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.7 MB/s | 279 kB 00:00 2024-02-23T06:25:02.657 INFO:teuthology.orchestra.run.smithi142.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-02-23T06:25:02.682 INFO:teuthology.orchestra.run.smithi142.stdout:(215/286): python3-protobuf-3.14.0-13.el9.noarc 826 kB/s | 269 kB 00:00 2024-02-23T06:25:02.715 INFO:teuthology.orchestra.run.smithi142.stdout:(216/286): python3-requests-oauthlib-1.3.0-12.e 427 kB/s | 54 kB 00:00 2024-02-23T06:25:02.731 INFO:teuthology.orchestra.run.smithi152.stdout:(105/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 245 kB/s | 53 kB 00:00 2024-02-23T06:25:02.782 INFO:teuthology.orchestra.run.smithi142.stdout:(217/286): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-02-23T06:25:02.824 INFO:teuthology.orchestra.run.smithi142.stdout:(218/286): qatlib-23.11.0-1.el9.x86_64.rpm 1.9 MB/s | 216 kB 00:00 2024-02-23T06:25:02.873 INFO:teuthology.orchestra.run.smithi152.stdout:(106/286): java-11-openjdk-devel-11.0.18.0.10-3 5.4 MB/s | 3.3 MB 00:00 2024-02-23T06:25:02.883 INFO:teuthology.orchestra.run.smithi142.stdout:(219/286): qatlib-service-23.11.0-1.el9.x86_64. 347 kB/s | 35 kB 00:00 2024-02-23T06:25:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:(220/286): qatzip-libs-1.1.2-2.el9.x86_64.rpm 410 kB/s | 44 kB 00:00 2024-02-23T06:25:02.992 INFO:teuthology.orchestra.run.smithi142.stdout:(221/286): rtkit-0.11-28.el9.x86_64.rpm 516 kB/s | 56 kB 00:00 2024-02-23T06:25:03.006 INFO:teuthology.orchestra.run.smithi152.stdout:(107/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 87 kB/s | 24 kB 00:00 2024-02-23T06:25:03.042 INFO:teuthology.orchestra.run.smithi142.stdout:(222/286): sisu-0.3.4-10.el9.noarch.rpm 4.6 MB/s | 510 kB 00:00 2024-02-23T06:25:03.125 INFO:teuthology.orchestra.run.smithi142.stdout:(223/286): slf4j-1.7.30-13.el9.noarch.rpm 517 kB/s | 69 kB 00:00 2024-02-23T06:25:03.151 INFO:teuthology.orchestra.run.smithi142.stdout:(224/286): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-02-23T06:25:03.259 INFO:teuthology.orchestra.run.smithi142.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 1.4 MB/s | 152 kB 00:00 2024-02-23T06:25:03.265 INFO:teuthology.orchestra.run.smithi152.stdout:(108/286): jsr-305-3.0.2-6.el9.noarch.rpm 138 kB/s | 35 kB 00:00 2024-02-23T06:25:03.365 INFO:teuthology.orchestra.run.smithi152.stdout:(109/286): jsoup-1.13.1-10.el9.noarch.rpm 767 kB/s | 377 kB 00:00 2024-02-23T06:25:03.368 INFO:teuthology.orchestra.run.smithi142.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 5.0 MB/s | 555 kB 00:00 2024-02-23T06:25:03.493 INFO:teuthology.orchestra.run.smithi142.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 7.4 MB/s | 944 kB 00:00 2024-02-23T06:25:03.602 INFO:teuthology.orchestra.run.smithi142.stdout:(228/286): sound-theme-freedesktop-0.8-17.el9.n 804 kB/s | 383 kB 00:00 2024-02-23T06:25:03.652 INFO:teuthology.orchestra.run.smithi142.stdout:(229/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 335 kB/s | 53 kB 00:00 2024-02-23T06:25:03.769 INFO:teuthology.orchestra.run.smithi142.stdout:(230/286): webrtc-audio-processing-0.3.1-8.el9. 2.6 MB/s | 306 kB 00:00 2024-02-23T06:25:03.795 INFO:teuthology.orchestra.run.smithi142.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 898 kB/s | 173 kB 00:00 2024-02-23T06:25:03.832 INFO:teuthology.orchestra.run.smithi152.stdout:(110/286): java-11-openjdk-headless-11.0.18.0.1 27 MB/s | 40 MB 00:01 2024-02-23T06:25:03.887 INFO:teuthology.orchestra.run.smithi142.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 826 kB/s | 96 kB 00:00 2024-02-23T06:25:03.958 INFO:teuthology.orchestra.run.smithi152.stdout:(111/286): libX11-xcb-1.7.0-8.el9.x86_64.rpm 18 kB/s | 11 kB 00:00 2024-02-23T06:25:03.991 INFO:teuthology.orchestra.run.smithi152.stdout:(112/286): lcms2-2.12-3.el9.x86_64.rpm 231 kB/s | 168 kB 00:00 2024-02-23T06:25:03.995 INFO:teuthology.orchestra.run.smithi142.stdout:(233/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 391 kB/s | 42 kB 00:00 2024-02-23T06:25:04.141 INFO:teuthology.orchestra.run.smithi152.stdout:(113/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 79 kB/s | 24 kB 00:00 2024-02-23T06:25:04.248 INFO:teuthology.orchestra.run.smithi142.stdout:(234/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-02-23T06:25:04.266 INFO:teuthology.orchestra.run.smithi152.stdout:(114/286): libXcursor-1.2.0-7.el9.x86_64.rpm 100 kB/s | 31 kB 00:00 2024-02-23T06:25:04.308 INFO:teuthology.orchestra.run.smithi152.stdout:(115/286): libXdamage-1.1.5-7.el9.x86_64.rpm 72 kB/s | 23 kB 00:00 2024-02-23T06:25:04.337 INFO:teuthology.orchestra.run.smithi142.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 659 kB/s | 358 kB 00:00 2024-02-23T06:25:04.363 INFO:teuthology.orchestra.run.smithi142.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 1.0 MB/s | 385 kB 00:00 2024-02-23T06:25:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 963 kB/s | 134 kB 00:00 2024-02-23T06:25:04.400 INFO:teuthology.orchestra.run.smithi152.stdout:(116/286): libXfixes-5.0.3-16.el9.x86_64.rpm 77 kB/s | 20 kB 00:00 2024-02-23T06:25:04.480 INFO:teuthology.orchestra.run.smithi142.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 544 kB/s | 64 kB 00:00 2024-02-23T06:25:04.501 INFO:teuthology.orchestra.run.smithi152.stdout:(117/286): libXinerama-1.1.4-10.el9.x86_64.rpm 79 kB/s | 15 kB 00:00 2024-02-23T06:25:04.505 INFO:teuthology.orchestra.run.smithi142.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.2 MB/s | 505 kB 00:00 2024-02-23T06:25:04.526 INFO:teuthology.orchestra.run.smithi152.stdout:(118/286): libXi-1.7.10-8.el9.x86_64.rpm 153 kB/s | 40 kB 00:00 2024-02-23T06:25:04.589 INFO:teuthology.orchestra.run.smithi142.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-02-23T06:25:04.618 INFO:teuthology.orchestra.run.smithi152.stdout:(119/286): libXrandr-1.5.2-8.el9.x86_64.rpm 131 kB/s | 28 kB 00:00 2024-02-23T06:25:04.623 INFO:teuthology.orchestra.run.smithi142.stdout:(241/286): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-02-23T06:25:04.743 INFO:teuthology.orchestra.run.smithi152.stdout:(120/286): libXv-1.0.11-16.el9.x86_64.rpm 88 kB/s | 19 kB 00:00 2024-02-23T06:25:04.835 INFO:teuthology.orchestra.run.smithi152.stdout:(121/286): libXtst-1.2.3-16.el9.x86_64.rpm 64 kB/s | 21 kB 00:00 2024-02-23T06:25:04.860 INFO:teuthology.orchestra.run.smithi152.stdout:(122/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 78 kB/s | 19 kB 00:00 2024-02-23T06:25:04.994 INFO:teuthology.orchestra.run.smithi152.stdout:(123/286): libasyncns-0.8-22.el9.x86_64.rpm 122 kB/s | 30 kB 00:00 2024-02-23T06:25:05.086 INFO:teuthology.orchestra.run.smithi152.stdout:(124/286): libcanberra-gtk3-0.30-27.el9.x86_64. 142 kB/s | 32 kB 00:00 2024-02-23T06:25:05.111 INFO:teuthology.orchestra.run.smithi152.stdout:(125/286): libcanberra-0.30-27.el9.x86_64.rpm 312 kB/s | 86 kB 00:00 2024-02-23T06:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:(242/286): gperftools-libs-2.9.1-2.el9.x86_64.r 598 kB/s | 309 kB 00:00 2024-02-23T06:25:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:(243/286): abseil-cpp-20211102.0-3.el9.x86_64.r 901 kB/s | 548 kB 00:00 2024-02-23T06:25:05.232 INFO:teuthology.orchestra.run.smithi142.stdout:(244/286): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-02-23T06:25:05.265 INFO:teuthology.orchestra.run.smithi142.stdout:(245/286): xkeyboard-config-2.33-2.el9.noarch.r 926 kB/s | 859 kB 00:00 2024-02-23T06:25:05.312 INFO:teuthology.orchestra.run.smithi152.stdout:(126/286): libfontenc-1.1.3-17.el9.x86_64.rpm 156 kB/s | 31 kB 00:00 2024-02-23T06:25:05.337 INFO:teuthology.orchestra.run.smithi152.stdout:(127/286): libdrm-2.4.117-1.el9.x86_64.rpm 469 kB/s | 161 kB 00:00 2024-02-23T06:25:05.446 INFO:teuthology.orchestra.run.smithi152.stdout:(128/286): libexif-0.6.22-6.el9.x86_64.rpm 1.2 MB/s | 435 kB 00:00 2024-02-23T06:25:05.499 INFO:teuthology.orchestra.run.smithi142.stdout:(246/286): libarrow-doc-9.0.0-10.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-02-23T06:25:05.613 INFO:teuthology.orchestra.run.smithi152.stdout:(129/286): libglvnd-1.3.4-1.el9.x86_64.rpm 492 kB/s | 135 kB 00:00 2024-02-23T06:25:05.629 INFO:teuthology.orchestra.run.smithi152.stdout:(130/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 202 kB/s | 37 kB 00:00 2024-02-23T06:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout:(247/286): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-02-23T06:25:05.654 INFO:teuthology.orchestra.run.smithi152.stdout:(131/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 241 kB/s | 83 kB 00:00 2024-02-23T06:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout:(248/286): liboath-2.6.7-2.el9.x86_64.rpm 119 kB/s | 49 kB 00:00 2024-02-23T06:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout:(249/286): libunwind-1.6.2-1.el9.x86_64.rpm 336 kB/s | 67 kB 00:00 2024-02-23T06:25:05.733 INFO:teuthology.orchestra.run.smithi142.stdout:(250/286): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-02-23T06:25:05.859 INFO:teuthology.orchestra.run.smithi142.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 347 kB/s | 43 kB 00:00 2024-02-23T06:25:05.880 INFO:teuthology.orchestra.run.smithi152.stdout:(132/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 533 kB/s | 142 kB 00:00 2024-02-23T06:25:05.967 INFO:teuthology.orchestra.run.smithi142.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-02-23T06:25:05.980 INFO:teuthology.orchestra.run.smithi152.stdout:(133/286): libgxps-0.3.2-3.el9.x86_64.rpm 283 kB/s | 79 kB 00:00 2024-02-23T06:25:06.014 INFO:teuthology.orchestra.run.smithi152.stdout:(134/286): libgsf-1.14.47-5.el9.x86_64.rpm 666 kB/s | 256 kB 00:00 2024-02-23T06:25:06.017 INFO:teuthology.orchestra.run.smithi142.stdout:(253/286): python3-asyncssh-2.13.2-4.el9.noarch 1.7 MB/s | 548 kB 00:00 2024-02-23T06:25:06.059 INFO:teuthology.orchestra.run.smithi142.stdout:(254/286): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-02-23T06:25:06.085 INFO:teuthology.orchestra.run.smithi142.stdout:(255/286): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.0 MB/s | 838 kB 00:00 2024-02-23T06:25:06.106 INFO:teuthology.orchestra.run.smithi152.stdout:(135/286): libiptcdata-1.0.5-9.el9.x86_64.rpm 275 kB/s | 62 kB 00:00 2024-02-23T06:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout:(256/286): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-02-23T06:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-02-23T06:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout:(258/286): python3-google-auth-2.27.0-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-02-23T06:25:06.256 INFO:teuthology.orchestra.run.smithi152.stdout:(136/286): libnotify-0.7.9-8.el9.x86_64.rpm 180 kB/s | 44 kB 00:00 2024-02-23T06:25:06.269 INFO:teuthology.orchestra.run.smithi142.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-02-23T06:25:06.286 INFO:teuthology.orchestra.run.smithi152.stdout:(137/286): libldac-2.0.2.3-10.el9.x86_64.rpm 136 kB/s | 41 kB 00:00 2024-02-23T06:25:06.286 INFO:teuthology.orchestra.run.smithi142.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-02-23T06:25:06.316 INFO:teuthology.orchestra.run.smithi152.stdout:(138/286): libogg-1.3.4-6.el9.x86_64.rpm 161 kB/s | 34 kB 00:00 2024-02-23T06:25:06.361 INFO:teuthology.orchestra.run.smithi142.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-02-23T06:25:06.386 INFO:teuthology.orchestra.run.smithi142.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-02-23T06:25:06.453 INFO:teuthology.orchestra.run.smithi142.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-02-23T06:25:06.479 INFO:teuthology.orchestra.run.smithi142.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-02-23T06:25:06.571 INFO:teuthology.orchestra.run.smithi142.stdout:(265/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-02-23T06:25:06.591 INFO:teuthology.orchestra.run.smithi152.stdout:(139/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 200 kB/s | 45 kB 00:00 2024-02-23T06:25:06.596 INFO:teuthology.orchestra.run.smithi142.stdout:(266/286): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-02-23T06:25:06.629 INFO:teuthology.orchestra.run.smithi142.stdout:(267/286): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-02-23T06:25:06.663 INFO:teuthology.orchestra.run.smithi142.stdout:(268/286): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-02-23T06:25:06.710 INFO:teuthology.orchestra.run.smithi142.stdout:(269/286): python3-natsort-7.1.1-5.el9.noarch.r 508 kB/s | 58 kB 00:00 2024-02-23T06:25:06.739 INFO:teuthology.orchestra.run.smithi142.stdout:(270/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-02-23T06:25:06.764 INFO:teuthology.orchestra.run.smithi142.stdout:(271/286): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-02-23T06:25:06.806 INFO:teuthology.orchestra.run.smithi142.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 941 kB/s | 90 kB 00:00 2024-02-23T06:25:06.832 INFO:teuthology.orchestra.run.smithi142.stdout:(273/286): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-02-23T06:25:06.865 INFO:teuthology.orchestra.run.smithi142.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-02-23T06:25:06.898 INFO:teuthology.orchestra.run.smithi142.stdout:(275/286): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-02-23T06:25:06.924 INFO:teuthology.orchestra.run.smithi142.stdout:(276/286): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-02-23T06:25:06.924 INFO:teuthology.orchestra.run.smithi152.stdout:(140/286): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-02-23T06:25:06.958 INFO:teuthology.orchestra.run.smithi142.stdout:(277/286): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-02-23T06:25:07.008 INFO:teuthology.orchestra.run.smithi142.stdout:(278/286): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-02-23T06:25:07.033 INFO:teuthology.orchestra.run.smithi142.stdout:(279/286): python3-websocket-client-1.2.3-2.el9 826 kB/s | 90 kB 00:00 2024-02-23T06:25:07.058 INFO:teuthology.orchestra.run.smithi142.stdout:(280/286): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-02-23T06:25:07.100 INFO:teuthology.orchestra.run.smithi142.stdout:(281/286): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-02-23T06:25:07.125 INFO:teuthology.orchestra.run.smithi142.stdout:(282/286): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-02-23T06:25:07.176 INFO:teuthology.orchestra.run.smithi142.stdout:(283/286): s3cmd-2.4.0-1.el9.noarch.rpm 1.7 MB/s | 206 kB 00:00 2024-02-23T06:25:07.225 INFO:teuthology.orchestra.run.smithi152.stdout:(141/286): libsbc-1.4-9.el9.x86_64.rpm 150 kB/s | 45 kB 00:00 2024-02-23T06:25:07.309 INFO:teuthology.orchestra.run.smithi142.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-02-23T06:25:07.316 INFO:teuthology.orchestra.run.smithi152.stdout:(142/286): libosinfo-1.10.0-1.el9.x86_64.rpm 301 kB/s | 319 kB 00:01 2024-02-23T06:25:07.400 INFO:teuthology.orchestra.run.smithi152.stdout:(143/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 144 kB/s | 160 kB 00:01 2024-02-23T06:25:07.567 INFO:teuthology.orchestra.run.smithi152.stdout:(144/286): libsndfile-1.0.31-8.el9.x86_64.rpm 604 kB/s | 206 kB 00:00 2024-02-23T06:25:07.651 INFO:teuthology.orchestra.run.smithi152.stdout:(145/286): libtheora-1.1.1-31.el9.x86_64.rpm 491 kB/s | 164 kB 00:00 2024-02-23T06:25:07.692 INFO:teuthology.orchestra.run.smithi142.stdout:(285/286): librbd1-19.0.0-1668.g1fb7413e.el9.x8 6.1 MB/s | 3.1 MB 00:00 2024-02-23T06:25:07.743 INFO:teuthology.orchestra.run.smithi142.stdout:(286/286): librados2-19.0.0-1668.g1fb7413e.el9. 5.5 MB/s | 3.4 MB 00:00 2024-02-23T06:25:07.746 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-23T06:25:07.747 INFO:teuthology.orchestra.run.smithi142.stdout:Total 10 MB/s | 299 MB 00:28 2024-02-23T06:25:07.767 INFO:teuthology.orchestra.run.smithi152.stdout:(146/286): libtiff-4.4.0-12.el9.x86_64.rpm 541 kB/s | 198 kB 00:00 2024-02-23T06:25:07.793 INFO:teuthology.orchestra.run.smithi152.stdout:(147/286): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 164 kB/s | 37 kB 00:00 2024-02-23T06:25:08.085 INFO:teuthology.orchestra.run.smithi152.stdout:(148/286): libvisual-0.4.0-34.el9.x86_64.rpm 454 kB/s | 144 kB 00:00 2024-02-23T06:25:08.127 INFO:teuthology.orchestra.run.smithi152.stdout:(149/286): libvorbis-1.3.7-5.el9.x86_64.rpm 578 kB/s | 193 kB 00:00 2024-02-23T06:25:08.202 INFO:teuthology.orchestra.run.smithi152.stdout:(150/286): libtracker-sparql-3.1.2-3.el9.x86_64 587 kB/s | 324 kB 00:00 2024-02-23T06:25:08.311 INFO:teuthology.orchestra.run.smithi152.stdout:(151/286): libwayland-client-1.21.0-1.el9.x86_6 148 kB/s | 33 kB 00:00 2024-02-23T06:25:08.403 INFO:teuthology.orchestra.run.smithi152.stdout:(152/286): libwayland-cursor-1.21.0-1.el9.x86_6 77 kB/s | 19 kB 00:00 2024-02-23T06:25:08.428 INFO:teuthology.orchestra.run.smithi152.stdout:(153/286): libwayland-egl-1.21.0-1.el9.x86_64.r 64 kB/s | 13 kB 00:00 2024-02-23T06:25:08.670 INFO:teuthology.orchestra.run.smithi152.stdout:(154/286): libwayland-server-1.21.0-1.el9.x86_6 116 kB/s | 42 kB 00:00 2024-02-23T06:25:08.696 INFO:teuthology.orchestra.run.smithi152.stdout:(155/286): libwebp-1.2.0-8.el9.x86_64.rpm 949 kB/s | 277 kB 00:00 2024-02-23T06:25:08.788 INFO:teuthology.orchestra.run.smithi152.stdout:(156/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 372 kB/s | 133 kB 00:00 2024-02-23T06:25:08.888 INFO:teuthology.orchestra.run.smithi152.stdout:(157/286): low-memory-monitor-2.1-4.el9.x86_64. 187 kB/s | 36 kB 00:00 2024-02-23T06:25:08.913 INFO:teuthology.orchestra.run.smithi152.stdout:(158/286): libxshmfence-1.3-10.el9.x86_64.rpm 52 kB/s | 13 kB 00:00 2024-02-23T06:25:09.089 INFO:teuthology.orchestra.run.smithi152.stdout:(159/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 976 kB/s | 292 kB 00:00 2024-02-23T06:25:09.205 INFO:teuthology.orchestra.run.smithi152.stdout:(160/286): lua-posix-35.0-8.el9.x86_64.rpm 517 kB/s | 151 kB 00:00 2024-02-23T06:25:09.231 INFO:teuthology.orchestra.run.smithi152.stdout:(161/286): lua-5.4.4-4.el9.x86_64.rpm 553 kB/s | 188 kB 00:00 2024-02-23T06:25:09.323 INFO:teuthology.orchestra.run.smithi152.stdout:(162/286): maven-3.6.3-15.el9.noarch.rpm 76 kB/s | 18 kB 00:00 2024-02-23T06:25:09.415 INFO:teuthology.orchestra.run.smithi152.stdout:(163/286): maven-openjdk11-3.6.3-15.el9.noarch. 49 kB/s | 9.0 kB 00:00 2024-02-23T06:25:09.657 INFO:teuthology.orchestra.run.smithi152.stdout:(164/286): maven-lib-3.6.3-15.el9.noarch.rpm 3.3 MB/s | 1.5 MB 00:00 2024-02-23T06:25:09.759 INFO:teuthology.orchestra.run.smithi152.stdout:(165/286): maven-resolver-1.6.1-10.el9.noarch.r 1.2 MB/s | 517 kB 00:00 2024-02-23T06:25:09.782 INFO:teuthology.orchestra.run.smithi152.stdout:(166/286): maven-shared-utils-3.3.4-3.el9.noarc 412 kB/s | 151 kB 00:00 2024-02-23T06:25:09.958 INFO:teuthology.orchestra.run.smithi152.stdout:(167/286): maven-wagon-3.4.2-7.el9.noarch.rpm 374 kB/s | 112 kB 00:00 2024-02-23T06:25:10.058 INFO:teuthology.orchestra.run.smithi152.stdout:(168/286): mesa-libEGL-23.3.0-1.el9.x86_64.rpm 424 kB/s | 127 kB 00:00 2024-02-23T06:25:10.150 INFO:teuthology.orchestra.run.smithi152.stdout:(169/286): mesa-libGL-23.3.0-1.el9.x86_64.rpm 459 kB/s | 168 kB 00:00 2024-02-23T06:25:10.175 INFO:teuthology.orchestra.run.smithi152.stdout:(170/286): mesa-libgbm-23.3.0-1.el9.x86_64.rpm 174 kB/s | 38 kB 00:00 2024-02-23T06:25:10.300 INFO:teuthology.orchestra.run.smithi152.stdout:(171/286): mesa-libglapi-23.3.0-1.el9.x86_64.rp 192 kB/s | 46 kB 00:00 2024-02-23T06:25:10.359 INFO:teuthology.orchestra.run.smithi152.stdout:(172/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 154 kB/s | 32 kB 00:00 2024-02-23T06:25:10.409 INFO:teuthology.orchestra.run.smithi152.stdout:(173/286): openblas-0.3.21-2.el9.x86_64.rpm 151 kB/s | 35 kB 00:00 2024-02-23T06:25:10.515 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-23T06:25:10.659 INFO:teuthology.orchestra.run.smithi152.stdout:(174/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 590 kB/s | 163 kB 00:00 2024-02-23T06:25:10.694 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-23T06:25:10.695 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-23T06:25:10.727 INFO:teuthology.orchestra.run.smithi152.stdout:(175/286): opus-1.3.1-10.el9.x86_64.rpm 630 kB/s | 200 kB 00:00 2024-02-23T06:25:10.919 INFO:teuthology.orchestra.run.smithi152.stdout:(176/286): openblas-openmp-0.3.21-2.el9.x86_64. 7.7 MB/s | 4.7 MB 00:00 2024-02-23T06:25:11.177 INFO:teuthology.orchestra.run.smithi152.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 287 kB/s | 74 kB 00:00 2024-02-23T06:25:11.203 INFO:teuthology.orchestra.run.smithi152.stdout:(178/286): osinfo-db-20231215-1.el9.noarch.rpm 1.1 MB/s | 521 kB 00:00 2024-02-23T06:25:11.515 INFO:teuthology.orchestra.run.smithi152.stdout:(179/286): p11-kit-server-0.24.1-2.el9.x86_64.r 638 kB/s | 199 kB 00:00 2024-02-23T06:25:11.553 INFO:teuthology.orchestra.run.smithi152.stdout:(180/286): ostree-libs-2024.2-2.el9.x86_64.rpm 1.3 MB/s | 484 kB 00:00 2024-02-23T06:25:11.787 INFO:teuthology.orchestra.run.smithi152.stdout:(181/286): orc-0.4.31-6.el9.x86_64.rpm 163 kB/s | 184 kB 00:01 2024-02-23T06:25:11.812 INFO:teuthology.orchestra.run.smithi152.stdout:(182/286): pipewire-1.0.1-1.el9.x86_64.rpm 359 kB/s | 107 kB 00:00 2024-02-23T06:25:11.837 INFO:teuthology.orchestra.run.smithi152.stdout:(183/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 220 kB/s | 57 kB 00:00 2024-02-23T06:25:11.986 INFO:teuthology.orchestra.run.smithi152.stdout:(184/286): pipewire-jack-audio-connection-kit-1 46 kB/s | 9.1 kB 00:00 2024-02-23T06:25:12.127 INFO:teuthology.orchestra.run.smithi152.stdout:(185/286): pipewire-jack-audio-connection-kit-l 429 kB/s | 135 kB 00:00 2024-02-23T06:25:12.319 INFO:teuthology.orchestra.run.smithi152.stdout:(186/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 576 kB/s | 192 kB 00:00 2024-02-23T06:25:12.361 INFO:teuthology.orchestra.run.smithi152.stdout:(187/286): plexus-cipher-1.7-27.el9.noarch.rpm 111 kB/s | 26 kB 00:00 2024-02-23T06:25:12.438 INFO:teuthology.orchestra.run.smithi152.stdout:(188/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 3.5 MB/s | 1.9 MB 00:00 2024-02-23T06:25:12.579 INFO:teuthology.orchestra.run.smithi152.stdout:(189/286): plexus-classworlds-2.6.0-11.el9.noar 232 kB/s | 60 kB 00:00 2024-02-23T06:25:12.621 INFO:teuthology.orchestra.run.smithi152.stdout:(190/286): plexus-containers-component-annotati 78 kB/s | 18 kB 00:00 2024-02-23T06:25:12.738 INFO:teuthology.orchestra.run.smithi152.stdout:(191/286): plexus-interpolation-1.26-11.el9.noa 289 kB/s | 80 kB 00:00 2024-02-23T06:25:12.821 INFO:teuthology.orchestra.run.smithi152.stdout:(192/286): plexus-sec-dispatcher-1.4-37.el9.noa 139 kB/s | 34 kB 00:00 2024-02-23T06:25:13.021 INFO:teuthology.orchestra.run.smithi152.stdout:(193/286): plexus-utils-3.3.0-10.el9.noarch.rpm 674 kB/s | 254 kB 00:00 2024-02-23T06:25:13.139 INFO:teuthology.orchestra.run.smithi152.stdout:(194/286): poppler-21.01.0-19.el9.x86_64.rpm 2.7 MB/s | 1.1 MB 00:00 2024-02-23T06:25:13.248 INFO:teuthology.orchestra.run.smithi152.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 4.4 MB/s | 1.9 MB 00:00 2024-02-23T06:25:13.339 INFO:teuthology.orchestra.run.smithi152.stdout:(196/286): poppler-glib-21.01.0-19.el9.x86_64.r 480 kB/s | 152 kB 00:00 2024-02-23T06:25:13.531 INFO:teuthology.orchestra.run.smithi152.stdout:(197/286): publicsuffix-list-20210518-3.el9.noa 293 kB/s | 83 kB 00:00 2024-02-23T06:25:13.573 INFO:teuthology.orchestra.run.smithi152.stdout:(198/286): protobuf-3.14.0-13.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2024-02-23T06:25:13.576 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-23T06:25:13.577 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-23T06:25:13.732 INFO:teuthology.orchestra.run.smithi152.stdout:(199/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 1.7 MB/s | 679 kB 00:00 2024-02-23T06:25:14.124 INFO:teuthology.orchestra.run.smithi152.stdout:(200/286): python3-devel-3.9.17-2.el9.x86_64.rp 466 kB/s | 245 kB 00:00 2024-02-23T06:25:14.241 INFO:teuthology.orchestra.run.smithi152.stdout:(201/286): python3-jinja2-2.11.3-5.el9.noarch.r 488 kB/s | 248 kB 00:00 2024-02-23T06:25:14.341 INFO:teuthology.orchestra.run.smithi152.stdout:(202/286): python3-babel-2.9.1-2.el9.noarch.rpm 7.4 MB/s | 6.0 MB 00:00 2024-02-23T06:25:14.383 INFO:teuthology.orchestra.run.smithi152.stdout:(203/286): python3-jsonpatch-1.21-16.el9.noarch 99 kB/s | 26 kB 00:00 2024-02-23T06:25:14.550 INFO:teuthology.orchestra.run.smithi152.stdout:(204/286): python3-jsonpointer-2.0-4.el9.noarch 62 kB/s | 19 kB 00:00 2024-02-23T06:25:14.592 INFO:teuthology.orchestra.run.smithi152.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 166 kB/s | 35 kB 00:00 2024-02-23T06:25:14.701 INFO:teuthology.orchestra.run.smithi152.stdout:(206/286): python3-mako-1.1.4-6.el9.noarch.rpm 516 kB/s | 172 kB 00:00 2024-02-23T06:25:14.901 INFO:teuthology.orchestra.run.smithi152.stdout:(207/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 879 kB/s | 250 kB 00:00 2024-02-23T06:25:14.993 INFO:teuthology.orchestra.run.smithi152.stdout:(208/286): python3-oauthlib-3.1.1-5.el9.noarch. 763 kB/s | 222 kB 00:00 2024-02-23T06:25:15.135 INFO:teuthology.orchestra.run.smithi152.stdout:(209/286): python3-numpy-1.20.1-5.el9.x86_64.rp 8.7 MB/s | 5.1 MB 00:00 2024-02-23T06:25:15.160 INFO:teuthology.orchestra.run.smithi152.stdout:(210/286): python3-packaging-20.9-5.el9.noarch. 298 kB/s | 77 kB 00:00 2024-02-23T06:25:15.310 INFO:teuthology.orchestra.run.smithi152.stdout:(211/286): python3-prettytable-0.7.2-27.el9.noa 133 kB/s | 42 kB 00:00 2024-02-23T06:25:15.453 INFO:teuthology.orchestra.run.smithi152.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 544 kB/s | 159 kB 00:00 2024-02-23T06:25:15.605 INFO:teuthology.orchestra.run.smithi152.stdout:(213/286): python3-protobuf-3.14.0-13.el9.noarc 575 kB/s | 269 kB 00:00 2024-02-23T06:25:15.736 INFO:teuthology.orchestra.run.smithi152.stdout:(214/286): python3-pyasn1-modules-0.4.8-6.el9.n 655 kB/s | 279 kB 00:00 2024-02-23T06:25:15.795 INFO:teuthology.orchestra.run.smithi152.stdout:(215/286): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-02-23T06:25:15.904 INFO:teuthology.orchestra.run.smithi152.stdout:(216/286): python3-requests-oauthlib-1.3.0-12.e 196 kB/s | 54 kB 00:00 2024-02-23T06:25:16.046 INFO:teuthology.orchestra.run.smithi152.stdout:(217/286): python3-toml-0.10.2-6.el9.noarch.rpm 184 kB/s | 42 kB 00:00 2024-02-23T06:25:16.196 INFO:teuthology.orchestra.run.smithi152.stdout:(218/286): qatlib-23.11.0-1.el9.x86_64.rpm 742 kB/s | 216 kB 00:00 2024-02-23T06:25:16.238 INFO:teuthology.orchestra.run.smithi152.stdout:(219/286): qatlib-service-23.11.0-1.el9.x86_64. 182 kB/s | 35 kB 00:00 2024-02-23T06:25:16.480 INFO:teuthology.orchestra.run.smithi152.stdout:(220/286): qatzip-libs-1.1.2-2.el9.x86_64.rpm 157 kB/s | 44 kB 00:00 2024-02-23T06:25:16.505 INFO:teuthology.orchestra.run.smithi152.stdout:(221/286): rtkit-0.11-28.el9.x86_64.rpm 231 kB/s | 56 kB 00:00 2024-02-23T06:25:16.747 INFO:teuthology.orchestra.run.smithi152.stdout:(222/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-02-23T06:25:16.956 INFO:teuthology.orchestra.run.smithi152.stdout:(223/286): slf4j-1.7.30-13.el9.noarch.rpm 153 kB/s | 69 kB 00:00 2024-02-23T06:25:17.064 INFO:teuthology.orchestra.run.smithi152.stdout:(224/286): sisu-0.3.4-10.el9.noarch.rpm 874 kB/s | 510 kB 00:00 2024-02-23T06:25:17.090 INFO:teuthology.orchestra.run.smithi152.stdout:(225/286): socat-1.7.4.1-5.el9.x86_64.rpm 896 kB/s | 305 kB 00:00 2024-02-23T06:25:17.298 INFO:teuthology.orchestra.run.smithi152.stdout:(226/286): sound-theme-freedesktop-0.8-17.el9.n 1.1 MB/s | 383 kB 00:00 2024-02-23T06:25:17.391 INFO:teuthology.orchestra.run.smithi152.stdout:(227/286): totem-pl-parser-3.26.6-2.el9.x86_64. 470 kB/s | 152 kB 00:00 2024-02-23T06:25:17.633 INFO:teuthology.orchestra.run.smithi152.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 220 kB/s | 53 kB 00:00 2024-02-23T06:25:17.758 INFO:teuthology.orchestra.run.smithi152.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 2.0 MB/s | 944 kB 00:00 2024-02-23T06:25:17.933 INFO:teuthology.orchestra.run.smithi152.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 576 kB/s | 173 kB 00:00 2024-02-23T06:25:18.025 INFO:teuthology.orchestra.run.smithi152.stdout:(231/286): tracker-3.1.2-3.el9.x86_64.rpm 593 kB/s | 555 kB 00:00 2024-02-23T06:25:18.084 INFO:teuthology.orchestra.run.smithi152.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 942 kB/s | 306 kB 00:00 2024-02-23T06:25:18.225 INFO:teuthology.orchestra.run.smithi152.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 331 kB/s | 96 kB 00:00 2024-02-23T06:25:18.368 INFO:teuthology.orchestra.run.smithi152.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 163 kB/s | 42 kB 00:00 2024-02-23T06:25:18.454 INFO:teuthology.orchestra.run.smithi152.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 834 kB/s | 358 kB 00:00 2024-02-23T06:25:18.613 INFO:teuthology.orchestra.run.smithi152.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 998 kB/s | 385 kB 00:00 2024-02-23T06:25:18.696 INFO:teuthology.orchestra.run.smithi152.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 409 kB/s | 134 kB 00:00 2024-02-23T06:25:18.839 INFO:teuthology.orchestra.run.smithi152.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 283 kB/s | 64 kB 00:00 2024-02-23T06:25:18.872 INFO:teuthology.orchestra.run.smithi152.stdout:(239/286): xkeyboard-config-2.33-2.el9.noarch.r 2.0 MB/s | 859 kB 00:00 2024-02-23T06:25:18.931 INFO:teuthology.orchestra.run.smithi152.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-02-23T06:25:19.056 INFO:teuthology.orchestra.run.smithi152.stdout:(241/286): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-02-23T06:25:19.090 INFO:teuthology.orchestra.run.smithi152.stdout:(242/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 1.3 MB/s | 505 kB 00:00 2024-02-23T06:25:19.348 INFO:teuthology.orchestra.run.smithi152.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-02-23T06:25:19.548 INFO:teuthology.orchestra.run.smithi152.stdout:(244/286): abseil-cpp-20211102.0-3.el9.x86_64.r 888 kB/s | 548 kB 00:00 2024-02-23T06:25:19.607 INFO:teuthology.orchestra.run.smithi152.stdout:(245/286): gperftools-libs-2.9.1-2.el9.x86_64.r 561 kB/s | 309 kB 00:00 2024-02-23T06:25:19.640 INFO:teuthology.orchestra.run.smithi152.stdout:(246/286): libarrow-doc-9.0.0-10.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-02-23T06:25:19.707 INFO:teuthology.orchestra.run.smithi152.stdout:(247/286): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-02-23T06:25:19.741 INFO:teuthology.orchestra.run.smithi152.stdout:(248/286): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-02-23T06:25:19.858 INFO:teuthology.orchestra.run.smithi152.stdout:(249/286): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-02-23T06:25:19.983 INFO:teuthology.orchestra.run.smithi152.stdout:(250/286): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-02-23T06:25:20.117 INFO:teuthology.orchestra.run.smithi152.stdout:(251/286): python3-asyncssh-2.13.2-4.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-02-23T06:25:20.134 INFO:teuthology.orchestra.run.smithi152.stdout:(252/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 289 kB/s | 43 kB 00:00 2024-02-23T06:25:20.434 INFO:teuthology.orchestra.run.smithi152.stdout:(253/286): python3-certifi-2021.10.8-2.el9.noar 50 kB/s | 15 kB 00:00 2024-02-23T06:25:20.451 INFO:teuthology.orchestra.run.smithi152.stdout:(254/286): python3-cachetools-4.2.4-1.el9.noarc 96 kB/s | 32 kB 00:00 2024-02-23T06:25:20.518 INFO:teuthology.orchestra.run.smithi152.stdout:(255/286): libarrow-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-02-23T06:25:20.777 INFO:teuthology.orchestra.run.smithi152.stdout:(256/286): python3-cheroot-8.6.0-4.el9.noarch.r 502 kB/s | 172 kB 00:00 2024-02-23T06:25:20.802 INFO:teuthology.orchestra.run.smithi152.stdout:(257/286): python3-google-auth-2.27.0-1.el9.noa 715 kB/s | 203 kB 00:00 2024-02-23T06:25:20.827 INFO:teuthology.orchestra.run.smithi152.stdout:(258/286): python3-cherrypy-18.6.1-2.el9.noarch 954 kB/s | 358 kB 00:00 2024-02-23T06:25:21.152 INFO:teuthology.orchestra.run.smithi152.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 33 kB/s | 11 kB 00:00 2024-02-23T06:25:21.178 INFO:teuthology.orchestra.run.smithi152.stdout:(260/286): python3-grpcio-tools-1.46.7-10.el9.x 385 kB/s | 144 kB 00:00 2024-02-23T06:25:21.220 INFO:teuthology.orchestra.run.smithi152.stdout:(261/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-02-23T06:25:21.403 INFO:teuthology.orchestra.run.smithi152.stdout:(262/286): python3-jaraco-classes-3.2.1-5.el9.n 70 kB/s | 18 kB 00:00 2024-02-23T06:25:21.503 INFO:teuthology.orchestra.run.smithi152.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 69 kB/s | 19 kB 00:00 2024-02-23T06:25:21.529 INFO:teuthology.orchestra.run.smithi152.stdout:(264/286): python3-jaraco-collections-3.0.0-8.e 66 kB/s | 23 kB 00:00 2024-02-23T06:25:21.562 INFO:teuthology.orchestra.run.smithi152.stdout:(265/286): python3-jaraco-text-3.2.0-6.el9.noar 124 kB/s | 20 kB 00:00 2024-02-23T06:25:21.679 INFO:teuthology.orchestra.run.smithi152.stdout:(266/286): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-02-23T06:25:21.705 INFO:teuthology.orchestra.run.smithi152.stdout:(267/286): python3-more-itertools-8.12.0-2.el9. 555 kB/s | 79 kB 00:00 2024-02-23T06:25:21.738 INFO:teuthology.orchestra.run.smithi152.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-02-23T06:25:22.125 INFO:teuthology.orchestra.run.smithi152.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 42 kB/s | 16 kB 00:00 2024-02-23T06:25:22.147 INFO:teuthology.orchestra.run.smithi152.stdout:(270/286): python3-natsort-7.1.1-5.el9.noarch.r 123 kB/s | 58 kB 00:00 2024-02-23T06:25:22.172 INFO:teuthology.orchestra.run.smithi152.stdout:(271/286): python3-pecan-1.4.2-3.el9.noarch.rpm 583 kB/s | 272 kB 00:00 2024-02-23T06:25:22.589 INFO:teuthology.orchestra.run.smithi152.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 194 kB/s | 90 kB 00:00 2024-02-23T06:25:22.614 INFO:teuthology.orchestra.run.smithi152.stdout:(273/286): python3-repoze-lru-0.7-16.el9.noarch 66 kB/s | 31 kB 00:00 2024-02-23T06:25:22.639 INFO:teuthology.orchestra.run.smithi152.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 403 kB/s | 188 kB 00:00 2024-02-23T06:25:22.690 INFO:teuthology.orchestra.run.smithi152.stdout:(275/286): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-02-23T06:25:22.748 INFO:teuthology.orchestra.run.smithi152.stdout:(276/286): python3-tempora-5.0.0-2.el9.noarch.r 267 kB/s | 36 kB 00:00 2024-02-23T06:25:22.773 INFO:teuthology.orchestra.run.smithi152.stdout:(277/286): python3-typing-extensions-4.4.0-2.el 381 kB/s | 51 kB 00:00 2024-02-23T06:25:22.849 INFO:teuthology.orchestra.run.smithi152.stdout:(278/286): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-02-23T06:25:22.874 INFO:teuthology.orchestra.run.smithi152.stdout:(279/286): python3-websocket-client-1.2.3-2.el9 715 kB/s | 90 kB 00:00 2024-02-23T06:25:22.900 INFO:teuthology.orchestra.run.smithi152.stdout:(280/286): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-02-23T06:25:22.983 INFO:teuthology.orchestra.run.smithi152.stdout:(281/286): python3-zc-lockfile-2.0-10.el9.noarc 149 kB/s | 20 kB 00:00 2024-02-23T06:25:23.008 INFO:teuthology.orchestra.run.smithi152.stdout:(282/286): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-02-23T06:25:23.034 INFO:teuthology.orchestra.run.smithi152.stdout:(283/286): s3cmd-2.4.0-1.el9.noarch.rpm 1.5 MB/s | 206 kB 00:00 2024-02-23T06:25:23.309 INFO:teuthology.orchestra.run.smithi152.stdout:(284/286): librbd1-19.0.0-1668.g1fb7413e.el9.x8 11 MB/s | 3.1 MB 00:00 2024-02-23T06:25:23.424 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-02-23T06:25:23.434 INFO:teuthology.orchestra.run.smithi152.stdout:(285/286): thrift-0.15.0-2.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-02-23T06:25:23.570 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-02-23T06:25:23.731 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-23T06:25:23.801 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : javapackages-filesystem-5.3.0-1.module_el8.0.0+1 1/288 2024-02-23T06:25:23.830 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-02-23T06:25:23.895 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-02-23T06:25:23.937 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/288 2024-02-23T06:25:23.950 INFO:teuthology.orchestra.run.smithi152.stdout:(286/286): librados2-19.0.0-1668.g1fb7413e.el9. 3.6 MB/s | 3.4 MB 00:00 2024-02-23T06:25:23.955 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-02-23T06:25:23.956 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.3 MB/s | 299 MB 00:36 2024-02-23T06:25:23.990 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-02-23T06:25:24.023 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-02-23T06:25:24.049 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-02-23T06:25:24.111 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-02-23T06:25:24.441 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-02-23T06:25:24.483 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 10/288 2024-02-23T06:25:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 10/288 2024-02-23T06:25:24.625 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 11/288 2024-02-23T06:25:24.717 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 11/288 2024-02-23T06:25:24.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-1668.g1fb7413e.el9.x86_64 12/288 2024-02-23T06:25:24.794 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-02-23T06:25:24.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-02-23T06:25:24.855 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-02-23T06:25:24.883 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-02-23T06:25:24.914 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-02-23T06:25:24.940 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-02-23T06:25:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 19/288 2024-02-23T06:25:25.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/288 2024-02-23T06:25:25.248 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/288 2024-02-23T06:25:25.283 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/288 2024-02-23T06:25:25.336 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/288 2024-02-23T06:25:25.363 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 24/288 2024-02-23T06:25:25.459 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 24/288 2024-02-23T06:25:25.481 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86 25/288 2024-02-23T06:25:25.527 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86 25/288 2024-02-23T06:25:25.552 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/288 2024-02-23T06:25:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/288 2024-02-23T06:25:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/288 2024-02-23T06:25:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/288 2024-02-23T06:25:25.783 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/288 2024-02-23T06:25:25.890 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/288 2024-02-23T06:25:26.022 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/288 2024-02-23T06:25:26.031 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/288 2024-02-23T06:25:26.066 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-02-23T06:25:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-02-23T06:25:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-02-23T06:25:26.208 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/288 2024-02-23T06:25:26.235 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/288 2024-02-23T06:25:26.258 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : mesa-libglapi-23.3.0-1.el9.x86_64 37/288 2024-02-23T06:25:26.285 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-02-23T06:25:26.318 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-02-23T06:25:26.345 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-02-23T06:25:26.373 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 41/288 2024-02-23T06:25:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-02-23T06:25:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-02-23T06:25:26.444 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-02-23T06:25:26.471 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-02-23T06:25:26.537 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-02-23T06:25:26.588 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 46/288 2024-02-23T06:25:26.619 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-02-23T06:25:26.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 48/288 2024-02-23T06:25:26.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 49/288 2024-02-23T06:25:26.730 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 50/288 2024-02-23T06:25:26.762 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-02-23T06:25:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cups-libs-1:2.3.3op2-23.el9.x86_64 51/288 2024-02-23T06:25:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-1668.g1fb7413e.el9. 52/288 2024-02-23T06:25:26.875 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-1668.g1fb7413e.el 53/288 2024-02-23T06:25:26.917 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-1668.g1fb7413e.el9.x86_6 54/288 2024-02-23T06:25:26.944 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-02-23T06:25:26.944 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-02-23T06:25:26.993 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-02-23T06:25:27.127 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-02-23T06:25:27.178 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-02-23T06:25:27.708 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-02-23T06:25:27.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-02-23T06:25:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/288 2024-02-23T06:25:27.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/288 2024-02-23T06:25:27.941 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-02-23T06:25:27.977 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-02-23T06:25:28.009 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-02-23T06:25:28.081 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-02-23T06:25:28.110 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/288 2024-02-23T06:25:28.135 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-02-23T06:25:28.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-02-23T06:25:28.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-1668.g1fb7413e.el9.x86_6 69/288 2024-02-23T06:25:28.259 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-02-23T06:25:28.291 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-02-23T06:25:28.333 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-02-23T06:25:28.391 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-02-23T06:25:28.426 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-02-23T06:25:28.462 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-02-23T06:25:28.518 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-02-23T06:25:28.592 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/288 2024-02-23T06:25:28.634 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/288 2024-02-23T06:25:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/288 2024-02-23T06:25:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/288 2024-02-23T06:25:29.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/288 2024-02-23T06:25:29.101 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/288 2024-02-23T06:25:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/288 2024-02-23T06:25:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/288 2024-02-23T06:25:29.327 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/288 2024-02-23T06:25:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/288 2024-02-23T06:25:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 87/288 2024-02-23T06:25:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/288 2024-02-23T06:25:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/288 2024-02-23T06:25:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/288 2024-02-23T06:25:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/288 2024-02-23T06:25:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/288 2024-02-23T06:25:29.801 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-02-23T06:25:29.802 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/288 2024-02-23T06:25:29.802 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-02-23T06:25:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/288 2024-02-23T06:25:30.054 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/288 2024-02-23T06:25:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/288 2024-02-23T06:25:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/288 2024-02-23T06:25:30.159 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/288 2024-02-23T06:25:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/288 2024-02-23T06:25:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/288 2024-02-23T06:25:30.197 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-02-23T06:25:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:25:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 100/288 2024-02-23T06:25:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 101/288 2024-02-23T06:25:30.349 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 102/288 2024-02-23T06:25:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 102/288 2024-02-23T06:25:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 103/288 2024-02-23T06:25:30.702 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 104/288 2024-02-23T06:25:30.729 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rtkit-0.11-28.el9.x86_64 104/288 2024-02-23T06:25:30.740 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 104/288 2024-02-23T06:25:30.741 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-02-23T06:25:30.741 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:25:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 105/288 2024-02-23T06:25:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 106/288 2024-02-23T06:25:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 107/288 2024-02-23T06:25:30.894 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 108/288 2024-02-23T06:25:30.928 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 109/288 2024-02-23T06:25:31.009 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 110/288 2024-02-23T06:25:31.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 111/288 2024-02-23T06:25:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/288 2024-02-23T06:25:31.138 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 113/288 2024-02-23T06:25:31.237 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 114/288 2024-02-23T06:25:31.318 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/288 2024-02-23T06:25:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/288 2024-02-23T06:25:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/288 2024-02-23T06:25:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/288 2024-02-23T06:25:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/288 2024-02-23T06:25:32.282 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 120/288 2024-02-23T06:25:32.472 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/288 2024-02-23T06:25:32.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/288 2024-02-23T06:25:32.553 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 123/288 2024-02-23T06:25:32.598 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ostree-libs-2024.2-2.el9.x86_64 124/288 2024-02-23T06:25:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-02-23T06:25:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : osinfo-db-20231215-1.el9.noarch 126/288 2024-02-23T06:25:33.209 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-02-23T06:25:33.242 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : orc-0.4.31-6.el9.x86_64 128/288 2024-02-23T06:25:33.275 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-02-23T06:25:33.451 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 130/288 2024-02-23T06:25:33.481 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 131/288 2024-02-23T06:25:33.559 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-02-23T06:25:34.241 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-02-23T06:25:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-02-23T06:25:35.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-02-23T06:25:35.761 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-02-23T06:25:35.802 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/288 2024-02-23T06:25:35.830 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/288 2024-02-23T06:25:35.867 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/288 2024-02-23T06:25:35.878 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/288 2024-02-23T06:25:35.878 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-02-23T06:25:35.878 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:25:35.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/288 2024-02-23T06:25:35.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/288 2024-02-23T06:25:35.991 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/288 2024-02-23T06:25:36.306 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/288 2024-02-23T06:25:36.330 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 144/288 2024-02-23T06:25:36.413 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 144/288 2024-02-23T06:25:36.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 145/288 2024-02-23T06:25:36.486 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/288 2024-02-23T06:25:36.516 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/288 2024-02-23T06:25:36.579 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 148/288 2024-02-23T06:25:36.615 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/288 2024-02-23T06:25:36.640 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/288 2024-02-23T06:25:36.682 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/288 2024-02-23T06:25:36.713 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/288 2024-02-23T06:25:36.965 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/288 2024-02-23T06:25:37.000 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/288 2024-02-23T06:25:37.025 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libasyncns-0.8-22.el9.x86_64 154/288 2024-02-23T06:25:37.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 155/288 2024-02-23T06:25:37.077 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXv-1.0.11-16.el9.x86_64 156/288 2024-02-23T06:25:37.101 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 157/288 2024-02-23T06:25:37.130 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 158/288 2024-02-23T06:25:37.167 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 159/288 2024-02-23T06:25:37.210 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 160/288 2024-02-23T06:25:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 161/288 2024-02-23T06:25:37.298 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 162/288 2024-02-23T06:25:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : poppler-21.01.0-19.el9.x86_64 163/288 2024-02-23T06:25:37.781 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 164/288 2024-02-23T06:25:37.914 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 165/288 2024-02-23T06:25:37.981 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 166/288 2024-02-23T06:25:38.006 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 167/288 2024-02-23T06:25:38.035 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gsm-1.0.19-6.el9.x86_64 168/288 2024-02-23T06:25:38.093 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 169/288 2024-02-23T06:25:38.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 170/288 2024-02-23T06:25:38.166 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcanberra-0.30-27.el9.x86_64 171/288 2024-02-23T06:25:38.185 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 171/288 2024-02-23T06:25:38.212 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : graphene-1.10.6-2.el9.x86_64 172/288 2024-02-23T06:25:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : giflib-5.2.1-9.el9.x86_64 173/288 2024-02-23T06:25:38.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 174/288 2024-02-23T06:25:38.302 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 175/288 2024-02-23T06:25:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-02-23T06:25:39.731 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-02-23T06:25:39.894 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-02-23T06:25:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : javapackages-filesystem-5.3.0-1.module_el8.0.0+1 1/288 2024-02-23T06:25:40.012 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-02-23T06:25:40.080 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-02-23T06:25:40.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/288 2024-02-23T06:25:40.173 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-02-23T06:25:40.206 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-02-23T06:25:40.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-02-23T06:25:40.293 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-02-23T06:25:40.638 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-02-23T06:25:40.707 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 10/288 2024-02-23T06:25:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 10/288 2024-02-23T06:25:40.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 11/288 2024-02-23T06:25:40.916 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 11/288 2024-02-23T06:25:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.0.0-1668.g1fb7413e.el9.x86_64 12/288 2024-02-23T06:25:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-02-23T06:25:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-02-23T06:25:41.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-02-23T06:25:41.099 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-02-23T06:25:41.130 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-02-23T06:25:41.155 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-02-23T06:25:41.192 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 19/288 2024-02-23T06:25:41.334 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/288 2024-02-23T06:25:41.449 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/288 2024-02-23T06:25:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/288 2024-02-23T06:25:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/288 2024-02-23T06:25:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 24/288 2024-02-23T06:25:41.658 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 24/288 2024-02-23T06:25:41.680 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86 25/288 2024-02-23T06:25:41.776 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86 25/288 2024-02-23T06:25:41.801 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/288 2024-02-23T06:25:41.823 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/288 2024-02-23T06:25:41.839 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/288 2024-02-23T06:25:41.999 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/288 2024-02-23T06:25:42.031 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/288 2024-02-23T06:25:42.148 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/288 2024-02-23T06:25:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/288 2024-02-23T06:25:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/288 2024-02-23T06:25:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-02-23T06:25:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-02-23T06:25:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-02-23T06:25:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/288 2024-02-23T06:25:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/288 2024-02-23T06:25:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libglapi-23.3.0-1.el9.x86_64 37/288 2024-02-23T06:25:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-02-23T06:25:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-02-23T06:25:42.602 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-02-23T06:25:42.630 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 41/288 2024-02-23T06:25:42.662 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-02-23T06:25:42.687 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-02-23T06:25:42.728 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-02-23T06:25:42.760 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-02-23T06:25:42.833 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-02-23T06:25:42.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 46/288 2024-02-23T06:25:42.933 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-02-23T06:25:42.976 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 48/288 2024-02-23T06:25:43.012 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 49/288 2024-02-23T06:25:43.045 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-15.el9.x86_64 50/288 2024-02-23T06:25:43.128 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cups-libs-1:2.3.3op2-23.el9.x86_64 51/288 2024-02-23T06:25:43.171 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.0.0-1668.g1fb7413e.el9. 52/288 2024-02-23T06:25:43.214 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.0.0-1668.g1fb7413e.el 53/288 2024-02-23T06:25:43.256 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.0.0-1668.g1fb7413e.el9.x86_6 54/288 2024-02-23T06:25:43.331 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-02-23T06:25:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-02-23T06:25:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-02-23T06:25:44.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-02-23T06:25:44.148 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-02-23T06:25:44.182 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/288 2024-02-23T06:25:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/288 2024-02-23T06:25:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-02-23T06:25:44.325 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-02-23T06:25:44.354 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-02-23T06:25:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-02-23T06:25:44.472 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/288 2024-02-23T06:25:44.506 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-02-23T06:25:44.542 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-02-23T06:25:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.0.0-1668.g1fb7413e.el9.x86_6 69/288 2024-02-23T06:25:44.612 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-02-23T06:25:44.644 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-02-23T06:25:44.686 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-02-23T06:25:44.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-02-23T06:25:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-02-23T06:25:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-02-23T06:25:44.879 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-02-23T06:25:44.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/288 2024-02-23T06:25:44.991 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/288 2024-02-23T06:25:45.028 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/288 2024-02-23T06:25:45.075 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/288 2024-02-23T06:25:45.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/288 2024-02-23T06:25:45.162 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/288 2024-02-23T06:25:45.297 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/288 2024-02-23T06:25:45.344 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/288 2024-02-23T06:25:45.386 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/288 2024-02-23T06:25:45.480 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/288 2024-02-23T06:25:45.520 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 87/288 2024-02-23T06:25:45.560 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/288 2024-02-23T06:25:45.593 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/288 2024-02-23T06:25:45.617 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/288 2024-02-23T06:25:45.698 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/288 2024-02-23T06:25:45.819 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/288 2024-02-23T06:25:45.860 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/288 2024-02-23T06:25:46.069 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/288 2024-02-23T06:25:46.112 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/288 2024-02-23T06:25:46.143 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/288 2024-02-23T06:25:46.174 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/288 2024-02-23T06:25:46.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/288 2024-02-23T06:25:46.268 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/288 2024-02-23T06:25:46.281 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/288 2024-02-23T06:25:46.281 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-02-23T06:25:46.281 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:25:46.356 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 100/288 2024-02-23T06:25:46.407 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 101/288 2024-02-23T06:25:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 102/288 2024-02-23T06:25:46.456 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 102/288 2024-02-23T06:25:46.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 103/288 2024-02-23T06:25:46.888 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 104/288 2024-02-23T06:25:46.919 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rtkit-0.11-28.el9.x86_64 104/288 2024-02-23T06:25:46.931 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 104/288 2024-02-23T06:25:46.932 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-02-23T06:25:46.932 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:25:46.976 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 105/288 2024-02-23T06:25:47.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 106/288 2024-02-23T06:25:47.052 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 107/288 2024-02-23T06:25:47.101 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 108/288 2024-02-23T06:25:47.136 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 109/288 2024-02-23T06:25:47.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 110/288 2024-02-23T06:25:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 111/288 2024-02-23T06:25:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/288 2024-02-23T06:25:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 113/288 2024-02-23T06:25:47.453 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 114/288 2024-02-23T06:25:47.516 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/288 2024-02-23T06:25:48.278 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/288 2024-02-23T06:25:48.320 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/288 2024-02-23T06:25:48.354 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/288 2024-02-23T06:25:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/288 2024-02-23T06:25:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 120/288 2024-02-23T06:25:48.680 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/288 2024-02-23T06:25:48.726 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/288 2024-02-23T06:25:48.766 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 123/288 2024-02-23T06:25:48.819 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ostree-libs-2024.2-2.el9.x86_64 124/288 2024-02-23T06:25:49.314 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-02-23T06:25:49.381 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : osinfo-db-20231215-1.el9.noarch 126/288 2024-02-23T06:25:49.415 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-02-23T06:25:49.449 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : orc-0.4.31-6.el9.x86_64 128/288 2024-02-23T06:25:49.481 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-02-23T06:25:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.21-2.el9.x86_64 130/288 2024-02-23T06:25:49.696 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 131/288 2024-02-23T06:25:49.750 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 175/288 2024-02-23T06:25:49.783 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-02-23T06:25:49.810 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 176/288 2024-02-23T06:25:49.844 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 177/288 2024-02-23T06:25:49.888 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 178/288 2024-02-23T06:25:50.380 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 179/288 2024-02-23T06:25:50.409 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 180/288 2024-02-23T06:25:50.453 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-02-23T06:25:50.495 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 180/288 2024-02-23T06:25:50.528 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 181/288 2024-02-23T06:25:50.579 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-02-23T06:25:51.870 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-02-23T06:25:51.980 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-02-23T06:25:52.015 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/288 2024-02-23T06:25:52.043 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/288 2024-02-23T06:25:52.064 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/288 2024-02-23T06:25:52.075 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/288 2024-02-23T06:25:52.075 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-02-23T06:25:52.075 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:25:52.150 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/288 2024-02-23T06:25:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/288 2024-02-23T06:25:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/288 2024-02-23T06:25:52.523 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/288 2024-02-23T06:25:52.559 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 144/288 2024-02-23T06:25:52.658 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 144/288 2024-02-23T06:25:52.672 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 182/288 2024-02-23T06:25:52.699 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 145/288 2024-02-23T06:25:52.701 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 182/288 2024-02-23T06:25:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/288 2024-02-23T06:25:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/288 2024-02-23T06:25:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 148/288 2024-02-23T06:25:52.851 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/288 2024-02-23T06:25:52.877 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/288 2024-02-23T06:25:52.924 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/288 2024-02-23T06:25:52.950 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/288 2024-02-23T06:25:53.240 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 182/288 2024-02-23T06:25:53.280 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 183/288 2024-02-23T06:25:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/288 2024-02-23T06:25:53.372 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 183/288 2024-02-23T06:25:53.372 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-23T06:25:53.372 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-23T06:25:53.372 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:25:53.379 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/288 2024-02-23T06:25:53.404 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libasyncns-0.8-22.el9.x86_64 154/288 2024-02-23T06:25:53.406 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 184/288 2024-02-23T06:25:53.430 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 155/288 2024-02-23T06:25:53.455 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXv-1.0.11-16.el9.x86_64 156/288 2024-02-23T06:25:53.480 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 157/288 2024-02-23T06:25:53.508 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 158/288 2024-02-23T06:25:53.554 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 159/288 2024-02-23T06:25:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 160/288 2024-02-23T06:25:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 161/288 2024-02-23T06:25:53.685 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 162/288 2024-02-23T06:25:53.720 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : poppler-21.01.0-19.el9.x86_64 163/288 2024-02-23T06:25:54.192 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 164/288 2024-02-23T06:25:54.332 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 165/288 2024-02-23T06:25:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 166/288 2024-02-23T06:25:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 167/288 2024-02-23T06:25:54.439 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gsm-1.0.19-6.el9.x86_64 168/288 2024-02-23T06:25:54.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 169/288 2024-02-23T06:25:54.562 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 170/288 2024-02-23T06:25:54.595 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcanberra-0.30-27.el9.x86_64 171/288 2024-02-23T06:25:54.615 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 171/288 2024-02-23T06:25:54.641 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : graphene-1.10.6-2.el9.x86_64 172/288 2024-02-23T06:25:54.667 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : giflib-5.2.1-9.el9.x86_64 173/288 2024-02-23T06:25:54.702 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 174/288 2024-02-23T06:25:54.730 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 175/288 2024-02-23T06:26:02.346 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 184/288 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-02-23T06:26:02.347 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:02.514 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 185/288 2024-02-23T06:26:02.528 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 185/288 2024-02-23T06:26:02.529 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:02.529 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-23T06:26:02.529 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 186/288 2024-02-23T06:26:03.990 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 186/288 2024-02-23T06:26:03.990 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:03.990 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-23T06:26:03.990 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-23T06:26:03.990 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-23T06:26:03.991 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:04.199 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 187/288 2024-02-23T06:26:04.220 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 187/288 2024-02-23T06:26:04.221 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:04.221 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-23T06:26:04.221 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-23T06:26:04.221 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-23T06:26:04.221 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 188/288 2024-02-23T06:26:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 188/288 2024-02-23T06:26:04.696 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:04.696 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-23T06:26:04.696 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-23T06:26:04.696 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-23T06:26:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:04.799 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 189/288 2024-02-23T06:26:05.947 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 175/288 2024-02-23T06:26:05.995 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 176/288 2024-02-23T06:26:06.029 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 177/288 2024-02-23T06:26:06.090 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 178/288 2024-02-23T06:26:06.587 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 179/288 2024-02-23T06:26:06.620 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 180/288 2024-02-23T06:26:06.706 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 180/288 2024-02-23T06:26:06.731 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 181/288 2024-02-23T06:26:07.626 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 190/288 2024-02-23T06:26:07.741 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 191/288 2024-02-23T06:26:07.798 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 192/288 2024-02-23T06:26:07.861 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 193/288 2024-02-23T06:26:08.053 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 194/288 2024-02-23T06:26:08.111 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 195/288 2024-02-23T06:26:08.188 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 196/288 2024-02-23T06:26:08.294 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 197/288 2024-02-23T06:26:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 198/288 2024-02-23T06:26:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 199/288 2024-02-23T06:26:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 200/288 2024-02-23T06:26:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 201/288 2024-02-23T06:26:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 202/288 2024-02-23T06:26:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 203/288 2024-02-23T06:26:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 204/288 2024-02-23T06:26:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 205/288 2024-02-23T06:26:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : mesa-libgbm-23.3.0-1.el9.x86_64 206/288 2024-02-23T06:26:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 207/288 2024-02-23T06:26:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : mesa-libEGL-23.3.0-1.el9.x86_64 208/288 2024-02-23T06:26:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 209/288 2024-02-23T06:26:08.922 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : mesa-libGL-23.3.0-1.el9.x86_64 210/288 2024-02-23T06:26:08.932 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 182/288 2024-02-23T06:26:08.971 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 182/288 2024-02-23T06:26:08.986 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 211/288 2024-02-23T06:26:09.053 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 212/288 2024-02-23T06:26:09.092 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : tracker-3.1.2-3.el9.x86_64 213/288 2024-02-23T06:26:09.203 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 213/288 2024-02-23T06:26:09.247 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 214/288 2024-02-23T06:26:09.261 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 214/288 2024-02-23T06:26:09.298 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 215/288 2024-02-23T06:26:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 216/288 2024-02-23T06:26:09.512 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 182/288 2024-02-23T06:26:09.565 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 183/288 2024-02-23T06:26:09.659 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 183/288 2024-02-23T06:26:09.659 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-23T06:26:09.659 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-23T06:26:09.660 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:09.682 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 217/288 2024-02-23T06:26:09.692 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 184/288 2024-02-23T06:26:09.728 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 217/288 2024-02-23T06:26:09.753 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 217/288 2024-02-23T06:26:09.788 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bluez-libs-5.63-1.el8.x86_64 218/288 2024-02-23T06:26:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 219/288 2024-02-23T06:26:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 219/288 2024-02-23T06:26:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 219/288 2024-02-23T06:26:10.300 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-02-23T06:26:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:10.560 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 220/288 2024-02-23T06:26:10.629 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 221/288 2024-02-23T06:26:10.663 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 222/288 2024-02-23T06:26:11.155 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 223/288 2024-02-23T06:26:11.239 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 223/288 2024-02-23T06:26:11.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 224/288 2024-02-23T06:26:11.339 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 224/288 2024-02-23T06:26:11.518 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 225/288 2024-02-23T06:26:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : tzdata-java-2024a-1.el8.noarch 226/288 2024-02-23T06:26:12.453 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 227/288 2024-02-23T06:26:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 227/288 2024-02-23T06:26:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 228/288 2024-02-23T06:26:12.899 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : slf4j-1.7.30-13.el9.noarch 229/288 2024-02-23T06:26:12.927 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : atinject-1.0.3-6.el9.noarch 230/288 2024-02-23T06:26:12.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : hawtjni-runtime-1.16-1.module_el8.0.0+82+8ee6c37 231/288 2024-02-23T06:26:12.995 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 232/288 2024-02-23T06:26:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 233/288 2024-02-23T06:26:13.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 234/288 2024-02-23T06:26:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 235/288 2024-02-23T06:26:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 236/288 2024-02-23T06:26:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 237/288 2024-02-23T06:26:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 238/288 2024-02-23T06:26:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 239/288 2024-02-23T06:26:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jansi-native-1.7-5.module_el8.0.0+82+8ee6c375.x8 240/288 2024-02-23T06:26:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jansi-1.17.1-1.module_el8.0.0+82+8ee6c375.noarch 241/288 2024-02-23T06:26:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 242/288 2024-02-23T06:26:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 243/288 2024-02-23T06:26:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 244/288 2024-02-23T06:26:13.409 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 245/288 2024-02-23T06:26:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 246/288 2024-02-23T06:26:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 247/288 2024-02-23T06:26:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 248/288 2024-02-23T06:26:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jsoup-1.13.1-10.el9.noarch 249/288 2024-02-23T06:26:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 250/288 2024-02-23T06:26:13.619 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 251/288 2024-02-23T06:26:13.663 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 252/288 2024-02-23T06:26:13.695 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : guava-30.1-6.el9.noarch 253/288 2024-02-23T06:26:13.719 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : google-guice-4.2.3-9.el9.noarch 254/288 2024-02-23T06:26:13.771 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 255/288 2024-02-23T06:26:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 256/288 2024-02-23T06:26:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libepoxy-1.5.8-1.el8.x86_64 257/288 2024-02-23T06:26:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-02-23T06:26:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/288 2024-02-23T06:26:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/288 2024-02-23T06:26:14.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 260/288 2024-02-23T06:26:14.202 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 261/288 2024-02-23T06:26:14.268 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 261/288 2024-02-23T06:26:14.305 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 262/288 2024-02-23T06:26:14.312 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 262/288 2024-02-23T06:26:14.376 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/288 2024-02-23T06:26:14.397 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : maven-1:3.6.3-15.el9.noarch 264/288 2024-02-23T06:26:14.416 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 264/288 2024-02-23T06:26:14.832 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 265/288 2024-02-23T06:26:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 265/288 2024-02-23T06:26:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1668.g1fb7413e.e 266/288 2024-02-23T06:26:14.955 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1668.g1fb7413e. 267/288 2024-02-23T06:26:14.987 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noa 268/288 2024-02-23T06:26:15.216 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noa 268/288 2024-02-23T06:26:15.246 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.n 269/288 2024-02-23T06:26:16.211 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.n 269/288 2024-02-23T06:26:16.238 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb 270/288 2024-02-23T06:26:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb 270/288 2024-02-23T06:26:16.502 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1668.g1fb7413e.el 271/288 2024-02-23T06:26:16.531 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 272/288 2024-02-23T06:26:16.554 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 272/288 2024-02-23T06:26:16.554 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:16.554 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-23T06:26:16.554 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-23T06:26:16.554 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-23T06:26:16.554 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:16.599 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 273/288 2024-02-23T06:26:16.609 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 273/288 2024-02-23T06:26:16.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-1668.g1fb7413e.el9.x86_64 274/288 2024-02-23T06:26:16.663 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-02-23T06:26:16.711 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-02-23T06:26:16.734 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-02-23T06:26:16.748 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-02-23T06:26:16.748 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-02-23T06:26:16.748 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 184/288 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-02-23T06:26:18.792 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-02-23T06:26:18.793 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-02-23T06:26:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:18.947 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 185/288 2024-02-23T06:26:18.962 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 185/288 2024-02-23T06:26:18.962 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:18.962 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-23T06:26:18.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:20.406 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 186/288 2024-02-23T06:26:20.431 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 186/288 2024-02-23T06:26:20.432 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:20.432 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-23T06:26:20.432 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-23T06:26:20.432 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-23T06:26:20.432 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:20.639 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 187/288 2024-02-23T06:26:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 187/288 2024-02-23T06:26:20.662 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:20.662 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-23T06:26:20.662 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-23T06:26:20.663 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-23T06:26:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:21.124 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 188/288 2024-02-23T06:26:21.146 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 188/288 2024-02-23T06:26:21.147 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:21.147 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-23T06:26:21.147 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-23T06:26:21.147 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-23T06:26:21.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:21.251 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 189/288 2024-02-23T06:26:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-1668.g1fb7413e.el9.x86_64 278/288 2024-02-23T06:26:22.039 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 279/288 2024-02-23T06:26:22.061 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 279/288 2024-02-23T06:26:22.061 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:22.062 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-23T06:26:22.062 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-23T06:26:22.062 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-23T06:26:22.062 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:22.106 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1668.g1fb74 280/288 2024-02-23T06:26:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1668.g1fb74 280/288 2024-02-23T06:26:22.128 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:22.128 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-23T06:26:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:22.440 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 281/288 2024-02-23T06:26:22.462 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 281/288 2024-02-23T06:26:22.462 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:22.462 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-23T06:26:22.462 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-23T06:26:22.462 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-23T06:26:22.462 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:22.515 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 282/288 2024-02-23T06:26:22.546 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 283/288 2024-02-23T06:26:22.641 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-1668.g1fb7413e.el9.x86_ 284/288 2024-02-23T06:26:22.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 285/288 2024-02-23T06:26:22.729 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-02-23T06:26:22.729 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-02-23T06:26:22.830 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-02-23T06:26:22.831 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:22.904 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-02-23T06:26:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-02-23T06:26:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-02-23T06:26:22.949 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-02-23T06:26:22.949 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-02-23T06:26:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 288/288 2024-02-23T06:26:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 288/288 2024-02-23T06:26:23.085 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 288/288 2024-02-23T06:26:24.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 190/288 2024-02-23T06:26:24.233 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 191/288 2024-02-23T06:26:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 192/288 2024-02-23T06:26:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 193/288 2024-02-23T06:26:24.531 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 194/288 2024-02-23T06:26:24.593 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 195/288 2024-02-23T06:26:24.664 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 196/288 2024-02-23T06:26:24.754 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 197/288 2024-02-23T06:26:24.900 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 198/288 2024-02-23T06:26:24.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 199/288 2024-02-23T06:26:24.984 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 200/288 2024-02-23T06:26:25.025 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 201/288 2024-02-23T06:26:25.061 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-16.el9.x86_64 202/288 2024-02-23T06:26:25.089 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 203/288 2024-02-23T06:26:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 204/288 2024-02-23T06:26:25.148 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 205/288 2024-02-23T06:26:25.183 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libgbm-23.3.0-1.el9.x86_64 206/288 2024-02-23T06:26:25.217 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 207/288 2024-02-23T06:26:25.244 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libEGL-23.3.0-1.el9.x86_64 208/288 2024-02-23T06:26:25.281 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 209/288 2024-02-23T06:26:25.404 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libGL-23.3.0-1.el9.x86_64 210/288 2024-02-23T06:26:25.468 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 211/288 2024-02-23T06:26:25.543 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 212/288 2024-02-23T06:26:25.582 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : tracker-3.1.2-3.el9.x86_64 213/288 2024-02-23T06:26:25.696 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 213/288 2024-02-23T06:26:25.736 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 214/288 2024-02-23T06:26:25.751 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 214/288 2024-02-23T06:26:25.788 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 215/288 2024-02-23T06:26:25.813 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 216/288 2024-02-23T06:26:26.175 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 217/288 2024-02-23T06:26:26.208 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 217/288 2024-02-23T06:26:26.232 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 217/288 2024-02-23T06:26:26.259 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bluez-libs-5.63-1.el8.x86_64 218/288 2024-02-23T06:26:26.653 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 219/288 2024-02-23T06:26:26.688 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 219/288 2024-02-23T06:26:26.703 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 219/288 2024-02-23T06:26:26.703 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-02-23T06:26:26.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:26.938 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 220/288 2024-02-23T06:26:27.006 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 221/288 2024-02-23T06:26:27.040 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 222/288 2024-02-23T06:26:27.581 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 223/288 2024-02-23T06:26:27.666 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 223/288 2024-02-23T06:26:27.708 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 224/288 2024-02-23T06:26:27.732 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 224/288 2024-02-23T06:26:27.912 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 225/288 2024-02-23T06:26:28.816 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : tzdata-java-2024a-1.el8.noarch 226/288 2024-02-23T06:26:28.871 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 227/288 2024-02-23T06:26:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 227/288 2024-02-23T06:26:29.277 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 228/288 2024-02-23T06:26:29.308 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : slf4j-1.7.30-13.el9.noarch 229/288 2024-02-23T06:26:29.336 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : atinject-1.0.3-6.el9.noarch 230/288 2024-02-23T06:26:29.369 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : hawtjni-runtime-1.16-1.module_el8.0.0+82+8ee6c37 231/288 2024-02-23T06:26:29.404 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 232/288 2024-02-23T06:26:29.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 233/288 2024-02-23T06:26:29.468 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 234/288 2024-02-23T06:26:29.495 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 235/288 2024-02-23T06:26:29.520 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 236/288 2024-02-23T06:26:29.545 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 237/288 2024-02-23T06:26:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 238/288 2024-02-23T06:26:29.598 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 239/288 2024-02-23T06:26:29.635 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jansi-native-1.7-5.module_el8.0.0+82+8ee6c375.x8 240/288 2024-02-23T06:26:29.664 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jansi-1.17.1-1.module_el8.0.0+82+8ee6c375.noarch 241/288 2024-02-23T06:26:29.692 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 242/288 2024-02-23T06:26:29.730 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 243/288 2024-02-23T06:26:29.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 244/288 2024-02-23T06:26:29.785 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 245/288 2024-02-23T06:26:29.820 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 246/288 2024-02-23T06:26:29.851 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 247/288 2024-02-23T06:26:29.885 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 248/288 2024-02-23T06:26:29.923 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jsoup-1.13.1-10.el9.noarch 249/288 2024-02-23T06:26:29.961 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 250/288 2024-02-23T06:26:30.003 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 251/288 2024-02-23T06:26:30.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 252/288 2024-02-23T06:26:30.080 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : guava-30.1-6.el9.noarch 253/288 2024-02-23T06:26:30.103 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : google-guice-4.2.3-9.el9.noarch 254/288 2024-02-23T06:26:30.155 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 255/288 2024-02-23T06:26:30.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 256/288 2024-02-23T06:26:30.250 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libepoxy-1.5.8-1.el8.x86_64 257/288 2024-02-23T06:26:30.294 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-02-23T06:26:30.321 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/288 2024-02-23T06:26:30.499 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/288 2024-02-23T06:26:30.554 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 260/288 2024-02-23T06:26:30.577 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 261/288 2024-02-23T06:26:30.639 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 261/288 2024-02-23T06:26:30.672 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 262/288 2024-02-23T06:26:30.679 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 262/288 2024-02-23T06:26:30.709 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/288 2024-02-23T06:26:30.739 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-1:3.6.3-15.el9.noarch 264/288 2024-02-23T06:26:30.761 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 264/288 2024-02-23T06:26:31.189 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 265/288 2024-02-23T06:26:31.219 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 265/288 2024-02-23T06:26:31.270 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1668.g1fb7413e.e 266/288 2024-02-23T06:26:31.330 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1668.g1fb7413e. 267/288 2024-02-23T06:26:31.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noa 268/288 2024-02-23T06:26:31.423 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:31.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-1668.g1fb7413e.el9.x86_64 1/288 2024-02-23T06:26:31.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 2/288 2024-02-23T06:26:31.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 3/288 2024-02-23T06:26:31.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 4/288 2024-02-23T06:26:31.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1668.g1fb74 5/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 6/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 7/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 8/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 9/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 10/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 11/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-1668.g1fb7413e.el9.x86_64 12/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-1668.g1fb7413e.el9.x86_ 13/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 14/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 15/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-1668.g1fb7413e.el9.x86_6 16/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86 17/288 2024-02-23T06:26:31.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 18/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1668.g1fb7413e.el 19/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-1668.g1fb7413e.el9. 20/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-1668.g1fb7413e.el9.x86_6 21/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-1668.g1fb7413e.el9.x86_64 22/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 23/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 24/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 25/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 26/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 27/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1668.g1fb7413e. 28/288 2024-02-23T06:26:31.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noa 29/288 2024-02-23T06:26:31.451 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.n 30/288 2024-02-23T06:26:31.451 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb 31/288 2024-02-23T06:26:31.451 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1668.g1fb7413e.el 32/288 2024-02-23T06:26:31.451 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 33/288 2024-02-23T06:26:31.451 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1668.g1fb7413e.e 34/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 35/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 36/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : hawtjni-runtime-1.16-1.module_el8.0.0+82+8ee6c37 37/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jansi-1.17.1-1.module_el8.0.0+82+8ee6c375.noarch 38/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jansi-native-1.7-5.module_el8.0.0+82+8ee6c375.x8 39/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : javapackages-filesystem-5.3.0-1.module_el8.0.0+1 40/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libepoxy-1.5.8-1.el8.x86_64 41/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : tzdata-java-2024a-1.el8.noarch 42/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bluez-libs-5.63-1.el8.x86_64 43/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 44/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 45/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cups-libs-1:2.3.3op2-23.el9.x86_64 46/288 2024-02-23T06:26:31.452 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 47/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 48/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 49/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 50/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 51/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 54/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 55/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 56/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 57/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 58/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 59/288 2024-02-23T06:26:31.453 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 60/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 61/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 62/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 63/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 64/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 65/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 66/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 67/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 68/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : atinject-1.0.3-6.el9.noarch 69/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : atk-2.36.0-5.el9.x86_64 70/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 71/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 72/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 73/288 2024-02-23T06:26:31.454 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 74/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 75/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 76/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 77/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 78/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 79/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 80/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 81/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 82/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 83/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 84/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 85/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 86/288 2024-02-23T06:26:31.455 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 88/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 89/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 90/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 91/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 92/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 93/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 94/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 95/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 96/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 97/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : guava-30.1-6.el9.noarch 98/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 99/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 100/288 2024-02-23T06:26:31.456 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 101/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 102/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 103/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 104/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 105/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 106/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 107/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 108/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 109/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 110/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lcms2-2.12-3.el9.x86_64 111/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 112/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 113/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 114/288 2024-02-23T06:26:31.457 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 115/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 116/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 117/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 118/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 119/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 120/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 121/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 122/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 123/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 124/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 125/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 126/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 127/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 128/288 2024-02-23T06:26:31.458 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 129/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 130/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 131/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 132/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 133/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 134/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 135/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 136/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 137/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 138/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 139/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 140/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 141/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 142/288 2024-02-23T06:26:31.459 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsbc-1.4-9.el9.x86_64 143/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 144/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 145/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 146/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 147/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 148/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 149/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 150/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 151/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 152/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 153/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 154/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 155/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 156/288 2024-02-23T06:26:31.460 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 157/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 158/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 159/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 160/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 161/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 162/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 163/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 164/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 165/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 166/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 167/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : mesa-libEGL-23.3.0-1.el9.x86_64 168/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : mesa-libGL-23.3.0-1.el9.x86_64 169/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : mesa-libgbm-23.3.0-1.el9.x86_64 170/288 2024-02-23T06:26:31.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : mesa-libglapi-23.3.0-1.el9.x86_64 171/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 172/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 173/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 174/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 175/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : opus-1.3.1-10.el9.x86_64 176/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : orc-0.4.31-6.el9.x86_64 177/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 178/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 179/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ostree-libs-2024.2-2.el9.x86_64 180/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 181/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 182/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 183/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 184/288 2024-02-23T06:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 185/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 186/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 187/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 188/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 189/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 190/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 191/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 192/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 193/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 194/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 195/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 196/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 197/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 198/288 2024-02-23T06:26:31.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 199/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 200/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 201/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 202/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 203/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 204/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 205/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 206/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 207/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 208/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 209/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 210/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 211/288 2024-02-23T06:26:31.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 212/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 213/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 214/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 215/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 216/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 217/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 218/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 219/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 220/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 221/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rtkit-0.11-28.el9.x86_64 222/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 223/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 224/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 225/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 226/288 2024-02-23T06:26:31.465 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 227/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 228/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 229/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 230/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-02-23T06:26:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 244/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 246/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 247/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 250/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 251/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 252/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-02-23T06:26:31.467 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 255/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 258/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-02-23T06:26:31.468 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 277/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 278/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 282/288 2024-02-23T06:26:31.469 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-02-23T06:26:31.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-02-23T06:26:31.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 285/288 2024-02-23T06:26:31.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-02-23T06:26:31.470 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 287/288 2024-02-23T06:26:31.593 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noa 268/288 2024-02-23T06:26:31.628 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.n 269/288 2024-02-23T06:26:32.593 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.n 269/288 2024-02-23T06:26:32.621 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb 270/288 2024-02-23T06:26:32.722 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb 270/288 2024-02-23T06:26:32.882 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1668.g1fb7413e.el 271/288 2024-02-23T06:26:32.906 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 272/288 2024-02-23T06:26:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 272/288 2024-02-23T06:26:32.929 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:32.929 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-23T06:26:32.929 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-23T06:26:32.929 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-23T06:26:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:32.973 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 273/288 2024-02-23T06:26:32.984 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 273/288 2024-02-23T06:26:33.007 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.0.0-1668.g1fb7413e.el9.x86_64 274/288 2024-02-23T06:26:33.037 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-02-23T06:26:33.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-02-23T06:26:33.133 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-02-23T06:26:33.148 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-02-23T06:26:33.148 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-02-23T06:26:33.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:35.166 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-02-23T06:26:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.166 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: atinject-1.0.3-6.el9.noarch 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: atk-2.36.0-5.el9.x86_64 2024-02-23T06:26:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: avahi-glib-0.8-12.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: bluez-libs-5.63-1.el8.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: cdi-api-2.0.2-6.el9.noarch 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-02-23T06:26:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: cups-libs-1:2.3.3op2-23.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: dconf-0.40.0-6.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: exiv2-0.27.5-2.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flatpak-1.12.8-1.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-23T06:26:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: giflib-5.2.1-9.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: google-guice-4.2.3-9.el9.noarch 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: graphene-1.10.6-2.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gsm-1.0.19-6.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: gtk3-3.24.31-2.el9.x86_64 2024-02-23T06:26:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: guava-30.1-6.el9.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: hawtjni-runtime-1.16-1.module_el8.0.0+82+8ee6c375.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: iso-codes-4.6.0-3.el9.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: jansi-1.17.1-1.module_el8.0.0+82+8ee6c375.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: jansi-native-1.7-5.module_el8.0.0+82+8ee6c375.x86_64 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-02-23T06:26:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: jsoup-1.13.1-10.el9.noarch 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: jsr-305-3.0.2-6.el9.noarch 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: lcms2-2.12-3.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXi-1.7.10-8.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXtst-1.2.3-16.el9.x86_64 2024-02-23T06:26:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: libXv-1.0.11-16.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libasyncns-0.8-22.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libcanberra-0.30-27.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libdrm-2.4.117-1.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libepoxy-1.5.8-1.el8.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libexif-0.6.22-6.el9.x86_64 2024-02-23T06:26:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libgsf-1.14.47-5.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libgxps-0.3.2-3.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libnotify-0.7.9-8.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libpciaccess-0.16-6.el9.x86_64 2024-02-23T06:26:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libsbc-1.4-9.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libtiff-4.4.0-12.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-02-23T06:26:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libwebp-1.2.0-8.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: libxshmfence-1.3-10.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-23T06:26:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: lua-posix-35.0-8.el9.x86_64 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: maven-1:3.6.3-15.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libEGL-23.3.0-1.el9.x86_64 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libGL-23.3.0-1.el9.x86_64 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libgbm-23.3.0-1.el9.x86_64 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: mesa-libglapi-23.3.0-1.el9.x86_64 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-02-23T06:26:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: opus-1.3.1-10.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: orc-0.4.31-6.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: osinfo-db-20231215-1.el9.noarch 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: ostree-libs-2024.2-2.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-1.0.1-1.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-02-23T06:26:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-cipher-1.7-27.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: poppler-21.01.0-19.el9.x86_64 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: poppler-data-0.4.9-9.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-02-23T06:26:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-23T06:26:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-23T06:26:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-23T06:26:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-23T06:26:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: rtkit-0.11-28.el9.x86_64 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: s3cmd-2.4.0-1.el9.noarch 2024-02-23T06:26:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: sisu-1:0.3.4-10.el9.noarch 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: slf4j-1.7.30-13.el9.noarch 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: tracker-3.1.2-3.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: tzdata-java-2024a-1.el8.noarch 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: upower-0.99.11-11.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-02-23T06:26:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:35.187 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-23T06:26:35.619 DEBUG:teuthology.parallel:result is None 2024-02-23T06:26:38.403 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.0.0-1668.g1fb7413e.el9.x86_64 278/288 2024-02-23T06:26:38.446 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 279/288 2024-02-23T06:26:38.469 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 279/288 2024-02-23T06:26:38.469 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:38.469 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-23T06:26:38.469 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-23T06:26:38.469 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-23T06:26:38.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:38.513 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1668.g1fb74 280/288 2024-02-23T06:26:38.536 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1668.g1fb74 280/288 2024-02-23T06:26:38.536 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:38.536 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-23T06:26:38.536 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:38.839 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 281/288 2024-02-23T06:26:38.861 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 281/288 2024-02-23T06:26:38.862 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-23T06:26:38.862 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-23T06:26:38.862 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-23T06:26:38.862 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-23T06:26:38.862 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:38.922 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 282/288 2024-02-23T06:26:38.953 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 283/288 2024-02-23T06:26:39.056 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.0.0-1668.g1fb7413e.el9.x86_ 284/288 2024-02-23T06:26:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 285/288 2024-02-23T06:26:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-02-23T06:26:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-02-23T06:26:39.236 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-02-23T06:26:39.237 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-02-23T06:26:39.349 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-02-23T06:26:39.360 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-02-23T06:26:39.360 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-02-23T06:26:39.360 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-02-23T06:26:39.360 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:39.369 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 288/288 2024-02-23T06:26:39.441 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 288/288 2024-02-23T06:26:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 288/288 2024-02-23T06:26:48.214 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.0.0-1668.g1fb7413e.el9.x86_64 1/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 2/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 3/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 4/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1668.g1fb74 5/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 6/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 7/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 8/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 9/288 2024-02-23T06:26:48.215 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 10/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 11/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.0.0-1668.g1fb7413e.el9.x86_64 12/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.0.0-1668.g1fb7413e.el9.x86_ 13/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 14/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 15/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.0.0-1668.g1fb7413e.el9.x86_6 16/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86 17/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 18/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1668.g1fb7413e.el 19/288 2024-02-23T06:26:48.216 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.0.0-1668.g1fb7413e.el9. 20/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.0.0-1668.g1fb7413e.el9.x86_6 21/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.0.0-1668.g1fb7413e.el9.x86_64 22/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 23/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 24/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 25/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 26/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 27/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1668.g1fb7413e. 28/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noa 29/288 2024-02-23T06:26:48.217 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.n 30/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb 31/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1668.g1fb7413e.el 32/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 33/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1668.g1fb7413e.e 34/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 35/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 36/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : hawtjni-runtime-1.16-1.module_el8.0.0+82+8ee6c37 37/288 2024-02-23T06:26:48.218 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jansi-1.17.1-1.module_el8.0.0+82+8ee6c375.noarch 38/288 2024-02-23T06:26:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jansi-native-1.7-5.module_el8.0.0+82+8ee6c375.x8 39/288 2024-02-23T06:26:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : javapackages-filesystem-5.3.0-1.module_el8.0.0+1 40/288 2024-02-23T06:26:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libepoxy-1.5.8-1.el8.x86_64 41/288 2024-02-23T06:26:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : tzdata-java-2024a-1.el8.noarch 42/288 2024-02-23T06:26:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bluez-libs-5.63-1.el8.x86_64 43/288 2024-02-23T06:26:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 44/288 2024-02-23T06:26:48.220 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 45/288 2024-02-23T06:26:48.220 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cups-libs-1:2.3.3op2-23.el9.x86_64 46/288 2024-02-23T06:26:48.220 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 47/288 2024-02-23T06:26:48.220 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-16.el9.x86_64 48/288 2024-02-23T06:26:48.220 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 49/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 50/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 51/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 54/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 55/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 56/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 57/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 58/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 59/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 60/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 61/288 2024-02-23T06:26:48.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 62/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 63/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 64/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 65/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 66/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 67/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 68/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : atinject-1.0.3-6.el9.noarch 69/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : atk-2.36.0-5.el9.x86_64 70/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 71/288 2024-02-23T06:26:48.222 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 72/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 73/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 74/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 75/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 76/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 77/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 78/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 79/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 80/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 81/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 82/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 83/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 84/288 2024-02-23T06:26:48.223 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 85/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 86/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 88/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 89/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 90/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 91/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 92/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 93/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 94/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 95/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 96/288 2024-02-23T06:26:48.224 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 97/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : guava-30.1-6.el9.noarch 98/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 99/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 100/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 101/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 102/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 103/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 104/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 105/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 106/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 107/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 108/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 109/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 110/288 2024-02-23T06:26:48.225 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lcms2-2.12-3.el9.x86_64 111/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 112/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 113/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 114/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 115/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 116/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 117/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 118/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 119/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 120/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 121/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 122/288 2024-02-23T06:26:48.226 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 123/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 124/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 125/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 126/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 127/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 128/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 129/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 130/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 131/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 132/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 133/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 134/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 135/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 136/288 2024-02-23T06:26:48.227 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 137/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 138/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 139/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 140/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 141/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 142/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsbc-1.4-9.el9.x86_64 143/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 144/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 145/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 146/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 147/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 148/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 149/288 2024-02-23T06:26:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 150/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 151/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 152/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 153/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 154/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 155/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 156/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 157/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 158/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 159/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 160/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 161/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 162/288 2024-02-23T06:26:48.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 163/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 164/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 165/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 166/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 167/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libEGL-23.3.0-1.el9.x86_64 168/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libGL-23.3.0-1.el9.x86_64 169/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libgbm-23.3.0-1.el9.x86_64 170/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libglapi-23.3.0-1.el9.x86_64 171/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 172/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 173/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 174/288 2024-02-23T06:26:48.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 175/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : opus-1.3.1-10.el9.x86_64 176/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : orc-0.4.31-6.el9.x86_64 177/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 178/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 179/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ostree-libs-2024.2-2.el9.x86_64 180/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 181/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 182/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 183/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 184/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 185/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 186/288 2024-02-23T06:26:48.231 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 187/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 188/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 189/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 190/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 191/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 192/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 193/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 194/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 195/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 196/288 2024-02-23T06:26:48.232 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 197/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 198/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 199/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 200/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 201/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 202/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 203/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 204/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 205/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 206/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 207/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 208/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 209/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 210/288 2024-02-23T06:26:48.233 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 211/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 212/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 213/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 214/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 215/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 216/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 217/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 218/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 219/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 220/288 2024-02-23T06:26:48.234 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 221/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rtkit-0.11-28.el9.x86_64 222/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 223/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 224/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 225/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 226/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 227/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 228/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 229/288 2024-02-23T06:26:48.235 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 230/288 2024-02-23T06:26:48.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-02-23T06:26:48.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-02-23T06:26:48.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-02-23T06:26:48.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-02-23T06:26:48.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-02-23T06:26:48.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 244/288 2024-02-23T06:26:48.237 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 246/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 247/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 250/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 251/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 252/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 255/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-02-23T06:26:48.238 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 258/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-02-23T06:26:48.239 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-02-23T06:26:48.240 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 277/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 278/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-3.el9.x86_64 282/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-02-23T06:26:48.241 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-02-23T06:26:48.242 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 285/288 2024-02-23T06:26:48.242 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-02-23T06:26:48.242 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 287/288 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-23T06:26:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: atinject-1.0.3-6.el9.noarch 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: atk-2.36.0-5.el9.x86_64 2024-02-23T06:26:51.716 INFO:teuthology.orchestra.run.smithi152.stdout: avahi-glib-0.8-12.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: bluez-libs-5.63-1.el8.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: cdi-api-2.0.2-6.el9.noarch 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.717 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.0.0-1668.g1fb7413e.el9.noarch 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-02-23T06:26:51.718 INFO:teuthology.orchestra.run.smithi152.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: cups-libs-1:2.3.3op2-23.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: dconf-0.40.0-6.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2-0.27.5-2.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-1.12.8-1.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-23T06:26:51.719 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: giflib-5.2.1-9.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: google-guice-4.2.3-9.el9.noarch 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: graphene-1.10.6-2.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gsm-1.0.19-6.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: gtk3-3.24.31-2.el9.x86_64 2024-02-23T06:26:51.720 INFO:teuthology.orchestra.run.smithi152.stdout: guava-30.1-6.el9.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: hawtjni-runtime-1.16-1.module_el8.0.0+82+8ee6c375.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: iso-codes-4.6.0-3.el9.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: jansi-1.17.1-1.module_el8.0.0+82+8ee6c375.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: jansi-native-1.7-5.module_el8.0.0+82+8ee6c375.x86_64 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-02-23T06:26:51.721 INFO:teuthology.orchestra.run.smithi152.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-16.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: jsoup-1.13.1-10.el9.noarch 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: jsr-305-3.0.2-6.el9.noarch 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: lcms2-2.12-3.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXi-1.7.10-8.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-02-23T06:26:51.722 INFO:teuthology.orchestra.run.smithi152.stdout: libXtst-1.2.3-16.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libXv-1.0.11-16.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libasyncns-0.8-22.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra-0.30-27.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libdrm-2.4.117-1.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libepoxy-1.5.8-1.el8.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libexif-0.6.22-6.el9.x86_64 2024-02-23T06:26:51.723 INFO:teuthology.orchestra.run.smithi152.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libgsf-1.14.47-5.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libgxps-0.3.2-3.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libnotify-0.7.9-8.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-02-23T06:26:51.724 INFO:teuthology.orchestra.run.smithi152.stdout: libpciaccess-0.16-6.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libsbc-1.4-9.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libtiff-4.4.0-12.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-02-23T06:26:51.725 INFO:teuthology.orchestra.run.smithi152.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libwebp-1.2.0-8.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: libxshmfence-1.3-10.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-02-23T06:26:51.726 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: lua-posix-35.0-8.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: maven-1:3.6.3-15.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libEGL-23.3.0-1.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libGL-23.3.0-1.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libgbm-23.3.0-1.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libglapi-23.3.0-1.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-02-23T06:26:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: opus-1.3.1-10.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: orc-0.4.31-6.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db-20231215-1.el9.noarch 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: ostree-libs-2024.2-2.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-1.0.1-1.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-02-23T06:26:51.728 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-cipher-1.7-27.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-21.01.0-19.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-data-0.4.9-9.el9.noarch 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-23T06:26:51.729 INFO:teuthology.orchestra.run.smithi152.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-23T06:26:51.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-23T06:26:51.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-23T06:26:51.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-23T06:26:51.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.0.0-1668.g1fb7413e.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-3.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: rtkit-0.11-28.el9.x86_64 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: s3cmd-2.4.0-1.el9.noarch 2024-02-23T06:26:51.734 INFO:teuthology.orchestra.run.smithi152.stdout: sisu-1:0.3.4-10.el9.noarch 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: slf4j-1.7.30-13.el9.noarch 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: tracker-3.1.2-3.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: tzdata-java-2024a-1.el8.noarch 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: upower-0.99.11-11.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-02-23T06:26:51.735 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-02-23T06:26:51.736 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-02-23T06:26:51.736 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-02-23T06:26:51.736 INFO:teuthology.orchestra.run.smithi152.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-02-23T06:26:51.736 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-23T06:26:51.736 INFO:teuthology.orchestra.run.smithi152.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-02-23T06:26:51.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:51.737 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-02-23T06:26:52.148 DEBUG:teuthology.parallel:result is None 2024-02-23T06:26:52.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:26:52.521 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-23T06:26:52.627 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-1668.g1fb7413e.el9 2024-02-23T06:26:52.628 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1668.g1fb7413e.el9 2024-02-23T06:26:52.628 INFO:teuthology.task.install:The correct ceph version 19.0.0-1668.g1fb7413e is installed. 2024-02-23T06:26:52.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:26:52.772 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-23T06:26:52.889 INFO:teuthology.orchestra.run.smithi152.stdout:19.0.0-1668.g1fb7413e.el9 2024-02-23T06:26:52.889 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1668.g1fb7413e.el9 2024-02-23T06:26:52.889 INFO:teuthology.task.install:The correct ceph version 19.0.0-1668.g1fb7413e is installed. 2024-02-23T06:26:52.891 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-23T06:26:52.891 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:52.891 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-23T06:26:52.940 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:52.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-23T06:26:52.985 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-23T06:26:52.985 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:52.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-02-23T06:26:53.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-23T06:26:53.111 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:53.111 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-02-23T06:26:53.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-23T06:26:53.233 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-23T06:26:53.234 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:53.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-23T06:26:53.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-23T06:26:53.356 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:53.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-23T06:26:53.396 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-23T06:26:53.476 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-23T06:26:53.477 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:53.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-02-23T06:26:53.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-23T06:26:53.597 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:53.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-02-23T06:26:53.638 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-23T06:26:53.718 INFO:teuthology.run_tasks:Running task ceph... 2024-02-23T06:26:53.801 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-23T06:26:53.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-02-23T06:26:53.804 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2024-02-23T06:26:53.844 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-23T06:26:53.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-23T06:26:53.883 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-23T06:26:53.924 INFO:tasks.ceph:Creating extra log directories... 2024-02-23T06:26:53.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-23T06:26:53.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-23T06:26:54.040 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-23T06:26:54.040 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-23T06:26:54.040 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577', 'branch': 'wip-cbodley-testing', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7571577', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2, 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4', 'targets': {'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtw7yASYzEi18PB03+iYR3wW8O2k0vgRhFW47QLqh5Fe+UYojbO+UdVn3vtLVbVheAykvClTqOGdq99HciDkHo=', 'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcPMBWamP5QnJutz8FBXYnvE50hjNHuIdoXso9FT4S9wiSh/XUmvQROu75rXkeJdcx5znjykPgFtVnkEyXA9Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-23_03:36:00', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-23T06:26:54.041 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-23T06:26:54.043 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-23T06:26:54.070 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-02-23T06:26:54.110 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2024-02-23T06:26:54.150 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:54.150 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-02-23T06:26:54.217 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-23T06:26:54.217 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-23 06:26:23.928515549 +0000 2024-02-23T06:26:54.285 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-23 06:23:39.448878700 +0000 2024-02-23T06:26:54.286 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-23 06:23:39.448878700 +0000 2024-02-23T06:26:54.286 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-23 06:23:39.448878700 +0000 2024-02-23T06:26:54.286 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-23T06:26:54.368 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-23T06:26:54.368 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-23T06:26:54.368 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000207152 s, 2.5 MB/s 2024-02-23T06:26:54.369 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-23T06:26:54.437 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-02-23T06:26:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-23T06:26:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:54.505 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-23T06:26:54.505 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:54.506 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:54.506 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-23 06:26:23.928515549 +0000 2024-02-23T06:26:54.506 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-23 06:23:39.783871931 +0000 2024-02-23T06:26:54.506 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-23 06:23:39.783871931 +0000 2024-02-23T06:26:54.506 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-23 06:23:39.783871931 +0000 2024-02-23T06:26:54.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-23T06:26:54.583 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-23T06:26:54.583 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-23T06:26:54.583 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000166566 s, 3.1 MB/s 2024-02-23T06:26:54.584 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-23T06:26:54.652 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-02-23T06:26:54.719 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-23T06:26:54.719 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:54.719 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-23T06:26:54.719 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:54.719 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:54.719 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-23 06:26:23.929515529 +0000 2024-02-23T06:26:54.720 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-23 06:23:40.131864899 +0000 2024-02-23T06:26:54.720 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-23 06:23:40.131864899 +0000 2024-02-23T06:26:54.720 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-23 06:23:40.131864899 +0000 2024-02-23T06:26:54.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-23T06:26:54.797 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-23T06:26:54.797 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-23T06:26:54.798 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.00020211 s, 2.5 MB/s 2024-02-23T06:26:54.799 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-23T06:26:54.868 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-02-23T06:26:54.935 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-23T06:26:54.935 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:54.935 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-23T06:26:54.936 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:54.936 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:54.936 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-23 06:26:23.929515529 +0000 2024-02-23T06:26:54.936 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-23 06:23:40.467858110 +0000 2024-02-23T06:26:54.936 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-23 06:23:40.467858110 +0000 2024-02-23T06:26:54.936 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-23 06:23:40.467858110 +0000 2024-02-23T06:26:54.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-23T06:26:55.012 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-23T06:26:55.012 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-23T06:26:55.013 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000264001 s, 1.9 MB/s 2024-02-23T06:26:55.013 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-23T06:26:55.082 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-23T06:26:55.083 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:55.083 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-02-23T06:26:55.117 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-23T06:26:55.117 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-23 06:26:40.438649616 +0000 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-23 06:23:40.359663400 +0000 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-23 06:23:40.359663400 +0000 2024-02-23T06:26:55.189 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-23 06:23:40.359663400 +0000 2024-02-23T06:26:55.190 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-23T06:26:55.272 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-23T06:26:55.272 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-23T06:26:55.272 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00022291 s, 2.3 MB/s 2024-02-23T06:26:55.273 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-23T06:26:55.343 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-02-23T06:26:55.411 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-23T06:26:55.411 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:55.411 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-23T06:26:55.412 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:55.412 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:55.412 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-23 06:26:40.439649604 +0000 2024-02-23T06:26:55.412 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-23 06:23:40.701659190 +0000 2024-02-23T06:26:55.412 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-23 06:23:40.701659190 +0000 2024-02-23T06:26:55.412 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-23 06:23:40.701659190 +0000 2024-02-23T06:26:55.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-23T06:26:55.491 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-23T06:26:55.491 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-23T06:26:55.491 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000273502 s, 1.9 MB/s 2024-02-23T06:26:55.492 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-23T06:26:55.560 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-02-23T06:26:55.627 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-23T06:26:55.627 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:55.627 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-23T06:26:55.628 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:55.628 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:55.628 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-23 06:26:40.439649604 +0000 2024-02-23T06:26:55.628 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-23 06:23:41.039655029 +0000 2024-02-23T06:26:55.628 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-23 06:23:41.039655029 +0000 2024-02-23T06:26:55.628 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-23 06:23:41.039655029 +0000 2024-02-23T06:26:55.628 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-23T06:26:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-23T06:26:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-23T06:26:55.706 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000185314 s, 2.8 MB/s 2024-02-23T06:26:55.707 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-23T06:26:55.775 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-02-23T06:26:55.842 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-23T06:26:55.842 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-23T06:26:55.842 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-02-23T06:26:55.843 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-23T06:26:55.843 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-23T06:26:55.843 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-23 06:26:40.440649591 +0000 2024-02-23T06:26:55.843 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-23 06:23:41.387650745 +0000 2024-02-23T06:26:55.843 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-23 06:23:41.387650745 +0000 2024-02-23T06:26:55.843 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-23 06:23:41.387650745 +0000 2024-02-23T06:26:55.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-23T06:26:55.921 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-23T06:26:55.921 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-23T06:26:55.921 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000202642 s, 2.5 MB/s 2024-02-23T06:26:55.922 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-23T06:26:55.990 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-23T06:26:55.990 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-23T06:26:55.990 INFO:tasks.ceph:Generating config... 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-02-23T06:26:55.991 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-02-23T06:26:55.992 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-02-23T06:26:55.992 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-02-23T06:26:55.992 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-23T06:26:55.992 INFO:tasks.ceph:[client] setuser = ceph 2024-02-23T06:26:55.992 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-02-23T06:26:55.992 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-02-23T06:26:55.992 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-02-23T06:26:55.992 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-02-23T06:26:55.992 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-23T06:26:55.992 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-23T06:26:55.992 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-23T06:26:55.992 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-23T06:26:55.992 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-23T06:26:55.992 INFO:tasks.ceph:[mon] lockdep = True 2024-02-23T06:26:55.992 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] lockdep = True 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-23T06:26:55.993 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-23T06:26:55.994 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-23T06:26:55.994 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-23T06:26:55.994 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-23T06:26:55.994 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-02-23T06:26:55.994 INFO:tasks.ceph:Setting up mon.a... 2024-02-23T06:26:55.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-23T06:26:56.357 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2024-02-23T06:26:56.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-23T06:26:56.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-23T06:26:56.463 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'), ('mon.b', '172.21.15.152')] 2024-02-23T06:26:56.463 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.152', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-02-23T06:26:56.464 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:56.464 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-23T06:26:56.533 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --add b 172.21.15.152 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:26:56.629 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:26:56.630 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:26:56.630 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:26:56.630 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:26:56.630 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = quincy 2024-02-23T06:26:56.630 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 17 (quincy) 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:election_strategy: 1 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:26:56.631 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-23T06:26:56.632 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-23T06:26:56.660 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fe79781e-fbfa-43ae-96f3-8cb6bda71da9... 2024-02-23T06:26:56.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-23T06:26:56.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-02-23T06:26:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-23T06:26:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-02-23T06:26:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.152" 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: mon client directed command retry = 5 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject socket failures = 5000 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd_max_pg_log_entries = 10 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd_min_pg_log_entries = 10 2024-02-23T06:26:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-02-23T06:26:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-02-23T06:26:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: lockdep = True 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-02-23T06:26:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: osd shutdown pgref assert = True 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.772 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-02-23T06:26:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: lockdep = True 2024-02-23T06:26:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:26:56.775 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-02-23T06:26:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-02-23T06:26:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: debug rgw = 20 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw bucket counters cache = True 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw crypt require ssl = False 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw crypt s3 kms backend = testing 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw max chunk size = 4194304 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw obj stripe size = 6291456 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw torrent flag = True 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: rgw user counters cache = True 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: setgroup = ceph 2024-02-23T06:26:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: setuser = ceph 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2024-02-23T06:26:56.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.778 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2024-02-23T06:26:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.152" 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: mon client directed command retry = 5 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject socket failures = 5000 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: osd_max_pg_log_entries = 10 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: osd_min_pg_log_entries = 10 2024-02-23T06:26:56.780 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2024-02-23T06:26:56.781 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-23T06:26:56.783 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: lockdep = True 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: osd shutdown pgref assert = True 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-02-23T06:26:56.784 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2024-02-23T06:26:56.785 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: lockdep = True 2024-02-23T06:26:56.786 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: debug rgw = 20 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw bucket counters cache = True 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw crypt require ssl = False 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw crypt s3 kms backend = testing 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw max chunk size = 4194304 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw obj stripe size = 6291456 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw torrent flag = True 2024-02-23T06:26:56.787 INFO:teuthology.orchestra.run.smithi152.stdout: rgw user counters cache = True 2024-02-23T06:26:56.788 INFO:teuthology.orchestra.run.smithi152.stdout: setgroup = ceph 2024-02-23T06:26:56.788 INFO:teuthology.orchestra.run.smithi152.stdout: setuser = ceph 2024-02-23T06:26:56.788 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2024-02-23T06:26:56.788 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2024-02-23T06:26:56.788 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2024-02-23T06:26:56.789 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-23T06:26:56.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-23T06:26:56.898 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-23T06:26:56.898 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:56.898 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-23T06:26:56.925 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:56.925 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-23T06:26:56.992 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:26:56.992 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:56.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-23T06:26:56.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-23T06:26:57.083 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:26:57.084 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:26:57.150 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:26:57.150 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:57.150 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-23T06:26:57.150 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-23T06:26:57.205 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:26:57.206 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:26:57.273 INFO:tasks.ceph:Setting up mon nodes... 2024-02-23T06:26:57.274 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-23T06:26:57.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-23T06:26:57.340 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-23T06:26:57.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-23T06:26:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-23T06:26:57.421 INFO:tasks.ceph:Setting up mds nodes... 2024-02-23T06:26:57.421 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-23T06:26:57.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-23T06:26:57.475 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-23T06:26:57.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-23T06:26:57.545 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-23T06:26:57.561 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-23T06:26:57.561 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-23T06:26:57.561 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-23T06:26:57.601 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-23T06:26:57.601 INFO:tasks.ceph:role: osd.0 2024-02-23T06:26:57.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:26:57.602 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-23T06:26:57.688 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:26:57.689 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:26:58.204 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-23T06:26:58.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-23T06:26:58.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-23T06:26:58.286 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-23T06:26:58.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-23T06:26:58.372 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-23T06:26:58.372 INFO:tasks.ceph:role: osd.1 2024-02-23T06:26:58.372 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:26:58.372 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:26:58.459 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:26:58.919 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-23T06:26:58.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-23T06:26:58.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-23T06:26:58.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-23T06:26:59.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-23T06:26:59.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-23T06:26:59.091 INFO:tasks.ceph:role: osd.2 2024-02-23T06:26:59.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:26:59.092 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-23T06:26:59.177 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:26:59.178 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:26:59.665 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-23T06:26:59.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-23T06:26:59.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-23T06:26:59.738 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-23T06:26:59.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-23T06:26:59.822 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-23T06:26:59.822 INFO:tasks.ceph:role: osd.3 2024-02-23T06:26:59.823 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:26:59.823 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:26:59.910 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:26:59.911 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:27:00.416 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-02-23T06:27:00.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-02-23T06:27:00.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-23T06:27:00.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-23T06:27:00.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:00.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:00.632+0000 7f54f2618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-23T06:27:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:00.634+0000 7f54f2618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-23T06:27:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:00.634+0000 7f54f2618640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-23T06:27:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:00.635+0000 7f54f2618640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-23T06:27:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:00.635+0000 7f54f2618640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-23T06:27:00.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:00.641+0000 7f54f2618640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-23T06:27:03.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-23T06:27:03.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:03.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:03.645+0000 7f5441c06640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-23T06:27:03.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:03.645+0000 7f5441c06640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-23T06:27:03.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:03.645+0000 7f5441c06640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-23T06:27:03.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:03.645+0000 7f5441c06640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-23T06:27:03.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:03.645+0000 7f5441c06640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-23T06:27:03.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:03.646+0000 7f5441c06640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-23T06:27:06.496 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-23T06:27:06.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:06.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:06.603+0000 7f480f949640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-23T06:27:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:06.604+0000 7f480f949640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-23T06:27:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:06.604+0000 7f480f949640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-23T06:27:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:06.604+0000 7f480f949640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-23T06:27:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:06.604+0000 7f480f949640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-23T06:27:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:06.604+0000 7f480f949640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-23T06:27:09.461 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-23T06:27:09.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:09.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:09.607+0000 7fde04e13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-23T06:27:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:09.607+0000 7fde04e13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-23T06:27:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:09.607+0000 7fde04e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-23T06:27:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:09.607+0000 7fde04e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-23T06:27:09.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:09.607+0000 7fde04e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-23T06:27:09.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:27:09.608+0000 7fde04e13640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-23T06:27:12.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-23T06:27:12.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-23T06:27:12.558 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-23T06:27:12.558 INFO:tasks.ceph:role: osd.4 2024-02-23T06:27:12.558 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:27:12.558 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:27:12.608 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:27:12.609 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:27:12.609 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:27:12.609 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:27:13.118 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-23T06:27:13.120 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-23T06:27:13.120 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-23T06:27:13.243 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-23T06:27:13.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-23T06:27:13.332 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-23T06:27:13.332 INFO:tasks.ceph:role: osd.5 2024-02-23T06:27:13.332 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:27:13.333 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:27:13.421 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:27:13.422 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:27:13.422 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:27:13.422 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:27:13.872 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-23T06:27:13.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-23T06:27:13.874 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-23T06:27:13.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-23T06:27:13.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-23T06:27:14.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-23T06:27:14.025 INFO:tasks.ceph:role: osd.6 2024-02-23T06:27:14.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:27:14.025 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:27:14.113 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:27:14.612 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-23T06:27:14.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-23T06:27:14.614 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-23T06:27:14.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-23T06:27:14.780 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-23T06:27:14.859 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-23T06:27:14.859 INFO:tasks.ceph:role: osd.7 2024-02-23T06:27:14.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:27:14.860 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-23T06:27:14.946 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-23T06:27:15.471 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-23T06:27:15.473 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-23T06:27:15.473 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-23T06:27:15.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-23T06:27:15.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:15.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:15.705+0000 7fa980025640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-23T06:27:15.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:15.706+0000 7fa980025640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-23T06:27:15.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:15.706+0000 7fa980025640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-23T06:27:15.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:15.706+0000 7fa980025640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-23T06:27:15.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:15.706+0000 7fa980025640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-23T06:27:15.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:15.706+0000 7fa980025640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-23T06:27:18.556 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-23T06:27:18.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:18.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:18.664+0000 7f3792373640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-23T06:27:18.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:18.665+0000 7f3792373640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-23T06:27:18.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:18.665+0000 7f3792373640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-23T06:27:18.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:18.665+0000 7f3792373640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-23T06:27:18.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:18.665+0000 7f3792373640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-23T06:27:18.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:18.665+0000 7f3792373640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-23T06:27:21.515 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-23T06:27:21.561 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:21.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:21.622+0000 7f9a40268640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-23T06:27:21.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:21.623+0000 7f9a40268640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-23T06:27:21.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:21.623+0000 7f9a40268640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-23T06:27:21.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:21.623+0000 7f9a40268640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-23T06:27:21.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:21.623+0000 7f9a40268640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-23T06:27:21.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:21.623+0000 7f9a40268640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-23T06:27:24.473 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-23T06:27:24.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:24.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:24.580+0000 7f0194c0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-23T06:27:24.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:24.581+0000 7f0194c0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-23T06:27:24.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:24.581+0000 7f0194c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-23T06:27:24.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:24.581+0000 7f0194c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-23T06:27:24.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:24.581+0000 7f0194c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-23T06:27:24.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:24.581+0000 7f0194c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-23T06:27:27.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-23T06:27:27.486 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-23T06:27:27.486 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:27.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-23T06:27:27.533 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:27.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-23T06:27:27.616 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:27.616 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-23T06:27:27.697 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:27.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-23T06:27:27.777 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:27.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-23T06:27:27.857 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:27.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-23T06:27:27.903 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:27.903 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-23T06:27:27.986 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:27.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-23T06:27:28.067 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:28.067 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-23T06:27:28.148 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:28.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-23T06:27:28.228 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:28.228 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-23T06:27:28.257 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:28.257 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-23T06:27:28.296 INFO:tasks.ceph:Adding keys to all mons... 2024-02-23T06:27:28.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-23T06:27:28.299 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-23T06:27:28.339 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-02-23T06:27:28.339 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCxOthlAQVbFBAAX7ACfPb0cEpiicqwxtrBkQ== 2024-02-23T06:27:28.339 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-02-23T06:27:28.339 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC0Othl2sm8JRAAbMN8HuC8SWMQ+DSqN4vCvw== 2024-02-23T06:27:28.339 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC3OthlAHqFJhAAV8XLx+Pzkw/4AFruGWwLqw== 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC6OthlergMJBAAQe9YzxChbiPV1p+e+9VANw== 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC9OthlzcZCJBAAbeJy6A8NZmXiuoh+MkhGQw== 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCxOthl0yr6GBAAJDF5Q8/JTfvhpY67M4M/8w== 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDDOthlsd0hKhAAnHV8gUlwCH8bIDj7IrcBwg== 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDGOthle7+sJxAAAhiUKij5QRTriL8IN6iYvg== 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-02-23T06:27:28.340 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDJOthlJtEvJRAApxRpkf6FaphlAkhPsvwElw== 2024-02-23T06:27:28.341 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-02-23T06:27:28.341 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDMOthl88StIhAAbyL8Zk54cXCjzSZ6KVSEmw== 2024-02-23T06:27:28.341 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-02-23T06:27:28.341 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCxOthlv45cHBAAwpAlxLsFEIKY5BM7pMk0gQ== 2024-02-23T06:27:28.341 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-02-23T06:27:28.341 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCxOthlMu+HIBAALwSaNxKSEQo5HTdJou/66Q== 2024-02-23T06:27:28.374 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2024-02-23T06:27:28.374 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCxOthlAQVbFBAAX7ACfPb0cEpiicqwxtrBkQ== 2024-02-23T06:27:28.374 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2024-02-23T06:27:28.374 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQC0Othl2sm8JRAAbMN8HuC8SWMQ+DSqN4vCvw== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQC3OthlAHqFJhAAV8XLx+Pzkw/4AFruGWwLqw== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQC6OthlergMJBAAQe9YzxChbiPV1p+e+9VANw== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQC9OthlzcZCJBAAbeJy6A8NZmXiuoh+MkhGQw== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCxOthl0yr6GBAAJDF5Q8/JTfvhpY67M4M/8w== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDDOthlsd0hKhAAnHV8gUlwCH8bIDj7IrcBwg== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDGOthle7+sJxAAAhiUKij5QRTriL8IN6iYvg== 2024-02-23T06:27:28.375 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDJOthlJtEvJRAApxRpkf6FaphlAkhPsvwElw== 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDMOthl88StIhAAbyL8Zk54cXCjzSZ6KVSEmw== 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCxOthlv45cHBAAwpAlxLsFEIKY5BM7pMk0gQ== 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-02-23T06:27:28.376 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCxOthlMu+HIBAALwSaNxKSEQo5HTdJou/66Q== 2024-02-23T06:27:28.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-23T06:27:28.385 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-23T06:27:28.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.617 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-23T06:27:28.750 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-23T06:27:28.815 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.817 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.884 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:28.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:29.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:29.018 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-23T06:27:29.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-23T06:27:29.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-23T06:27:29.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-23T06:27:29.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-23T06:27:29.224 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-23T06:27:29.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-23T06:27:29.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-23T06:27:29.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-23T06:27:29.411 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-23T06:27:29.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-23T06:27:29.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-23T06:27:29.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-23T06:27:29.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-23T06:27:29.791 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-23T06:27:29.831 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:29.833 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-23T06:27:29.899 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-23T06:27:29.900 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-23T06:27:29.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-23T06:27:29.902 INFO:tasks.ceph.mon.a:Started 2024-02-23T06:27:29.902 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-23T06:27:29.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-23T06:27:29.905 INFO:tasks.ceph.mon.c:Started 2024-02-23T06:27:29.905 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-23T06:27:29.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-23T06:27:29.942 INFO:tasks.ceph.mon.b:Started 2024-02-23T06:27:29.942 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-23T06:27:29.942 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-23T06:27:29.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-23T06:27:29.945 INFO:tasks.ceph.mgr.y:Started 2024-02-23T06:27:29.945 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-23T06:27:29.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-23T06:27:29.947 INFO:tasks.ceph.mgr.x:Started 2024-02-23T06:27:29.947 INFO:tasks.ceph:Setting crush tunables to default 2024-02-23T06:27:29.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2024-02-23T06:27:35.741 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:35.740+0000 7f85ba258040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-23T06:27:35.794 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:35.794+0000 7f85ba258040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-23T06:27:36.136 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2024-02-23T06:27:36.148 INFO:tasks.ceph:check_enable_crimson: False 2024-02-23T06:27:36.148 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-23T06:27:36.148 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:36.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-23T06:27:36.189 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:36.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-23T06:27:36.271 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:36.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-23T06:27:36.324 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.323+0000 7f85ba258040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-23T06:27:36.351 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:27:36.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-23T06:27:36.381 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.381+0000 7f85ba258040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-23T06:27:36.422 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:36.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-23T06:27:36.429 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.429+0000 7f85ba258040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-23T06:27:36.462 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:36.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-23T06:27:36.484 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.484+0000 7f85ba258040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-23T06:27:36.527 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.527+0000 7f85ba258040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-23T06:27:36.543 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:36.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-23T06:27:36.551 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:36.549+0000 7f84d21af040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-23T06:27:36.590 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-23T06:27:36.590 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-23T06:27:36.609 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:36.607+0000 7f84d21af040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-23T06:27:36.640 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.640+0000 7f85ba258040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-23T06:27:36.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 831de556-c5da-4b37-957b-3f025870038e 0 2024-02-23T06:27:36.708 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.708+0000 7f85ba258040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-23T06:27:36.753 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.753+0000 7f85ba258040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-23T06:27:36.805 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.804+0000 7f85ba258040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-23T06:27:36.851 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:36.851+0000 7f85ba258040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-23T06:27:37.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-23T06:27:37.003+0000 7f726affd640 0 --2- 172.21.15.152:0/2594172926 >> v2:172.21.15.152:3300/0 conn(0x7f726c0621a0 0x7f726c142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-02-23T06:27:37.090 INFO:teuthology.orchestra.run.smithi152.stdout:0 2024-02-23T06:27:37.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 1e9ef568-d322-485d-8b19-3aeeb1bbde9b 1 2024-02-23T06:27:37.163 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.161+0000 7f84d21af040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-23T06:27:37.221 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.219+0000 7f84d21af040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-23T06:27:37.226 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.226+0000 7f85ba258040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-23T06:27:37.268 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.266+0000 7f84d21af040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-23T06:27:37.299 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-02-23T06:27:37.311 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 3f14a23a-4d9a-47c1-b701-763c2683cd5a 2 2024-02-23T06:27:37.326 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.324+0000 7f84d21af040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-23T06:27:37.361 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.360+0000 7f85ba258040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-23T06:27:37.372 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.370+0000 7f84d21af040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-23T06:27:37.482 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.482+0000 7f85ba258040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-23T06:27:37.493 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.491+0000 7f84d21af040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-23T06:27:37.510 INFO:teuthology.orchestra.run.smithi152.stdout:2 2024-02-23T06:27:37.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new cbda9656-f026-4a28-b3e0-f397cb408a33 3 2024-02-23T06:27:37.530 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.530+0000 7f85ba258040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-23T06:27:37.567 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.565+0000 7f84d21af040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-23T06:27:37.616 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.615+0000 7f84d21af040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-23T06:27:37.642 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.641+0000 7f85ba258040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-23T06:27:37.672 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.671+0000 7f84d21af040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-23T06:27:37.723 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:37.721+0000 7f84d21af040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-23T06:27:37.738 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.738+0000 7f85ba258040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-23T06:27:37.761 INFO:teuthology.orchestra.run.smithi152.stdout:3 2024-02-23T06:27:37.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 2453c98a-6212-4fba-9891-888ea5e6b4b6 4 2024-02-23T06:27:37.892 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.892+0000 7f85ba258040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-23T06:27:37.934 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:37.934+0000 7f85ba258040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-23T06:27:38.013 INFO:teuthology.orchestra.run.smithi152.stdout:4 2024-02-23T06:27:38.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new b5b413dc-c4aa-4f4d-86c4-0601352bfcda 5 2024-02-23T06:27:38.089 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:38.088+0000 7f85ba258040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-23T06:27:38.126 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.124+0000 7f84d21af040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-23T06:27:38.220 INFO:teuthology.orchestra.run.smithi152.stdout:5 2024-02-23T06:27:38.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 731897c3-fa3b-49ba-803a-ee9e9b98ac93 6 2024-02-23T06:27:38.269 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.267+0000 7f84d21af040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-23T06:27:38.400 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.398+0000 7f84d21af040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-23T06:27:38.428 INFO:teuthology.orchestra.run.smithi152.stdout:6 2024-02-23T06:27:38.439 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new e3604853-5921-411d-be2a-eb8819a6ec8b 7 2024-02-23T06:27:38.448 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.447+0000 7f84d21af040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-23T06:27:38.568 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.567+0000 7f84d21af040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-23T06:27:38.651 INFO:teuthology.orchestra.run.smithi152.stdout:7 2024-02-23T06:27:38.662 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-23T06:27:38.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-23T06:27:38.665 INFO:tasks.ceph.osd.0:Started 2024-02-23T06:27:38.665 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-23T06:27:38.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-23T06:27:38.667 INFO:tasks.ceph.osd.1:Started 2024-02-23T06:27:38.667 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-23T06:27:38.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-23T06:27:38.669 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.667+0000 7f84d21af040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-23T06:27:38.669 INFO:tasks.ceph.osd.2:Started 2024-02-23T06:27:38.669 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-23T06:27:38.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-23T06:27:38.671 INFO:tasks.ceph.osd.3:Started 2024-02-23T06:27:38.671 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-23T06:27:38.672 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-23T06:27:38.674 INFO:tasks.ceph.osd.4:Started 2024-02-23T06:27:38.674 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-23T06:27:38.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-23T06:27:38.676 INFO:tasks.ceph.osd.5:Started 2024-02-23T06:27:38.676 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-23T06:27:38.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-23T06:27:38.678 INFO:tasks.ceph.osd.6:Started 2024-02-23T06:27:38.678 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-23T06:27:38.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-23T06:27:38.680 INFO:tasks.ceph.osd.7:Started 2024-02-23T06:27:38.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-23T06:27:38.861 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.859+0000 7f84d21af040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-23T06:27:38.874 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:27:38.874 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":10,"fsid":"fe79781e-fbfa-43ae-96f3-8cb6bda71da9","created":"2024-02-23T06:27:35.260198+0000","modified":"2024-02-23T06:27:38.644090+0000","last_up_change":"0.000000","last_in_change":"2024-02-23T06:27:38.644090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"831de556-c5da-4b37-957b-3f025870038e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1e9ef568-d322-485d-8b19-3aeeb1bbde9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3f14a23a-4d9a-47c1-b701-763c2683cd5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cbda9656-f026-4a28-b3e0-f397cb408a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2453c98a-6212-4fba-9891-888ea5e6b4b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5b413dc-c4aa-4f4d-86c4-0601352bfcda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"731897c3-fa3b-49ba-803a-ee9e9b98ac93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e3604853-5921-411d-be2a-eb8819a6ec8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-23T06:27:38.885 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-23T06:27:38.885 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-23T06:27:38.903 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:38.901+0000 7f84d21af040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-23T06:27:39.060 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:39.059+0000 7f84d21af040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-23T06:27:39.209 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:39.209+0000 7f85ba258040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-23T06:27:39.286 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:27:39.285+0000 7f5975215640 -1 Falling back to public interface 2024-02-23T06:27:39.291 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:27:39.291+0000 7f17333fa640 -1 Falling back to public interface 2024-02-23T06:27:39.295 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:27:39.295+0000 7ff26b415640 -1 Falling back to public interface 2024-02-23T06:27:39.304 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:27:39.303+0000 7fa4311bd640 -1 Falling back to public interface 2024-02-23T06:27:39.310 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:27:39.308+0000 7f925c78f640 -1 Falling back to public interface 2024-02-23T06:27:39.310 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:27:39.308+0000 7f7d57411640 -1 Falling back to public interface 2024-02-23T06:27:39.310 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:27:39.308+0000 7f7d55be6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-02-23T06:27:39.312 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:27:39.310+0000 7f4a66eb5640 -1 Falling back to public interface 2024-02-23T06:27:39.322 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:27:39.321+0000 7f7a41e13640 -1 Falling back to public interface 2024-02-23T06:27:39.489 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:39.488+0000 7f85ba258040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-23T06:27:39.540 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:39.540+0000 7f85ba258040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-23T06:27:39.656 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:39.655+0000 7f85ba258040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-23T06:27:39.691 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-23T06:27:39.864 INFO:teuthology.misc.health.smithi142.stdout: 2024-02-23T06:27:39.864 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":10,"fsid":"fe79781e-fbfa-43ae-96f3-8cb6bda71da9","created":"2024-02-23T06:27:35.260198+0000","modified":"2024-02-23T06:27:38.644090+0000","last_up_change":"0.000000","last_in_change":"2024-02-23T06:27:38.644090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"831de556-c5da-4b37-957b-3f025870038e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1e9ef568-d322-485d-8b19-3aeeb1bbde9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3f14a23a-4d9a-47c1-b701-763c2683cd5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cbda9656-f026-4a28-b3e0-f397cb408a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2453c98a-6212-4fba-9891-888ea5e6b4b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5b413dc-c4aa-4f4d-86c4-0601352bfcda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"731897c3-fa3b-49ba-803a-ee9e9b98ac93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e3604853-5921-411d-be2a-eb8819a6ec8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-23T06:27:39.874 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-23T06:27:39.905 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:39.903+0000 7f84d21af040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-23T06:27:40.184 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:40.183+0000 7f84d21af040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-23T06:27:40.236 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:40.235+0000 7f84d21af040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-23T06:27:40.353 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-23T06:27:40.352+0000 7f84d21af040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-23T06:27:40.680 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:40.678+0000 7f855b4c2640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-23T06:27:40.681 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:27:40.679+0000 7f855b4c2640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-23T06:27:42.781 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:27:42.780+0000 7f5975215640 -1 osd.2 0 log_to_monitors true 2024-02-23T06:27:42.788 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:27:42.787+0000 7f17333fa640 -1 osd.3 0 log_to_monitors true 2024-02-23T06:27:42.790 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:27:42.790+0000 7f4a66eb5640 -1 osd.7 0 log_to_monitors true 2024-02-23T06:27:42.819 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:27:42.818+0000 7ff26b415640 -1 osd.1 0 log_to_monitors true 2024-02-23T06:27:42.823 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:27:42.822+0000 7fa4311bd640 -1 osd.0 0 log_to_monitors true 2024-02-23T06:27:42.829 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:27:42.829+0000 7f7d57411640 -1 osd.4 0 log_to_monitors true 2024-02-23T06:27:42.833 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:27:42.832+0000 7f925c78f640 -1 osd.6 0 log_to_monitors true 2024-02-23T06:27:42.845 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:27:42.845+0000 7f7a41e13640 -1 osd.5 0 log_to_monitors true 2024-02-23T06:27:46.640 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:27:46.639+0000 7f7a3cdaa640 -1 osd.5 0 waiting for initial osdmap 2024-02-23T06:27:46.654 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:27:46.654+0000 7f7a353dc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.680 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-23T06:27:46.763 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:27:46.761+0000 7fa42c5f6640 -1 osd.0 0 waiting for initial osdmap 2024-02-23T06:27:46.771 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:27:46.771+0000 7f7d53be2640 -1 osd.4 0 waiting for initial osdmap 2024-02-23T06:27:46.772 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:27:46.772+0000 7f4a623f6640 -1 osd.7 0 waiting for initial osdmap 2024-02-23T06:27:46.779 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:27:46.777+0000 7fa424c80640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.781 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:27:46.781+0000 7f7d4a9dc640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.788 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:27:46.788+0000 7f4a5aa28640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.799 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:27:46.798+0000 7f59701f6640 -1 osd.2 0 waiting for initial osdmap 2024-02-23T06:27:46.811 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:27:46.809+0000 7f172e7f6640 -1 osd.3 0 waiting for initial osdmap 2024-02-23T06:27:46.815 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:27:46.815+0000 7f9257bf6640 -1 osd.6 0 waiting for initial osdmap 2024-02-23T06:27:46.815 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:27:46.814+0000 7f5968880640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.816 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:27:46.815+0000 7ff2663aa640 -1 osd.1 0 waiting for initial osdmap 2024-02-23T06:27:46.826 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:27:46.825+0000 7f1726e80640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.828 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:27:46.827+0000 7ff25e9dc640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:46.833 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:27:46.833+0000 7f9250280640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-23T06:27:47.013 INFO:teuthology.misc.health.smithi142.stdout: 2024-02-23T06:27:47.013 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":12,"fsid":"fe79781e-fbfa-43ae-96f3-8cb6bda71da9","created":"2024-02-23T06:27:35.260198+0000","modified":"2024-02-23T06:27:44.681181+0000","last_up_change":"0.000000","last_in_change":"2024-02-23T06:27:38.644090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"831de556-c5da-4b37-957b-3f025870038e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1e9ef568-d322-485d-8b19-3aeeb1bbde9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3f14a23a-4d9a-47c1-b701-763c2683cd5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cbda9656-f026-4a28-b3e0-f397cb408a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2453c98a-6212-4fba-9891-888ea5e6b4b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5b413dc-c4aa-4f4d-86c4-0601352bfcda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"731897c3-fa3b-49ba-803a-ee9e9b98ac93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e3604853-5921-411d-be2a-eb8819a6ec8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-23T06:27:47.024 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-23T06:27:53.832 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-23T06:27:54.130 INFO:teuthology.misc.health.smithi142.stdout: 2024-02-23T06:27:54.131 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":16,"fsid":"fe79781e-fbfa-43ae-96f3-8cb6bda71da9","created":"2024-02-23T06:27:35.260198+0000","modified":"2024-02-23T06:27:50.703858+0000","last_up_change":"2024-02-23T06:27:47.645136+0000","last_in_change":"2024-02-23T06:27:38.644090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-23T06:27:47.720664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"831de556-c5da-4b37-957b-3f025870038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6825","nonce":1577595781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6827","nonce":1577595781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6831","nonce":1577595781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6829","nonce":1577595781}]},"public_addr":"172.21.15.142:6825/1577595781","cluster_addr":"172.21.15.142:6827/1577595781","heartbeat_back_addr":"172.21.15.142:6831/1577595781","heartbeat_front_addr":"172.21.15.142:6829/1577595781","state":["exists","up"]},{"osd":1,"uuid":"1e9ef568-d322-485d-8b19-3aeeb1bbde9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6817","nonce":4008394756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6819","nonce":4008394756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6823","nonce":4008394756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6821","nonce":4008394756}]},"public_addr":"172.21.15.142:6817/4008394756","cluster_addr":"172.21.15.142:6819/4008394756","heartbeat_back_addr":"172.21.15.142:6823/4008394756","heartbeat_front_addr":"172.21.15.142:6821/4008394756","state":["exists","up"]},{"osd":2,"uuid":"3f14a23a-4d9a-47c1-b701-763c2683cd5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6801","nonce":3021220351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6803","nonce":3021220351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6807","nonce":3021220351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6805","nonce":3021220351}]},"public_addr":"172.21.15.142:6801/3021220351","cluster_addr":"172.21.15.142:6803/3021220351","heartbeat_back_addr":"172.21.15.142:6807/3021220351","heartbeat_front_addr":"172.21.15.142:6805/3021220351","state":["exists","up"]},{"osd":3,"uuid":"cbda9656-f026-4a28-b3e0-f397cb408a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6809","nonce":3663012454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6811","nonce":3663012454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6815","nonce":3663012454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6813","nonce":3663012454}]},"public_addr":"172.21.15.142:6809/3663012454","cluster_addr":"172.21.15.142:6811/3663012454","heartbeat_back_addr":"172.21.15.142:6815/3663012454","heartbeat_front_addr":"172.21.15.142:6813/3663012454","state":["exists","up"]},{"osd":4,"uuid":"2453c98a-6212-4fba-9891-888ea5e6b4b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6801","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6803","nonce":3198084750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6806","nonce":3198084750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6813","nonce":3198084750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6810","nonce":3198084750}]},"public_addr":"172.21.15.152:6803/3198084750","cluster_addr":"172.21.15.152:6806/3198084750","heartbeat_back_addr":"172.21.15.152:6813/3198084750","heartbeat_front_addr":"172.21.15.152:6810/3198084750","state":["exists","up"]},{"osd":5,"uuid":"b5b413dc-c4aa-4f4d-86c4-0601352bfcda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6825","nonce":160508611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6827","nonce":160508611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6831","nonce":160508611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6829","nonce":160508611}]},"public_addr":"172.21.15.152:6825/160508611","cluster_addr":"172.21.15.152:6827/160508611","heartbeat_back_addr":"172.21.15.152:6831/160508611","heartbeat_front_addr":"172.21.15.152:6829/160508611","state":["exists","up"]},{"osd":6,"uuid":"731897c3-fa3b-49ba-803a-ee9e9b98ac93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6802","nonce":1235701666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6807","nonce":1235701666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6815","nonce":1235701666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6809","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6812","nonce":1235701666}]},"public_addr":"172.21.15.152:6802/1235701666","cluster_addr":"172.21.15.152:6807/1235701666","heartbeat_back_addr":"172.21.15.152:6815/1235701666","heartbeat_front_addr":"172.21.15.152:6812/1235701666","state":["exists","up"]},{"osd":7,"uuid":"e3604853-5921-411d-be2a-eb8819a6ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6817","nonce":1410246671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6819","nonce":1410246671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6823","nonce":1410246671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6821","nonce":1410246671}]},"public_addr":"172.21.15.152:6817/1410246671","cluster_addr":"172.21.15.152:6819/1410246671","heartbeat_back_addr":"172.21.15.152:6823/1410246671","heartbeat_front_addr":"172.21.15.152:6821/1410246671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.781292+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.796695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.762054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.809863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.830413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.828384+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.827595+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-23T06:27:54.142 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-23T06:27:54.142 INFO:tasks.ceph:Creating RBD pool 2024-02-23T06:27:54.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-23T06:27:54.738 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'rbd' created 2024-02-23T06:27:54.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-23T06:27:55.745 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-23T06:27:55.761 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-23T06:27:55.762 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-23T06:27:55.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-23T06:27:55.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-23T06:27:55.762 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-23T06:27:56.114 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:27:56.125 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":271480492},{"type":"v1","addr":"172.21.15.142:6833","nonce":271480492}]},"active_addr":"172.21.15.142:6833/271480492","active_change":"2024-02-23T06:27:39.669524+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":340423569}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2477940968}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2477384721}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1164389817}]}]} 2024-02-23T06:27:56.131 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-23T06:27:56.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-23T06:27:56.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-23T06:27:56.431 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:27:56.431 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":18,"fsid":"fe79781e-fbfa-43ae-96f3-8cb6bda71da9","created":"2024-02-23T06:27:35.260198+0000","modified":"2024-02-23T06:27:55.738671+0000","last_up_change":"2024-02-23T06:27:47.645136+0000","last_in_change":"2024-02-23T06:27:38.644090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-23T06:27:47.720664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-23T06:27:54.455208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"831de556-c5da-4b37-957b-3f025870038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6825","nonce":1577595781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6827","nonce":1577595781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6831","nonce":1577595781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6829","nonce":1577595781}]},"public_addr":"172.21.15.142:6825/1577595781","cluster_addr":"172.21.15.142:6827/1577595781","heartbeat_back_addr":"172.21.15.142:6831/1577595781","heartbeat_front_addr":"172.21.15.142:6829/1577595781","state":["exists","up"]},{"osd":1,"uuid":"1e9ef568-d322-485d-8b19-3aeeb1bbde9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6817","nonce":4008394756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6819","nonce":4008394756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6823","nonce":4008394756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6821","nonce":4008394756}]},"public_addr":"172.21.15.142:6817/4008394756","cluster_addr":"172.21.15.142:6819/4008394756","heartbeat_back_addr":"172.21.15.142:6823/4008394756","heartbeat_front_addr":"172.21.15.142:6821/4008394756","state":["exists","up"]},{"osd":2,"uuid":"3f14a23a-4d9a-47c1-b701-763c2683cd5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6801","nonce":3021220351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6803","nonce":3021220351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6807","nonce":3021220351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6805","nonce":3021220351}]},"public_addr":"172.21.15.142:6801/3021220351","cluster_addr":"172.21.15.142:6803/3021220351","heartbeat_back_addr":"172.21.15.142:6807/3021220351","heartbeat_front_addr":"172.21.15.142:6805/3021220351","state":["exists","up"]},{"osd":3,"uuid":"cbda9656-f026-4a28-b3e0-f397cb408a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6809","nonce":3663012454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6811","nonce":3663012454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6815","nonce":3663012454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6813","nonce":3663012454}]},"public_addr":"172.21.15.142:6809/3663012454","cluster_addr":"172.21.15.142:6811/3663012454","heartbeat_back_addr":"172.21.15.142:6815/3663012454","heartbeat_front_addr":"172.21.15.142:6813/3663012454","state":["exists","up"]},{"osd":4,"uuid":"2453c98a-6212-4fba-9891-888ea5e6b4b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6801","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6803","nonce":3198084750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6806","nonce":3198084750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6813","nonce":3198084750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6810","nonce":3198084750}]},"public_addr":"172.21.15.152:6803/3198084750","cluster_addr":"172.21.15.152:6806/3198084750","heartbeat_back_addr":"172.21.15.152:6813/3198084750","heartbeat_front_addr":"172.21.15.152:6810/3198084750","state":["exists","up"]},{"osd":5,"uuid":"b5b413dc-c4aa-4f4d-86c4-0601352bfcda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6825","nonce":160508611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6827","nonce":160508611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6831","nonce":160508611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6829","nonce":160508611}]},"public_addr":"172.21.15.152:6825/160508611","cluster_addr":"172.21.15.152:6827/160508611","heartbeat_back_addr":"172.21.15.152:6831/160508611","heartbeat_front_addr":"172.21.15.152:6829/160508611","state":["exists","up"]},{"osd":6,"uuid":"731897c3-fa3b-49ba-803a-ee9e9b98ac93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6802","nonce":1235701666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6807","nonce":1235701666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6815","nonce":1235701666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6809","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6812","nonce":1235701666}]},"public_addr":"172.21.15.152:6802/1235701666","cluster_addr":"172.21.15.152:6807/1235701666","heartbeat_back_addr":"172.21.15.152:6815/1235701666","heartbeat_front_addr":"172.21.15.152:6812/1235701666","state":["exists","up"]},{"osd":7,"uuid":"e3604853-5921-411d-be2a-eb8819a6ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6817","nonce":1410246671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6819","nonce":1410246671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6823","nonce":1410246671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6821","nonce":1410246671}]},"public_addr":"172.21.15.152:6817/1410246671","cluster_addr":"172.21.15.152:6819/1410246671","heartbeat_back_addr":"172.21.15.152:6823/1410246671","heartbeat_front_addr":"172.21.15.152:6821/1410246671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.781292+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.796695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.762054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.809863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.830413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.828384+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.827595+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-23T06:27:56.443 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-23T06:27:56.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-23T06:27:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:27:56.740 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":18,"fsid":"fe79781e-fbfa-43ae-96f3-8cb6bda71da9","created":"2024-02-23T06:27:35.260198+0000","modified":"2024-02-23T06:27:55.738671+0000","last_up_change":"2024-02-23T06:27:47.645136+0000","last_in_change":"2024-02-23T06:27:38.644090+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-23T06:27:47.720664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-23T06:27:54.455208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"831de556-c5da-4b37-957b-3f025870038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6825","nonce":1577595781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6827","nonce":1577595781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6831","nonce":1577595781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1577595781},{"type":"v1","addr":"172.21.15.142:6829","nonce":1577595781}]},"public_addr":"172.21.15.142:6825/1577595781","cluster_addr":"172.21.15.142:6827/1577595781","heartbeat_back_addr":"172.21.15.142:6831/1577595781","heartbeat_front_addr":"172.21.15.142:6829/1577595781","state":["exists","up"]},{"osd":1,"uuid":"1e9ef568-d322-485d-8b19-3aeeb1bbde9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6817","nonce":4008394756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6819","nonce":4008394756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6823","nonce":4008394756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4008394756},{"type":"v1","addr":"172.21.15.142:6821","nonce":4008394756}]},"public_addr":"172.21.15.142:6817/4008394756","cluster_addr":"172.21.15.142:6819/4008394756","heartbeat_back_addr":"172.21.15.142:6823/4008394756","heartbeat_front_addr":"172.21.15.142:6821/4008394756","state":["exists","up"]},{"osd":2,"uuid":"3f14a23a-4d9a-47c1-b701-763c2683cd5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6801","nonce":3021220351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6803","nonce":3021220351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6807","nonce":3021220351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3021220351},{"type":"v1","addr":"172.21.15.142:6805","nonce":3021220351}]},"public_addr":"172.21.15.142:6801/3021220351","cluster_addr":"172.21.15.142:6803/3021220351","heartbeat_back_addr":"172.21.15.142:6807/3021220351","heartbeat_front_addr":"172.21.15.142:6805/3021220351","state":["exists","up"]},{"osd":3,"uuid":"cbda9656-f026-4a28-b3e0-f397cb408a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6809","nonce":3663012454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6811","nonce":3663012454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6815","nonce":3663012454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3663012454},{"type":"v1","addr":"172.21.15.142:6813","nonce":3663012454}]},"public_addr":"172.21.15.142:6809/3663012454","cluster_addr":"172.21.15.142:6811/3663012454","heartbeat_back_addr":"172.21.15.142:6815/3663012454","heartbeat_front_addr":"172.21.15.142:6813/3663012454","state":["exists","up"]},{"osd":4,"uuid":"2453c98a-6212-4fba-9891-888ea5e6b4b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6801","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6803","nonce":3198084750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6806","nonce":3198084750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6813","nonce":3198084750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3198084750},{"type":"v1","addr":"172.21.15.152:6810","nonce":3198084750}]},"public_addr":"172.21.15.152:6803/3198084750","cluster_addr":"172.21.15.152:6806/3198084750","heartbeat_back_addr":"172.21.15.152:6813/3198084750","heartbeat_front_addr":"172.21.15.152:6810/3198084750","state":["exists","up"]},{"osd":5,"uuid":"b5b413dc-c4aa-4f4d-86c4-0601352bfcda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6825","nonce":160508611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6827","nonce":160508611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6831","nonce":160508611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":160508611},{"type":"v1","addr":"172.21.15.152:6829","nonce":160508611}]},"public_addr":"172.21.15.152:6825/160508611","cluster_addr":"172.21.15.152:6827/160508611","heartbeat_back_addr":"172.21.15.152:6831/160508611","heartbeat_front_addr":"172.21.15.152:6829/160508611","state":["exists","up"]},{"osd":6,"uuid":"731897c3-fa3b-49ba-803a-ee9e9b98ac93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6802","nonce":1235701666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6807","nonce":1235701666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6815","nonce":1235701666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6809","nonce":1235701666},{"type":"v1","addr":"172.21.15.152:6812","nonce":1235701666}]},"public_addr":"172.21.15.152:6802/1235701666","cluster_addr":"172.21.15.152:6807/1235701666","heartbeat_back_addr":"172.21.15.152:6815/1235701666","heartbeat_front_addr":"172.21.15.152:6812/1235701666","state":["exists","up"]},{"osd":7,"uuid":"e3604853-5921-411d-be2a-eb8819a6ec8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6817","nonce":1410246671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6819","nonce":1410246671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6823","nonce":1410246671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1410246671},{"type":"v1","addr":"172.21.15.152:6821","nonce":1410246671}]},"public_addr":"172.21.15.152:6817/1410246671","cluster_addr":"172.21.15.152:6819/1410246671","heartbeat_back_addr":"172.21.15.152:6823/1410246671","heartbeat_front_addr":"172.21.15.152:6821/1410246671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.781292+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.796695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.762054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.809863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.830413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.828384+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-23T06:27:43.827595+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-23T06:27:56.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-23T06:27:56.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-23T06:27:56.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-23T06:27:56.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-23T06:27:56.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-23T06:27:56.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-23T06:27:56.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-23T06:27:56.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-23T06:27:57.015 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-23T06:27:57.022 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-23T06:27:57.023 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:57.023 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-23T06:27:57.024 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:57.025 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-23T06:27:57.026 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-23T06:27:57.029 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:57.029 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-23T06:27:57.030 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2024-02-23T06:27:57.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-23T06:27:57.031 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:57.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-23T06:27:57.629 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2024-02-23T06:27:57.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-02-23T06:27:57.651 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2024-02-23T06:27:57.651 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.653 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.653 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2024-02-23T06:27:57.655 INFO:teuthology.orchestra.run.smithi142.stdout:55834574850 2024-02-23T06:27:57.667 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-02-23T06:27:57.674 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:57.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-02-23T06:27:57.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-02-23T06:27:57.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-02-23T06:27:57.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2024-02-23T06:27:57.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-02-23T06:27:57.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-02-23T06:27:58.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-23T06:27:58.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-23T06:27:58.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-23T06:27:58.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-23T06:27:58.680 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-23T06:27:58.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-23T06:27:58.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-23T06:27:58.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-23T06:27:59.268 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:59.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-02-23T06:27:59.291 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.300 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:59.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-02-23T06:27:59.314 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:59.330 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2024-02-23T06:27:59.330 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:59.331 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:59.338 INFO:teuthology.orchestra.run.smithi142.stdout:55834574853 2024-02-23T06:27:59.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-02-23T06:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2024-02-23T06:27:59.346 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.6 2024-02-23T06:27:59.349 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-02-23T06:27:59.354 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-02-23T06:27:59.356 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-02-23T06:27:59.360 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-02-23T06:27:59.362 DEBUG:teuthology.parallel:result is None 2024-02-23T06:27:59.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-23T06:27:59.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-23T06:27:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:27:59.697 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-02-23T06:27:59.709 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-23T06:27:59.677560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218816,"kb_used_data":2628,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2691072,"data_stored":1668004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001145"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.825890+0000","last_change":"2024-02-23T06:27:55.750006+0000","last_active":"2024-02-23T06:27:56.825890+0000","last_peered":"2024-02-23T06:27:56.825890+0000","last_clean":"2024-02-23T06:27:56.825890+0000","last_became_active":"2024-02-23T06:27:55.749667+0000","last_became_peered":"2024-02-23T06:27:55.749667+0000","last_unstale":"2024-02-23T06:27:56.825890+0000","last_undegraded":"2024-02-23T06:27:56.825890+0000","last_fullsized":"2024-02-23T06:27:56.825890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T17:12:28.589420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753818+0000","last_change":"2024-02-23T06:27:55.748967+0000","last_active":"2024-02-23T06:27:56.753818+0000","last_peered":"2024-02-23T06:27:56.753818+0000","last_clean":"2024-02-23T06:27:56.753818+0000","last_became_active":"2024-02-23T06:27:55.748690+0000","last_became_peered":"2024-02-23T06:27:55.748690+0000","last_unstale":"2024-02-23T06:27:56.753818+0000","last_undegraded":"2024-02-23T06:27:56.753818+0000","last_fullsized":"2024-02-23T06:27:56.753818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T10:36:17.762559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.750994+0000","last_change":"2024-02-23T06:27:56.298518+0000","last_active":"2024-02-23T06:27:56.750994+0000","last_peered":"2024-02-23T06:27:56.750994+0000","last_clean":"2024-02-23T06:27:56.750994+0000","last_became_active":"2024-02-23T06:27:56.298156+0000","last_became_peered":"2024-02-23T06:27:56.298156+0000","last_unstale":"2024-02-23T06:27:56.750994+0000","last_undegraded":"2024-02-23T06:27:56.750994+0000","last_fullsized":"2024-02-23T06:27:56.750994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T13:34:33.344201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753817+0000","last_change":"2024-02-23T06:27:56.298454+0000","last_active":"2024-02-23T06:27:56.753817+0000","last_peered":"2024-02-23T06:27:56.753817+0000","last_clean":"2024-02-23T06:27:56.753817+0000","last_became_active":"2024-02-23T06:27:56.298117+0000","last_became_peered":"2024-02-23T06:27:56.298117+0000","last_unstale":"2024-02-23T06:27:56.753817+0000","last_undegraded":"2024-02-23T06:27:56.753817+0000","last_fullsized":"2024-02-23T06:27:56.753817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T09:35:52.320826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753743+0000","last_change":"2024-02-23T06:27:55.749413+0000","last_active":"2024-02-23T06:27:56.753743+0000","last_peered":"2024-02-23T06:27:56.753743+0000","last_clean":"2024-02-23T06:27:56.753743+0000","last_became_active":"2024-02-23T06:27:55.749135+0000","last_became_peered":"2024-02-23T06:27:55.749135+0000","last_unstale":"2024-02-23T06:27:56.753743+0000","last_undegraded":"2024-02-23T06:27:56.753743+0000","last_fullsized":"2024-02-23T06:27:56.753743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T11:30:16.055296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.827342+0000","last_change":"2024-02-23T06:27:55.887020+0000","last_active":"2024-02-23T06:27:56.827342+0000","last_peered":"2024-02-23T06:27:56.827342+0000","last_clean":"2024-02-23T06:27:56.827342+0000","last_became_active":"2024-02-23T06:27:55.886704+0000","last_became_peered":"2024-02-23T06:27:55.886704+0000","last_unstale":"2024-02-23T06:27:56.827342+0000","last_undegraded":"2024-02-23T06:27:56.827342+0000","last_fullsized":"2024-02-23T06:27:56.827342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T06:43:28.111530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.750981+0000","last_change":"2024-02-23T06:27:55.751804+0000","last_active":"2024-02-23T06:27:56.750981+0000","last_peered":"2024-02-23T06:27:56.750981+0000","last_clean":"2024-02-23T06:27:56.750981+0000","last_became_active":"2024-02-23T06:27:55.751553+0000","last_became_peered":"2024-02-23T06:27:55.751553+0000","last_unstale":"2024-02-23T06:27:56.750981+0000","last_undegraded":"2024-02-23T06:27:56.750981+0000","last_fullsized":"2024-02-23T06:27:56.750981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T09:45:39.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753786+0000","last_change":"2024-02-23T06:27:55.754713+0000","last_active":"2024-02-23T06:27:56.753786+0000","last_peered":"2024-02-23T06:27:56.753786+0000","last_clean":"2024-02-23T06:27:56.753786+0000","last_became_active":"2024-02-23T06:27:55.754470+0000","last_became_peered":"2024-02-23T06:27:55.754470+0000","last_unstale":"2024-02-23T06:27:56.753786+0000","last_undegraded":"2024-02-23T06:27:56.753786+0000","last_fullsized":"2024-02-23T06:27:56.753786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T08:41:36.537116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.750867+0000","last_change":"2024-02-23T06:27:49.781694+0000","last_active":"2024-02-23T06:27:56.750867+0000","last_peered":"2024-02-23T06:27:56.750867+0000","last_clean":"2024-02-23T06:27:56.750867+0000","last_became_active":"2024-02-23T06:27:49.780640+0000","last_became_peered":"2024-02-23T06:27:49.780640+0000","last_unstale":"2024-02-23T06:27:56.750867+0000","last_undegraded":"2024-02-23T06:27:56.750867+0000","last_fullsized":"2024-02-23T06:27:56.750867+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:48.700290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:48.700290+0000","last_clean_scrub_stamp":"2024-02-23T06:27:48.700290+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T07:28:29.851614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-23T06:27:59.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-23T06:28:00.003 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:28:00.003 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-02-23T06:28:00.015 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-23T06:27:59.677560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218816,"kb_used_data":2628,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2691072,"data_stored":1668004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001145"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.825890+0000","last_change":"2024-02-23T06:27:55.750006+0000","last_active":"2024-02-23T06:27:56.825890+0000","last_peered":"2024-02-23T06:27:56.825890+0000","last_clean":"2024-02-23T06:27:56.825890+0000","last_became_active":"2024-02-23T06:27:55.749667+0000","last_became_peered":"2024-02-23T06:27:55.749667+0000","last_unstale":"2024-02-23T06:27:56.825890+0000","last_undegraded":"2024-02-23T06:27:56.825890+0000","last_fullsized":"2024-02-23T06:27:56.825890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T17:12:28.589420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753818+0000","last_change":"2024-02-23T06:27:55.748967+0000","last_active":"2024-02-23T06:27:56.753818+0000","last_peered":"2024-02-23T06:27:56.753818+0000","last_clean":"2024-02-23T06:27:56.753818+0000","last_became_active":"2024-02-23T06:27:55.748690+0000","last_became_peered":"2024-02-23T06:27:55.748690+0000","last_unstale":"2024-02-23T06:27:56.753818+0000","last_undegraded":"2024-02-23T06:27:56.753818+0000","last_fullsized":"2024-02-23T06:27:56.753818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T10:36:17.762559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.750994+0000","last_change":"2024-02-23T06:27:56.298518+0000","last_active":"2024-02-23T06:27:56.750994+0000","last_peered":"2024-02-23T06:27:56.750994+0000","last_clean":"2024-02-23T06:27:56.750994+0000","last_became_active":"2024-02-23T06:27:56.298156+0000","last_became_peered":"2024-02-23T06:27:56.298156+0000","last_unstale":"2024-02-23T06:27:56.750994+0000","last_undegraded":"2024-02-23T06:27:56.750994+0000","last_fullsized":"2024-02-23T06:27:56.750994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T13:34:33.344201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753817+0000","last_change":"2024-02-23T06:27:56.298454+0000","last_active":"2024-02-23T06:27:56.753817+0000","last_peered":"2024-02-23T06:27:56.753817+0000","last_clean":"2024-02-23T06:27:56.753817+0000","last_became_active":"2024-02-23T06:27:56.298117+0000","last_became_peered":"2024-02-23T06:27:56.298117+0000","last_unstale":"2024-02-23T06:27:56.753817+0000","last_undegraded":"2024-02-23T06:27:56.753817+0000","last_fullsized":"2024-02-23T06:27:56.753817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T09:35:52.320826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753743+0000","last_change":"2024-02-23T06:27:55.749413+0000","last_active":"2024-02-23T06:27:56.753743+0000","last_peered":"2024-02-23T06:27:56.753743+0000","last_clean":"2024-02-23T06:27:56.753743+0000","last_became_active":"2024-02-23T06:27:55.749135+0000","last_became_peered":"2024-02-23T06:27:55.749135+0000","last_unstale":"2024-02-23T06:27:56.753743+0000","last_undegraded":"2024-02-23T06:27:56.753743+0000","last_fullsized":"2024-02-23T06:27:56.753743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T11:30:16.055296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.827342+0000","last_change":"2024-02-23T06:27:55.887020+0000","last_active":"2024-02-23T06:27:56.827342+0000","last_peered":"2024-02-23T06:27:56.827342+0000","last_clean":"2024-02-23T06:27:56.827342+0000","last_became_active":"2024-02-23T06:27:55.886704+0000","last_became_peered":"2024-02-23T06:27:55.886704+0000","last_unstale":"2024-02-23T06:27:56.827342+0000","last_undegraded":"2024-02-23T06:27:56.827342+0000","last_fullsized":"2024-02-23T06:27:56.827342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T06:43:28.111530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.750981+0000","last_change":"2024-02-23T06:27:55.751804+0000","last_active":"2024-02-23T06:27:56.750981+0000","last_peered":"2024-02-23T06:27:56.750981+0000","last_clean":"2024-02-23T06:27:56.750981+0000","last_became_active":"2024-02-23T06:27:55.751553+0000","last_became_peered":"2024-02-23T06:27:55.751553+0000","last_unstale":"2024-02-23T06:27:56.750981+0000","last_undegraded":"2024-02-23T06:27:56.750981+0000","last_fullsized":"2024-02-23T06:27:56.750981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T09:45:39.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.753786+0000","last_change":"2024-02-23T06:27:55.754713+0000","last_active":"2024-02-23T06:27:56.753786+0000","last_peered":"2024-02-23T06:27:56.753786+0000","last_clean":"2024-02-23T06:27:56.753786+0000","last_became_active":"2024-02-23T06:27:55.754470+0000","last_became_peered":"2024-02-23T06:27:55.754470+0000","last_unstale":"2024-02-23T06:27:56.753786+0000","last_undegraded":"2024-02-23T06:27:56.753786+0000","last_fullsized":"2024-02-23T06:27:56.753786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:54.732041+0000","last_clean_scrub_stamp":"2024-02-23T06:27:54.732041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T08:41:36.537116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-23T06:27:56.750867+0000","last_change":"2024-02-23T06:27:49.781694+0000","last_active":"2024-02-23T06:27:56.750867+0000","last_peered":"2024-02-23T06:27:56.750867+0000","last_clean":"2024-02-23T06:27:56.750867+0000","last_became_active":"2024-02-23T06:27:49.780640+0000","last_became_peered":"2024-02-23T06:27:49.780640+0000","last_unstale":"2024-02-23T06:27:56.750867+0000","last_undegraded":"2024-02-23T06:27:56.750867+0000","last_fullsized":"2024-02-23T06:27:56.750867+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-23T06:27:48.700290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-23T06:27:48.700290+0000","last_clean_scrub_stamp":"2024-02-23T06:27:48.700290+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-24T07:28:29.851614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-23T06:28:00.016 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-23T06:28:00.016 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-23T06:28:00.016 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-23T06:28:00.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-23T06:28:00.345 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:28:00.346 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-23T06:28:00.358 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-23T06:28:00.359 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-02-23T06:28:00.371 INFO:teuthology.run_tasks:Running task rgw... 2024-02-23T06:28:00.385 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-23T06:28:00.385 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-23T06:28:00.386 INFO:tasks.rgw:Creating data pools 2024-02-23T06:28:00.386 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-23T06:28:00.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-02-23T06:28:00.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-02-23T06:28:02.793 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'default.rgw.buckets.data' created 2024-02-23T06:28:02.812 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-23T06:28:03.800 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-23T06:28:03.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-23T06:28:04.802 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'default.rgw.buckets.index' created 2024-02-23T06:28:04.821 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-23T06:28:05.803 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-23T06:28:05.834 DEBUG:tasks.rgw:Pools created 2024-02-23T06:28:05.835 INFO:tasks.rgw:Configuring compression type = random 2024-02-23T06:28:05.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-02-23T06:28:05.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-02-23T06:28:05.835 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-02-23T06:28:05.941 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:05.941 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:07.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.856+0000 7fdd7f150640 0 -- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5567e760cf70 msgr2=0x5567e760d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:28:07.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.862+0000 7fdd7e94f640 0 -- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5567e7621e60 msgr2=0x5567e76285b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:28:07.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.864+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.865+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.865+0000 7fdd8108c800 20 realm 2024-02-23T06:28:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.865+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.866+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:07.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.866+0000 7fdd8108c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:28:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.866+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.866+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.866+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.867+0000 7fdd8108c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:28:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.867+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.867+0000 7fdd8108c800 20 rados_obj.operate() r=0 bl.length=875 2024-02-23T06:28:07.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.867+0000 7fdd8108c800 20 searching for the correct realm 2024-02-23T06:28:07.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:28:07.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:28:07.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:28:07.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:28:07.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:28:07.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:28:07.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:07.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.879+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:28:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 rados_obj.operate() r=0 bl.length=398 2024-02-23T06:28:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 zone default found 2024-02-23T06:28:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 4 Realm: () 2024-02-23T06:28:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:28:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:28:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:28:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 zonegroup default 2024-02-23T06:28:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:07.880+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:09.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:09.844+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:09.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:09.844+0000 7fdd8108c800 20 rados->read ofs=0 len=0 2024-02-23T06:28:09.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:09.845+0000 7fdd8108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:09.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:09.845+0000 7fdd8108c800 20 started sync module instance, tier type = 2024-02-23T06:28:09.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:09.846+0000 7fdd8108c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=0 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=1 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=2 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=3 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=4 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=5 2024-02-23T06:28:11.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.871+0000 7fdd8108c800 20 add_watcher() i=6 2024-02-23T06:28:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.872+0000 7fdd8108c800 20 add_watcher() i=7 2024-02-23T06:28:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.872+0000 7fdd8108c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:28:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.872+0000 7fdd8108c800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-02-23T06:28:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.872+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-02-23T06:28:11.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.872+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.873+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-02-23T06:28:11.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-02-23T06:28:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-02-23T06:28:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-02-23T06:28:11.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-02-23T06:28:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-02-23T06:28:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.874+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-02-23T06:28:11.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.875+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-02-23T06:28:11.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.876+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.877+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.878+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-02-23T06:28:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.879+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-02-23T06:28:11.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.880+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.881+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-02-23T06:28:11.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.882+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-02-23T06:28:11.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.883+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-02-23T06:28:11.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.884+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.885+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-02-23T06:28:11.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.886+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-02-23T06:28:11.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.887+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.888+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.889+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.890+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-02-23T06:28:11.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.891+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-02-23T06:28:11.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.892+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-02-23T06:28:11.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.893+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.894+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-02-23T06:28:11.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.895+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.896+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.897+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.898+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.899+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-02-23T06:28:11.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.900+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-02-23T06:28:11.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-02-23T06:28:11.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.901+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-02-23T06:28:11.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.902+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-02-23T06:28:11.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.903+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.904+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.905+0000 7fdd8108c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-02-23T06:28:11.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.905+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-02-23T06:28:11.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.906+0000 7fdd8108c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-02-23T06:28:11.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.912+0000 7fdc317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:28:11.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.912+0000 7fdd8108c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:11.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:11.912+0000 7fdd8108c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:14.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.838+0000 7fdd8108c800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-02-23T06:28:14.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.838+0000 7fdd8108c800 5 note: GC not initialized 2024-02-23T06:28:14.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.838+0000 7fdb9bfff640 20 reqs_thread_entry: start 2024-02-23T06:28:14.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.839+0000 7fdd8108c800 20 init_complete bucket index max shards: 11 2024-02-23T06:28:14.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.839+0000 7fdd8108c800 20 Filter name: none 2024-02-23T06:28:14.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.839+0000 7fdb99ffb640 20 reqs_thread_entry: start 2024-02-23T06:28:14.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.870+0000 7fdc317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:28:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.873+0000 7fdd8108c800 20 remove_watcher() i=0 2024-02-23T06:28:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.873+0000 7fdd8108c800 2 removed watcher, disabling cache 2024-02-23T06:28:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.874+0000 7fdd8108c800 20 remove_watcher() i=1 2024-02-23T06:28:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.875+0000 7fdd8108c800 20 remove_watcher() i=2 2024-02-23T06:28:14.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.879+0000 7fdd8108c800 20 remove_watcher() i=3 2024-02-23T06:28:14.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.883+0000 7fdd8108c800 20 remove_watcher() i=4 2024-02-23T06:28:14.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.885+0000 7fdd8108c800 20 remove_watcher() i=5 2024-02-23T06:28:14.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.886+0000 7fdd8108c800 20 remove_watcher() i=6 2024-02-23T06:28:14.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:14.887+0000 7fdd8108c800 20 remove_watcher() i=7 2024-02-23T06:28:14.913 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-02-23T06:28:14.913 DEBUG:tasks.util.rgw: json result: [] 2024-02-23T06:28:14.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-02-23T06:28:14.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-02-23T06:28:14.913 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-02-23T06:28:14.976 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:14.977 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.000+0000 7f566ee13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.000+0000 7f566ee13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.003+0000 7f552cfe1640 20 reqs_thread_entry: start 2024-02-23T06:28:15.019 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"7548481d-b1fb-47f2-93fa-498ec3ee60c4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-23T06:28:15.019 DEBUG:tasks.util.rgw: json result: {'id': '7548481d-b1fb-47f2-93fa-498ec3ee60c4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-23T06:28:15.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-02-23T06:28:15.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-02-23T06:28:15.020 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-02-23T06:28:15.073 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.073 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.102+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.103+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.103+0000 7f2132733800 20 realm 2024-02-23T06:28:15.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.103+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.104+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.104+0000 7f2132733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:28:15.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.104+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.104+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.104+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.105+0000 7f2132733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:28:15.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.105+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.105+0000 7f2132733800 20 rados_obj.operate() r=0 bl.length=891 2024-02-23T06:28:15.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.105+0000 7f2132733800 20 searching for the correct realm 2024-02-23T06:28:15.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.109+0000 7f21259a2640 0 -- 172.21.15.142:0/1452222503 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x560d7f082cd0 msgr2=0x560d7f085190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:28:15.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.112+0000 7f21259a2640 0 -- 172.21.15.142:0/1452222503 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f2120058900 msgr2=0x7f2120003990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.117+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:28:15.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 20 rados_obj.operate() r=0 bl.length=398 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 20 zone default found 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 4 Realm: () 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 20 zonegroup default 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.118+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 started sync module instance, tier type = 2024-02-23T06:28:15.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.119+0000 7f2132733800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=0 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=1 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=2 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=3 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=4 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=5 2024-02-23T06:28:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.137+0000 7f2132733800 20 add_watcher() i=6 2024-02-23T06:28:15.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.140+0000 7f2132733800 20 add_watcher() i=7 2024-02-23T06:28:15.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.140+0000 7f2132733800 2 all 8 watchers are set, enabling cache 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f1fe4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f2132733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f2132733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f2132733800 5 note: GC not initialized 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f1f5f7fe640 20 reqs_thread_entry: start 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f2132733800 20 init_complete bucket index max shards: 11 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.143+0000 7f2132733800 20 Filter name: none 2024-02-23T06:28:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.144+0000 7f1f5d7fa640 20 reqs_thread_entry: start 2024-02-23T06:28:15.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.154+0000 7f1fe4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:28:15.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.156+0000 7f2132733800 20 remove_watcher() i=0 2024-02-23T06:28:15.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.156+0000 7f2132733800 2 removed watcher, disabling cache 2024-02-23T06:28:15.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.157+0000 7f2132733800 20 remove_watcher() i=1 2024-02-23T06:28:15.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.158+0000 7f2132733800 20 remove_watcher() i=2 2024-02-23T06:28:15.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.160+0000 7f2132733800 20 remove_watcher() i=3 2024-02-23T06:28:15.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.161+0000 7f2132733800 20 remove_watcher() i=4 2024-02-23T06:28:15.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.162+0000 7f2132733800 20 remove_watcher() i=5 2024-02-23T06:28:15.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.163+0000 7f2132733800 20 remove_watcher() i=6 2024-02-23T06:28:15.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.164+0000 7f2132733800 20 remove_watcher() i=7 2024-02-23T06:28:15.173 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-02-23T06:28:15.174 DEBUG:tasks.util.rgw: json result: [] 2024-02-23T06:28:15.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-02-23T06:28:15.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-02-23T06:28:15.174 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-02-23T06:28:15.233 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.234 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.255+0000 7fb041417800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.255+0000 7fb041417800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.258+0000 7fae827fc640 20 reqs_thread_entry: start 2024-02-23T06:28:15.274 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"7548481d-b1fb-47f2-93fa-498ec3ee60c4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-23T06:28:15.274 DEBUG:tasks.util.rgw: json result: {'id': '7548481d-b1fb-47f2-93fa-498ec3ee60c4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-23T06:28:15.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-02-23T06:28:15.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-02-23T06:28:15.274 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-02-23T06:28:15.327 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.327 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.357+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 realm 2024-02-23T06:28:15.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:28:15.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.358+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.359+0000 7f181f413800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:28:15.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.359+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.360+0000 7f181f413800 20 rados_obj.operate() r=0 bl.length=891 2024-02-23T06:28:15.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.360+0000 7f181f413800 20 searching for the correct realm 2024-02-23T06:28:15.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.361+0000 7f181a9a3640 0 -- 172.21.15.142:0/3735045168 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f181402f040 msgr2=0x7f181402f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:28:15.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.566+0000 7f181b1a4640 0 -- 172.21.15.142:0/3735045168 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f1804083030 msgr2=0x7f18040779a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.572+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 rados_obj.operate() r=0 bl.length=398 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 zone default found 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 4 Realm: () 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 zonegroup default 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.573+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.574+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.574+0000 7f181f413800 20 rados->read ofs=0 len=0 2024-02-23T06:28:15.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.574+0000 7f181f413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:28:15.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.574+0000 7f181f413800 20 started sync module instance, tier type = 2024-02-23T06:28:15.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.574+0000 7f181f413800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.586+0000 7f181f413800 20 add_watcher() i=0 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.586+0000 7f181f413800 20 add_watcher() i=1 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.586+0000 7f181f413800 20 add_watcher() i=2 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.586+0000 7f181f413800 20 add_watcher() i=3 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.586+0000 7f181f413800 20 add_watcher() i=4 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.586+0000 7f181f413800 20 add_watcher() i=5 2024-02-23T06:28:15.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.587+0000 7f181f413800 20 add_watcher() i=6 2024-02-23T06:28:15.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.589+0000 7f181f413800 20 add_watcher() i=7 2024-02-23T06:28:15.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.589+0000 7f181f413800 2 all 8 watchers are set, enabling cache 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f16d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f181f413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f181f413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f181f413800 5 note: GC not initialized 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f164bfff640 20 reqs_thread_entry: start 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f181f413800 20 init_complete bucket index max shards: 11 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f181f413800 20 Filter name: none 2024-02-23T06:28:15.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.591+0000 7f1649ffb640 20 reqs_thread_entry: start 2024-02-23T06:28:15.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.601+0000 7f16d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:28:15.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.603+0000 7f181f413800 20 remove_watcher() i=0 2024-02-23T06:28:15.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.603+0000 7f181f413800 2 removed watcher, disabling cache 2024-02-23T06:28:15.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.604+0000 7f181f413800 20 remove_watcher() i=1 2024-02-23T06:28:15.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.606+0000 7f181f413800 20 remove_watcher() i=2 2024-02-23T06:28:15.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.607+0000 7f181f413800 20 remove_watcher() i=3 2024-02-23T06:28:15.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.608+0000 7f181f413800 20 remove_watcher() i=4 2024-02-23T06:28:15.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.609+0000 7f181f413800 20 remove_watcher() i=5 2024-02-23T06:28:15.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.610+0000 7f181f413800 20 remove_watcher() i=6 2024-02-23T06:28:15.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.610+0000 7f181f413800 20 remove_watcher() i=7 2024-02-23T06:28:15.620 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2024-02-23T06:28:15.620 DEBUG:tasks.util.rgw: json result: [] 2024-02-23T06:28:15.621 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-02-23T06:28:15.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-02-23T06:28:15.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-02-23T06:28:15.621 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-02-23T06:28:15.680 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.680 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.702+0000 7efce9d3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.702+0000 7efce9d3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.705+0000 7efb1bfff640 20 reqs_thread_entry: start 2024-02-23T06:28:15.720 INFO:teuthology.orchestra.run.smithi142.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-02-23T06:28:15.720 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-02-23T06:28:15.720 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-02-23T06:28:15.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-02-23T06:28:15.720 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-02-23T06:28:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.804+0000 7f9cf812d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.804+0000 7f9cf812d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.807+0000 7f9b39ffb640 20 reqs_thread_entry: start 2024-02-23T06:28:15.822 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"7548481d-b1fb-47f2-93fa-498ec3ee60c4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-23T06:28:15.822 DEBUG:tasks.util.rgw: json result: {'id': '7548481d-b1fb-47f2-93fa-498ec3ee60c4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-23T06:28:15.822 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-02-23T06:28:15.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-02-23T06:28:15.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-02-23T06:28:15.823 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-02-23T06:28:15.884 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.884 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:15.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.906+0000 7ff63fd2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:15.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.906+0000 7ff63fd2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:15.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:15.909+0000 7ff491ffb640 20 reqs_thread_entry: start 2024-02-23T06:28:15.923 INFO:teuthology.orchestra.run.smithi142.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-02-23T06:28:15.924 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-02-23T06:28:15.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-02-23T06:28:15.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-02-23T06:28:15.924 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-02-23T06:28:15.985 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:28:15.985 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:28:16.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:16.007+0000 7f94a75af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:28:16.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:16.007+0000 7f94a75af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:28:16.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:28:16.010+0000 7f92eaffd640 20 reqs_thread_entry: start 2024-02-23T06:28:16.025 INFO:teuthology.orchestra.run.smithi142.stdout:{"id":"7548481d-b1fb-47f2-93fa-498ec3ee60c4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-23T06:28:16.025 DEBUG:tasks.util.rgw: json result: {'id': '7548481d-b1fb-47f2-93fa-498ec3ee60c4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-23T06:28:16.026 INFO:tasks.rgw:Starting rgw... 2024-02-23T06:28:16.026 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-23T06:28:16.026 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-23T06:28:16.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo echo -n http://smithi142.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-02-23T06:28:16.066 INFO:teuthology.orchestra.run.smithi142.stdout:http://smithi142.front.sepia.ceph.com:80 2024-02-23T06:28:16.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-02-23T06:28:16.147 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-23T06:28:16.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-23T06:28:16.189 INFO:tasks.rgw.client.0:Started 2024-02-23T06:28:16.190 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi142.front.sepia.ceph.com:80/ 2024-02-23T06:28:16.190 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-02-23T06:28:16.290 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-23T06:28:16.290 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-23T06:28:16.290 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-02-23T06:28:16.290 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-23T06:28:16.290 INFO:teuthology.orchestra.run.smithi142.stderr:curl: (7) Failed to connect to smithi142.front.sepia.ceph.com port 80: Connection refused 2024-02-23T06:28:17.291 DEBUG:teuthology.orchestra.run.smithi142:> curl http://smithi142.front.sepia.ceph.com:80/ 2024-02-23T06:28:17.321 INFO:teuthology.orchestra.run.smithi142.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-23T06:28:17.321 INFO:teuthology.orchestra.run.smithi142.stderr: Dload Upload Total Spent Left Speed 2024-02-23T06:28:17.323 INFO:teuthology.orchestra.run.smithi142.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2024-02-23T06:28:17.323 INFO:teuthology.orchestra.run.smithi142.stdout:anonymous 2024-02-23T06:28:17.324 INFO:teuthology.run_tasks:Running task tox... 2024-02-23T06:28:17.338 INFO:tasks.tox:Deploying tox from pip... 2024-02-23T06:28:17.338 DEBUG:teuthology.orchestra.run.smithi142:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-02-23T06:28:20.052 DEBUG:teuthology.orchestra.run.smithi142:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-02-23T06:28:20.670 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting tox==3.15.0 2024-02-23T06:28:20.795 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-02-23T06:28:21.004 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting py<2,>=1.4.17 2024-02-23T06:28:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-02-23T06:28:21.363 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-02-23T06:28:21.381 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-02-23T06:28:21.590 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting pluggy<1,>=0.12.0 2024-02-23T06:28:21.607 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-02-23T06:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting filelock<4,>=3.0.0 2024-02-23T06:28:21.732 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2024-02-23T06:28:21.841 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting packaging>=14 2024-02-23T06:28:21.858 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2024-02-23T06:28:21.948 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting six<2,>=1.14.0 2024-02-23T06:28:21.965 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-02-23T06:28:22.040 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting toml>=0.9.4 2024-02-23T06:28:22.057 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-02-23T06:28:22.186 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting distlib<1,>=0.3.7 2024-02-23T06:28:22.204 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-02-23T06:28:22.306 INFO:teuthology.orchestra.run.smithi142.stdout:Collecting platformdirs<5,>=3.9.1 2024-02-23T06:28:22.323 INFO:teuthology.orchestra.run.smithi142.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-02-23T06:28:22.434 INFO:teuthology.orchestra.run.smithi142.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-02-23T06:28:23.250 INFO:teuthology.orchestra.run.smithi142.stdout:Successfully installed distlib-0.3.8 filelock-3.13.1 packaging-23.2 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-02-23T06:28:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: You are using pip version 21.2.3; however, version 24.0 is available. 2024-02-23T06:28:23.509 INFO:teuthology.orchestra.run.smithi142.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-02-23T06:28:23.571 INFO:teuthology.run_tasks:Running task workunit... 2024-02-23T06:28:23.589 INFO:tasks.workunit:Pulling workunits from ref 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:28:23.589 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-23T06:28:23.590 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:28:23.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:28:23.617 INFO:teuthology.orchestra.run.smithi142.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-23T06:28:23.617 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:28:23.684 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-23T06:28:23.684 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-23T06:28:23.751 INFO:tasks.workunit:timeout=3h 2024-02-23T06:28:23.751 INFO:tasks.workunit:cleanup=True 2024-02-23T06:28:23.751 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:28:23.820 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-23T06:29:35.961 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'. 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.310 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:36.311 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at 1fb7413ec44 Merge branches 'pr-55565', 'pr-55627' and 'wip-64543' into wip-cbodley-testing 2024-02-23T06:29:36.312 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-23T06:29:36.345 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-23T06:29:36.347 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:29:36.347 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-23T06:29:36.978 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-23T06:29:37.050 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-23T06:29:37.092 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:29:37.092 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:29:37.092 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-23T06:29:37.130 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:29:37.133 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:29:37.133 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-23T06:29:37.202 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-02-23T06:29:37.203 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-02-23T06:29:37.204 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-02-23T06:29:37.273 INFO:tasks.workunit.client.0.smithi142.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-02-23T06:29:37.274 INFO:tasks.workunit.client.0.smithi142.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-02-23T06:29:37.274 INFO:tasks.workunit.client.0.smithi142.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:++ deactivate nondestructive 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:++ hash -r 2024-02-23T06:29:39.610 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:29:39.611 INFO:tasks.workunit.client.0.smithi142.stderr:++ unset VIRTUAL_ENV 2024-02-23T06:29:39.611 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-02-23T06:29:39.611 INFO:tasks.workunit.client.0.smithi142.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ export VIRTUAL_ENV 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ export PATH 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -z '' ']' 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ _OLD_VIRTUAL_PS1= 2024-02-23T06:29:39.612 INFO:tasks.workunit.client.0.smithi142.stderr:++ PS1='(rgw) ' 2024-02-23T06:29:39.613 INFO:tasks.workunit.client.0.smithi142.stderr:++ export PS1 2024-02-23T06:29:39.613 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-02-23T06:29:39.613 INFO:tasks.workunit.client.0.smithi142.stderr:++ hash -r 2024-02-23T06:29:39.613 INFO:tasks.workunit.client.0.smithi142.stderr:+ pip install pip --upgrade 2024-02-23T06:29:39.844 INFO:tasks.workunit.client.0.smithi142.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-02-23T06:29:40.058 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting pip 2024-02-23T06:29:40.133 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-02-23T06:29:40.306 INFO:tasks.workunit.client.0.smithi142.stdout:Installing collected packages: pip 2024-02-23T06:29:40.306 INFO:tasks.workunit.client.0.smithi142.stdout: Attempting uninstall: pip 2024-02-23T06:29:40.306 INFO:tasks.workunit.client.0.smithi142.stdout: Found existing installation: pip 21.2.3 2024-02-23T06:29:40.453 INFO:tasks.workunit.client.0.smithi142.stdout: Uninstalling pip-21.2.3: 2024-02-23T06:29:40.458 INFO:tasks.workunit.client.0.smithi142.stdout: Successfully uninstalled pip-21.2.3 2024-02-23T06:29:41.429 INFO:tasks.workunit.client.0.smithi142.stdout:Successfully installed pip-24.0 2024-02-23T06:29:41.684 INFO:tasks.workunit.client.0.smithi142.stderr:+ pip install boto3 2024-02-23T06:29:42.595 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting boto3 2024-02-23T06:29:42.672 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading boto3-1.34.48-py3-none-any.whl.metadata (6.6 kB) 2024-02-23T06:29:43.335 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting botocore<1.35.0,>=1.34.48 (from boto3) 2024-02-23T06:29:43.352 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading botocore-1.34.48-py3-none-any.whl.metadata (5.7 kB) 2024-02-23T06:29:43.490 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-02-23T06:29:43.506 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-02-23T06:29:43.653 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-02-23T06:29:43.670 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-02-23T06:29:43.796 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:29:43.814 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2024-02-23T06:29:43.917 INFO:tasks.workunit.client.0.smithi142.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 2.4 MB/s eta 0:00:00 2024-02-23T06:29:44.024 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:29:44.042 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-02-23T06:29:44.093 INFO:tasks.workunit.client.0.smithi142.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 783.4 kB/s eta 0:00:00 2024-02-23T06:29:44.378 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:29:44.395 INFO:tasks.workunit.client.0.smithi142.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-02-23T06:29:44.491 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading boto3-1.34.48-py3-none-any.whl (139 kB) 2024-02-23T06:29:44.545 INFO:tasks.workunit.client.0.smithi142.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 2.5 MB/s eta 0:00:00 2024-02-23T06:29:44.571 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading botocore-1.34.48-py3-none-any.whl (12.0 MB) 2024-02-23T06:29:44.839 INFO:tasks.workunit.client.0.smithi142.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 45.9 MB/s eta 0:00:00 2024-02-23T06:29:44.856 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-02-23T06:29:44.920 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-02-23T06:29:44.972 INFO:tasks.workunit.client.0.smithi142.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.1/82.1 kB 1.4 MB/s eta 0:00:00 2024-02-23T06:29:44.994 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-02-23T06:29:45.047 INFO:tasks.workunit.client.0.smithi142.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 2.6 MB/s eta 0:00:00 2024-02-23T06:29:45.148 INFO:tasks.workunit.client.0.smithi142.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-02-23T06:29:46.183 INFO:tasks.workunit.client.0.smithi142.stdout:Successfully installed boto3-1.34.48 botocore-1.34.48 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-02-23T06:29:46.318 INFO:tasks.workunit.client.0.smithi142.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-02-23T06:29:46.453 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-02-23T06:29:46.486 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:46.486 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:46.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.519+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 realm 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.521+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.522+0000 7fb7c7c44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:46.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.522+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.522+0000 7fb7c7c44800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:46.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.522+0000 7fb7c7c44800 20 searching for the correct realm 2024-02-23T06:29:46.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.526+0000 7fb7c5d44640 0 -- 172.21.15.142:0/956026535 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fb7b007e070 msgr2=0x7fb7b006b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:46.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.529+0000 7fb7c5543640 0 -- 172.21.15.142:0/956026535 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb7b0056a10 msgr2=0x7fb7b005b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:46.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:46.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:46.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:46.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:46.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:46.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:46.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.735+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.736+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.736+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.736+0000 7fb7c7c44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:46.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.736+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:46.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 zone default found 2024-02-23T06:29:46.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 4 Realm: () 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 zonegroup default 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.737+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.738+0000 7fb7c7c44800 20 started sync module instance, tier type = 2024-02-23T06:29:46.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.738+0000 7fb7c7c44800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:46.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=0 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=1 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=2 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=3 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=4 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=5 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.753+0000 7fb7c7c44800 20 add_watcher() i=6 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.754+0000 7fb7c7c44800 20 add_watcher() i=7 2024-02-23T06:29:46.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.754+0000 7fb7c7c44800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:46.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb67b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:46.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb7c7c44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:46.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb7c7c44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb7c7c44800 5 note: GC not initialized 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb67a7e4640 20 reqs_thread_entry: start 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb7c7c44800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.756+0000 7fb7c7c44800 20 Filter name: none 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb5ebfff640 20 reqs_thread_entry: start 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-02-23T06:29:46.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-02-23T06:29:46.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-02-23T06:29:46.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.757+0000 7fb7c7c44800 20 rados->read ofs=0 len=0 2024-02-23T06:29:46.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.758+0000 7fb7c7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:46.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.758+0000 7fb7c7c44800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-02-23T06:29:46.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.758+0000 7fb7c7c44800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-02-23T06:29:46.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.758+0000 7fb7c7c44800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-02-23T06:29:46.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.758+0000 7fb7c7c44800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-02-23T06:29:46.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.760+0000 7fb7c7c44800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-02-23T06:29:46.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.760+0000 7fb7c7c44800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-02-23T06:29:46.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.760+0000 7fb7c7c44800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-02-23T06:29:46.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.760+0000 7fb6a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94521804890208 notifier 4583 bl.length()=560 2024-02-23T06:29:46.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.760+0000 7fb6a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-02-23T06:29:46.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.760+0000 7fb6a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-02-23T06:29:46.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.764+0000 7fb7c7c44800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-02-23T06:29:46.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.764+0000 7fb7c7c44800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-02-23T06:29:46.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.764+0000 7fb7c7c44800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-02-23T06:29:46.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.765+0000 7fb6a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94521804883312 notifier 4583 bl.length()=186 2024-02-23T06:29:46.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.765+0000 7fb6a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-02-23T06:29:46.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.765+0000 7fb6a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-02-23T06:29:46.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.766+0000 7fb67b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:46.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.769+0000 7fb7c7c44800 20 remove_watcher() i=0 2024-02-23T06:29:46.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.769+0000 7fb7c7c44800 2 removed watcher, disabling cache 2024-02-23T06:29:46.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.770+0000 7fb7c7c44800 20 remove_watcher() i=1 2024-02-23T06:29:46.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.771+0000 7fb7c7c44800 20 remove_watcher() i=2 2024-02-23T06:29:46.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.772+0000 7fb7c7c44800 20 remove_watcher() i=3 2024-02-23T06:29:46.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.773+0000 7fb7c7c44800 20 remove_watcher() i=4 2024-02-23T06:29:46.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.774+0000 7fb7c7c44800 20 remove_watcher() i=5 2024-02-23T06:29:46.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.775+0000 7fb7c7c44800 20 remove_watcher() i=6 2024-02-23T06:29:46.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:46.776+0000 7fb7c7c44800 20 remove_watcher() i=7 2024-02-23T06:29:47.084 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: recalculated bucket check stats are correct 2024-02-23T06:29:47.084 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:47.085 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-02-23T06:29:47.114 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:47.114 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.147+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.148+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.148+0000 7ff96d00f800 20 realm 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.148+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.149+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.149+0000 7ff96d00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.149+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.149+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.149+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.150+0000 7ff96d00f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:47.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.150+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.150+0000 7ff96d00f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:47.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.150+0000 7ff96d00f800 20 searching for the correct realm 2024-02-23T06:29:47.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.152+0000 7ff96854f640 0 -- 172.21.15.142:0/2303495081 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x55e1f7ef4490 msgr2=0x7ff96005ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:47.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.357+0000 7ff968d50640 0 -- 172.21.15.142:0/2303495081 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7ff95002d040 msgr2=0x7ff95001b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.362+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:47.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 20 zone default found 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 4 Realm: () 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.363+0000 7ff96d00f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 zonegroup default 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.364+0000 7ff96d00f800 20 started sync module instance, tier type = 2024-02-23T06:29:47.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.365+0000 7ff96d00f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:47.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=0 2024-02-23T06:29:47.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=1 2024-02-23T06:29:47.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=2 2024-02-23T06:29:47.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=3 2024-02-23T06:29:47.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=4 2024-02-23T06:29:47.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=5 2024-02-23T06:29:47.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.379+0000 7ff96d00f800 20 add_watcher() i=6 2024-02-23T06:29:47.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.382+0000 7ff96d00f800 20 add_watcher() i=7 2024-02-23T06:29:47.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.382+0000 7ff96d00f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:47.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.383+0000 7ff81efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 5 note: GC not initialized 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff81dfdb640 20 reqs_thread_entry: start 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 20 Filter name: none 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff78f7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.384+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:47.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:47.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:47.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:47.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.385+0000 7ff96d00f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.386+0000 7ff96d00f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.386+0000 7ff96d00f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.386+0000 7ff96d00f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:29:47.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.386+0000 7ff96d00f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:29:47.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.395+0000 7ff81efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:47.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.399+0000 7ff96d00f800 20 remove_watcher() i=0 2024-02-23T06:29:47.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.399+0000 7ff96d00f800 2 removed watcher, disabling cache 2024-02-23T06:29:47.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.400+0000 7ff96d00f800 20 remove_watcher() i=1 2024-02-23T06:29:47.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.402+0000 7ff96d00f800 20 remove_watcher() i=2 2024-02-23T06:29:47.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.403+0000 7ff96d00f800 20 remove_watcher() i=3 2024-02-23T06:29:47.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.404+0000 7ff96d00f800 20 remove_watcher() i=4 2024-02-23T06:29:47.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.405+0000 7ff96d00f800 20 remove_watcher() i=5 2024-02-23T06:29:47.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.406+0000 7ff96d00f800 20 remove_watcher() i=6 2024-02-23T06:29:47.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.407+0000 7ff96d00f800 20 remove_watcher() i=7 2024-02-23T06:29:47.419 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-02-23T06:29:47.446 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:47.446 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:47.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.479+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 realm 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.480+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.481+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:47.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.481+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.481+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:47.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.481+0000 7fd6b852a800 20 searching for the correct realm 2024-02-23T06:29:47.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.485+0000 7fd6b384a640 0 -- 172.21.15.142:0/2364215173 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fd6a4067020 msgr2=0x7fd6a409f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:47.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.488+0000 7fd6b484c640 0 -- 172.21.15.142:0/2364215173 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7fd6a8060e20 msgr2=0x7fd6a8078950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.491+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:47.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 zone default found 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 4 Realm: () 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 zonegroup default 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.492+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.493+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.493+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.493+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.493+0000 7fd6b852a800 20 started sync module instance, tier type = 2024-02-23T06:29:47.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.493+0000 7fd6b852a800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:47.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=0 2024-02-23T06:29:47.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=1 2024-02-23T06:29:47.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=2 2024-02-23T06:29:47.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=3 2024-02-23T06:29:47.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=4 2024-02-23T06:29:47.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=5 2024-02-23T06:29:47.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.509+0000 7fd6b852a800 20 add_watcher() i=6 2024-02-23T06:29:47.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.512+0000 7fd6b852a800 20 add_watcher() i=7 2024-02-23T06:29:47.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.512+0000 7fd6b852a800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:47.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd56afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd6b852a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd6b852a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd6b852a800 5 note: GC not initialized 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd569fdb640 20 reqs_thread_entry: start 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd6b852a800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd6b852a800 20 Filter name: none 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd4db7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.514+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:47.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:47.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.515+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.516+0000 7fd6b852a800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.516+0000 7fd6b852a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.517+0000 7fd6b852a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.517+0000 7fd6b852a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.518+0000 7fd56afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:47.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.520+0000 7fd6b852a800 20 remove_watcher() i=0 2024-02-23T06:29:47.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.520+0000 7fd6b852a800 2 removed watcher, disabling cache 2024-02-23T06:29:47.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.521+0000 7fd6b852a800 20 remove_watcher() i=1 2024-02-23T06:29:47.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.523+0000 7fd6b852a800 20 remove_watcher() i=2 2024-02-23T06:29:47.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.524+0000 7fd6b852a800 20 remove_watcher() i=3 2024-02-23T06:29:47.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.526+0000 7fd6b852a800 20 remove_watcher() i=4 2024-02-23T06:29:47.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.527+0000 7fd6b852a800 20 remove_watcher() i=5 2024-02-23T06:29:47.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.528+0000 7fd6b852a800 20 remove_watcher() i=6 2024-02-23T06:29:47.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.529+0000 7fd6b852a800 20 remove_watcher() i=7 2024-02-23T06:29:47.539 INFO:tasks.workunit.client.0.smithi142.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-02-23T06:29:47.539 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check unlinked does not report normal entries 2024-02-23T06:29:47.539 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:47.540 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-02-23T06:29:47.572 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:47.572 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:47.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.604+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 realm 2024-02-23T06:29:47.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:47.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.606+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.607+0000 7f4f32b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:47.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.607+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.607+0000 7f4f32b1f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:47.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.607+0000 7f4f32b1f800 20 searching for the correct realm 2024-02-23T06:29:47.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.610+0000 7f4f25da2640 0 -- 172.21.15.142:0/1637477171 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x562cad2fe430 msgr2=0x562cad3008f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:47.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.614+0000 7f4f2e5a3640 0 -- 172.21.15.142:0/1637477171 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f4f18066c20 msgr2=0x7f4f180277b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:47.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:47.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:47.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:47.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:47.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:47.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:47.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.618+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:47.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 zone default found 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 4 Realm: () 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 zonegroup default 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.619+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.620+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.620+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.620+0000 7f4f32b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:47.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.620+0000 7f4f32b1f800 20 started sync module instance, tier type = 2024-02-23T06:29:47.622 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.620+0000 7f4f32b1f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:47.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=0 2024-02-23T06:29:47.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=1 2024-02-23T06:29:47.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=2 2024-02-23T06:29:47.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=3 2024-02-23T06:29:47.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=4 2024-02-23T06:29:47.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=5 2024-02-23T06:29:47.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.631+0000 7f4f32b1f800 20 add_watcher() i=6 2024-02-23T06:29:47.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.632+0000 7f4f32b1f800 20 add_watcher() i=7 2024-02-23T06:29:47.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.632+0000 7f4f32b1f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:47.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4de4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 5 note: GC not initialized 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4d5f7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 20 Filter name: none 2024-02-23T06:29:47.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4d5d7fa640 20 reqs_thread_entry: start 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.634+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:47.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.635+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:47.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.636+0000 7f4f32b1f800 1 NOTICE: finished shard 0 (0 entries found) 2024-02-23T06:29:47.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.636+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:47.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.636+0000 7f4f32b1f800 1 NOTICE: finished shard 1 (0 entries found) 2024-02-23T06:29:47.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.636+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:47.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.637+0000 7f4f32b1f800 1 NOTICE: finished shard 2 (0 entries found) 2024-02-23T06:29:47.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.637+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.637+0000 7f4f32b1f800 1 NOTICE: finished shard 3 (0 entries found) 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.637+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.637+0000 7f4f32b1f800 1 NOTICE: finished shard 4 (0 entries found) 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.637+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.638+0000 7f4f32b1f800 1 NOTICE: finished shard 5 (0 entries found) 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.638+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.638+0000 7f4f32b1f800 1 NOTICE: finished shard 6 (0 entries found) 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.638+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.639+0000 7f4f32b1f800 1 NOTICE: finished shard 7 (0 entries found) 2024-02-23T06:29:47.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.639+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:47.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.841+0000 7f4f32b1f800 1 NOTICE: finished shard 8 (0 entries found) 2024-02-23T06:29:47.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.841+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:47.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.841+0000 7f4f32b1f800 1 NOTICE: finished shard 9 (0 entries found) 2024-02-23T06:29:47.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.841+0000 7f4f32b1f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:47.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.842+0000 7f4f32b1f800 1 NOTICE: finished shard 10 (0 entries found) 2024-02-23T06:29:47.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.842+0000 7f4f32b1f800 1 NOTICE: finished all shards (0 entries found) 2024-02-23T06:29:47.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.842+0000 7f4de4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:47.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.845+0000 7f4f32b1f800 20 remove_watcher() i=0 2024-02-23T06:29:47.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.845+0000 7f4f32b1f800 2 removed watcher, disabling cache 2024-02-23T06:29:47.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.846+0000 7f4f32b1f800 20 remove_watcher() i=1 2024-02-23T06:29:47.847 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.847+0000 7f4f32b1f800 20 remove_watcher() i=2 2024-02-23T06:29:47.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.848+0000 7f4f32b1f800 20 remove_watcher() i=3 2024-02-23T06:29:47.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.849+0000 7f4f32b1f800 20 remove_watcher() i=4 2024-02-23T06:29:47.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.850+0000 7f4f32b1f800 20 remove_watcher() i=5 2024-02-23T06:29:47.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.853+0000 7f4f32b1f800 20 remove_watcher() i=6 2024-02-23T06:29:47.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:47.854+0000 7f4f32b1f800 20 remove_watcher() i=7 2024-02-23T06:29:47.865 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-02-23T06:29:48.254 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-02-23T06:29:49.696 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:49.697 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-02-23T06:29:49.731 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:49.731 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:49.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.769+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:49.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:49.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 realm 2024-02-23T06:29:49.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:49.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:49.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:49.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:49.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:49.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.771+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:49.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.772+0000 7f9fd842e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:49.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.772+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:49.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.773+0000 7f9fd842e800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:49.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.773+0000 7f9fd842e800 20 searching for the correct realm 2024-02-23T06:29:49.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.776+0000 7f9fcada2640 0 -- 172.21.15.142:0/637813412 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f9fc406b060 msgr2=0x7f9fc409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:49.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:49.982+0000 7f9fd35a3640 0 -- 172.21.15.142:0/637813412 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f9fbc017050 msgr2=0x7f9fbc00e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:50.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.189+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:50.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 zone default found 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 4 Realm: () 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 zonegroup default 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.190+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.191+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.191+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.191+0000 7f9fd842e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.191+0000 7f9fd842e800 20 started sync module instance, tier type = 2024-02-23T06:29:50.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.191+0000 7f9fd842e800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=0 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=1 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=2 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=3 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=4 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=5 2024-02-23T06:29:50.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.202+0000 7f9fd842e800 20 add_watcher() i=6 2024-02-23T06:29:50.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.204+0000 7f9fd842e800 20 add_watcher() i=7 2024-02-23T06:29:50.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.204+0000 7f9fd842e800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:50.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9e89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9fd842e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:50.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9fd842e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:50.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9fd842e800 5 note: GC not initialized 2024-02-23T06:29:50.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9e88fe1640 20 reqs_thread_entry: start 2024-02-23T06:29:50.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9fd842e800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:50.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9fd842e800 20 Filter name: none 2024-02-23T06:29:50.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.206+0000 7f9e027fc640 20 reqs_thread_entry: start 2024-02-23T06:29:50.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:50.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 INFO: main: starting shard=0 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.207+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.208+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.208+0000 7f9fd842e800 20 INFO: main: starting shard=1 2024-02-23T06:29:50.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.208+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:50.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.209+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.209+0000 7f9fd842e800 20 INFO: main: starting shard=2 2024-02-23T06:29:50.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.209+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:50.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.209+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.209+0000 7f9fd842e800 20 INFO: main: starting shard=3 2024-02-23T06:29:50.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.209+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:50.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.210+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.210+0000 7f9fd842e800 20 INFO: main: starting shard=4 2024-02-23T06:29:50.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.210+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:50.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.210+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.210+0000 7f9fd842e800 20 INFO: main: starting shard=5 2024-02-23T06:29:50.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.210+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:50.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.211+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.211+0000 7f9fd842e800 20 INFO: main: starting shard=6 2024-02-23T06:29:50.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.211+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:50.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.211+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.211+0000 7f9fd842e800 20 INFO: main: starting shard=7 2024-02-23T06:29:50.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.211+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:50.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.212+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.212+0000 7f9fd842e800 20 INFO: main: starting shard=8 2024-02-23T06:29:50.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.212+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:50.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.212+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-02-23T06:29:50.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.213+0000 7f9fd842e800 20 INFO: main: starting shard=9 2024-02-23T06:29:50.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.213+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:50.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.213+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.213+0000 7f9fd842e800 20 INFO: main: starting shard=10 2024-02-23T06:29:50.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.213+0000 7f9fd842e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:50.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.214+0000 7f9fd842e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.214+0000 7f9fd842e800 20 INFO: main: done 2024-02-23T06:29:50.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.214+0000 7f9e89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.217+0000 7f9fd842e800 20 remove_watcher() i=0 2024-02-23T06:29:50.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.217+0000 7f9fd842e800 2 removed watcher, disabling cache 2024-02-23T06:29:50.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.218+0000 7f9fd842e800 20 remove_watcher() i=1 2024-02-23T06:29:50.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.220+0000 7f9fd842e800 20 remove_watcher() i=2 2024-02-23T06:29:50.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.221+0000 7f9fd842e800 20 remove_watcher() i=3 2024-02-23T06:29:50.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.222+0000 7f9fd842e800 20 remove_watcher() i=4 2024-02-23T06:29:50.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.223+0000 7f9fd842e800 20 remove_watcher() i=5 2024-02-23T06:29:50.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.224+0000 7f9fd842e800 20 remove_watcher() i=6 2024-02-23T06:29:50.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.225+0000 7f9fd842e800 20 remove_watcher() i=7 2024-02-23T06:29:50.310 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:50.312 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-02-23T06:29:50.341 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:50.341 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:50.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.374+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.375+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 20 realm 2024-02-23T06:29:50.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:50.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.376+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.377+0000 7f8742e13800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.377+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.377+0000 7f8742e13800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:50.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.377+0000 7f8742e13800 20 searching for the correct realm 2024-02-23T06:29:50.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.381+0000 7f87359a2640 0 -- 172.21.15.142:0/4120661119 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x5636dd0effd0 msgr2=0x5636dd0f2420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:50.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.384+0000 7f873e1a3640 0 -- 172.21.15.142:0/4120661119 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f872805d790 msgr2=0x7f872805dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:50.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:50.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:50.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.389+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:50.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 zone default found 2024-02-23T06:29:50.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 4 Realm: () 2024-02-23T06:29:50.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:50.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:50.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 zonegroup default 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 started sync module instance, tier type = 2024-02-23T06:29:50.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.390+0000 7f8742e13800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:50.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=0 2024-02-23T06:29:50.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=1 2024-02-23T06:29:50.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=2 2024-02-23T06:29:50.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=3 2024-02-23T06:29:50.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=4 2024-02-23T06:29:50.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=5 2024-02-23T06:29:50.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.400+0000 7f8742e13800 20 add_watcher() i=6 2024-02-23T06:29:50.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.401+0000 7f8742e13800 20 add_watcher() i=7 2024-02-23T06:29:50.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.401+0000 7f8742e13800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:50.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f85f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f8742e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f8742e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f8742e13800 5 note: GC not initialized 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f856f7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f8742e13800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.403+0000 7f8742e13800 20 Filter name: none 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f856d7fa640 20 reqs_thread_entry: start 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:50.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:50.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:50.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 INFO: main: starting shard=0 2024-02-23T06:29:50.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.404+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:50.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.405+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.405+0000 7f8742e13800 20 INFO: main: starting shard=1 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.405+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.406+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.406+0000 7f8742e13800 20 INFO: main: starting shard=2 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.406+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.406+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.406+0000 7f8742e13800 20 INFO: main: starting shard=3 2024-02-23T06:29:50.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.406+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:50.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.407+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.407+0000 7f8742e13800 20 INFO: main: starting shard=4 2024-02-23T06:29:50.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.407+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:50.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.407+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.407+0000 7f8742e13800 20 INFO: main: starting shard=5 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.407+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.408+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.408+0000 7f8742e13800 20 INFO: main: starting shard=6 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.408+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.408+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.408+0000 7f8742e13800 20 INFO: main: starting shard=7 2024-02-23T06:29:50.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.408+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 INFO: main: starting shard=8 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 INFO: main: starting shard=9 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 INFO: main: starting shard=10 2024-02-23T06:29:50.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.409+0000 7f8742e13800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:50.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.410+0000 7f8742e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.410+0000 7f8742e13800 20 INFO: main: done 2024-02-23T06:29:50.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.411+0000 7f85f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.413+0000 7f8742e13800 20 remove_watcher() i=0 2024-02-23T06:29:50.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.413+0000 7f8742e13800 2 removed watcher, disabling cache 2024-02-23T06:29:50.414 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.414+0000 7f8742e13800 20 remove_watcher() i=1 2024-02-23T06:29:50.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.415+0000 7f8742e13800 20 remove_watcher() i=2 2024-02-23T06:29:50.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.416+0000 7f8742e13800 20 remove_watcher() i=3 2024-02-23T06:29:50.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.418+0000 7f8742e13800 20 remove_watcher() i=4 2024-02-23T06:29:50.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.419+0000 7f8742e13800 20 remove_watcher() i=5 2024-02-23T06:29:50.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.420+0000 7f8742e13800 20 remove_watcher() i=6 2024-02-23T06:29:50.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.421+0000 7f8742e13800 20 remove_watcher() i=7 2024-02-23T06:29:50.490 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:50.492 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-02-23T06:29:50.523 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:50.523 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:50.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.556+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.557+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.557+0000 7fb86bf35800 20 realm 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.557+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.557+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.557+0000 7fb86bf35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.557+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.558+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.558+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.558+0000 7fb86bf35800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.558+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.559+0000 7fb86bf35800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:50.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.559+0000 7fb86bf35800 20 searching for the correct realm 2024-02-23T06:29:50.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.562+0000 7fb86824c640 0 -- 172.21.15.142:0/249549684 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x55ec728768b0 msgr2=0x55ec72878d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:50.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.565+0000 7fb867a4b640 0 -- 172.21.15.142:0/249549684 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb8500cf580 msgr2=0x7fb8500a62f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:50.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.569+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 zone default found 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 4 Realm: () 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 zonegroup default 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.570+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.571+0000 7fb86bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.571+0000 7fb86bf35800 20 started sync module instance, tier type = 2024-02-23T06:29:50.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.571+0000 7fb86bf35800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:50.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=0 2024-02-23T06:29:50.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=1 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=2 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=3 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=4 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=5 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.585+0000 7fb86bf35800 20 add_watcher() i=6 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.586+0000 7fb86bf35800 20 add_watcher() i=7 2024-02-23T06:29:50.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.586+0000 7fb86bf35800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:50.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.588+0000 7fb71dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.588+0000 7fb86bf35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:50.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.588+0000 7fb86bf35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:50.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.588+0000 7fb86bf35800 5 note: GC not initialized 2024-02-23T06:29:50.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb71cfe1640 20 reqs_thread_entry: start 2024-02-23T06:29:50.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 Filter name: none 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb6967fc640 20 reqs_thread_entry: start 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 INFO: main: starting shard=0 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.589+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.590+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.590+0000 7fb86bf35800 20 INFO: main: starting shard=1 2024-02-23T06:29:50.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.590+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.590+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 INFO: main: starting shard=2 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 INFO: main: starting shard=3 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 INFO: main: starting shard=4 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.591+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.592+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.592+0000 7fb86bf35800 20 INFO: main: starting shard=5 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.592+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:50.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.592+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.592+0000 7fb86bf35800 20 INFO: main: starting shard=6 2024-02-23T06:29:50.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.592+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:50.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 INFO: main: starting shard=7 2024-02-23T06:29:50.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:50.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 INFO: main: starting shard=8 2024-02-23T06:29:50.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:50.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 INFO: main: starting shard=9 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.593+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.594+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.594+0000 7fb86bf35800 20 INFO: main: starting shard=10 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.594+0000 7fb86bf35800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.594+0000 7fb86bf35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.594+0000 7fb86bf35800 20 INFO: main: done 2024-02-23T06:29:50.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.595+0000 7fb71dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.597+0000 7fb86bf35800 20 remove_watcher() i=0 2024-02-23T06:29:50.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.597+0000 7fb86bf35800 2 removed watcher, disabling cache 2024-02-23T06:29:50.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.598+0000 7fb86bf35800 20 remove_watcher() i=1 2024-02-23T06:29:50.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.600+0000 7fb86bf35800 20 remove_watcher() i=2 2024-02-23T06:29:50.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.601+0000 7fb86bf35800 20 remove_watcher() i=3 2024-02-23T06:29:50.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.602+0000 7fb86bf35800 20 remove_watcher() i=4 2024-02-23T06:29:50.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.603+0000 7fb86bf35800 20 remove_watcher() i=5 2024-02-23T06:29:50.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.605+0000 7fb86bf35800 20 remove_watcher() i=6 2024-02-23T06:29:50.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.606+0000 7fb86bf35800 20 remove_watcher() i=7 2024-02-23T06:29:50.679 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:50.681 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-02-23T06:29:50.710 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:50.710 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:50.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.743+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.744+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.744+0000 7fe7a103a800 20 realm 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.744+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.745+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.746+0000 7fe7a103a800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:50.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.746+0000 7fe7a103a800 20 searching for the correct realm 2024-02-23T06:29:50.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.750+0000 7fe79c84c640 0 -- 172.21.15.142:0/4036637360 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7fe784086410 msgr2=0x7fe784086890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:50.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.955+0000 7fe79c04b640 0 -- 172.21.15.142:0/4036637360 >> [v2:172.21.15.152:6824/160508611,v1:172.21.15.152:6825/160508611] conn(0x55c94c9d7590 msgr2=0x55c94c9d9980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:50.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:50.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.958+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 zone default found 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 4 Realm: () 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 zonegroup default 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.959+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.960+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.960+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.960+0000 7fe7a103a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:50.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.960+0000 7fe7a103a800 20 started sync module instance, tier type = 2024-02-23T06:29:50.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.960+0000 7fe7a103a800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.976+0000 7fe7a103a800 20 add_watcher() i=0 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.976+0000 7fe7a103a800 20 add_watcher() i=1 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.976+0000 7fe7a103a800 20 add_watcher() i=2 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.976+0000 7fe7a103a800 20 add_watcher() i=3 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.976+0000 7fe7a103a800 20 add_watcher() i=4 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.976+0000 7fe7a103a800 20 add_watcher() i=5 2024-02-23T06:29:50.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.977+0000 7fe7a103a800 20 add_watcher() i=6 2024-02-23T06:29:50.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.977+0000 7fe7a103a800 20 add_watcher() i=7 2024-02-23T06:29:50.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.977+0000 7fe7a103a800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:50.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.979+0000 7fe6527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.979+0000 7fe7a103a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:50.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.979+0000 7fe7a103a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:50.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.979+0000 7fe7a103a800 5 note: GC not initialized 2024-02-23T06:29:50.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.979+0000 7fe6517e2640 20 reqs_thread_entry: start 2024-02-23T06:29:50.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.979+0000 7fe7a103a800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:50.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 Filter name: none 2024-02-23T06:29:50.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe5c2ffd640 20 reqs_thread_entry: start 2024-02-23T06:29:50.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:50.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 rados->read ofs=0 len=0 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 INFO: main: starting shard=0 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.980+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.981+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.981+0000 7fe7a103a800 20 INFO: main: starting shard=1 2024-02-23T06:29:50.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.981+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:50.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.981+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.981+0000 7fe7a103a800 20 INFO: main: starting shard=2 2024-02-23T06:29:50.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.981+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:50.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.982+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.982+0000 7fe7a103a800 20 INFO: main: starting shard=3 2024-02-23T06:29:50.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.982+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 INFO: main: starting shard=4 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 INFO: main: starting shard=5 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 INFO: main: starting shard=6 2024-02-23T06:29:50.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.983+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:50.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.984+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.984+0000 7fe7a103a800 20 INFO: main: starting shard=7 2024-02-23T06:29:50.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.984+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:50.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.984+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.984+0000 7fe7a103a800 20 INFO: main: starting shard=8 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.984+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.985+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.985+0000 7fe7a103a800 20 INFO: main: starting shard=9 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.985+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.985+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.985+0000 7fe7a103a800 20 INFO: main: starting shard=10 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.985+0000 7fe7a103a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.986+0000 7fe7a103a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:29:50.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.986+0000 7fe7a103a800 20 INFO: main: done 2024-02-23T06:29:50.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.986+0000 7fe6527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:50.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.988+0000 7fe7a103a800 20 remove_watcher() i=0 2024-02-23T06:29:50.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.988+0000 7fe7a103a800 2 removed watcher, disabling cache 2024-02-23T06:29:50.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.989+0000 7fe7a103a800 20 remove_watcher() i=1 2024-02-23T06:29:50.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.990+0000 7fe7a103a800 20 remove_watcher() i=2 2024-02-23T06:29:50.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.991+0000 7fe7a103a800 20 remove_watcher() i=3 2024-02-23T06:29:50.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.995+0000 7fe7a103a800 20 remove_watcher() i=4 2024-02-23T06:29:50.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.996+0000 7fe7a103a800 20 remove_watcher() i=5 2024-02-23T06:29:50.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.997+0000 7fe7a103a800 20 remove_watcher() i=6 2024-02-23T06:29:50.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:50.998+0000 7fe7a103a800 20 remove_watcher() i=7 2024-02-23T06:29:51.014 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-02-23T06:29:51.397 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-02-23T06:29:51.776 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check unlinked finds unlistable entries 2024-02-23T06:29:51.777 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:51.778 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-02-23T06:29:51.808 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:51.808 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:51.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.842+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 realm 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.843+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.844+0000 7fb38113c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:51.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.844+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.845+0000 7fb38113c800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:51.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.845+0000 7fb38113c800 20 searching for the correct realm 2024-02-23T06:29:51.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.848+0000 7fb37444a640 0 -- 172.21.15.142:0/1774575609 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x5648bb0e91d0 msgr2=0x5648bb0eb690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:51.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.851+0000 7fb37cc4b640 0 -- 172.21.15.142:0/1774575609 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb3640ca740 msgr2=0x7fb3640c73a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.855+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:51.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 zone default found 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 4 Realm: () 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 zonegroup default 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.856+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.857+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.857+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.857+0000 7fb38113c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:51.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.857+0000 7fb38113c800 20 started sync module instance, tier type = 2024-02-23T06:29:51.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.857+0000 7fb38113c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:51.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=0 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=1 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=2 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=3 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=4 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=5 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.868+0000 7fb38113c800 20 add_watcher() i=6 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.869+0000 7fb38113c800 20 add_watcher() i=7 2024-02-23T06:29:51.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.869+0000 7fb38113c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:51.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.871+0000 7fb232fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.871+0000 7fb38113c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.871+0000 7fb38113c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.871+0000 7fb38113c800 5 note: GC not initialized 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.871+0000 7fb231fe3640 20 reqs_thread_entry: start 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 Filter name: none 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb1a37fe640 20 reqs_thread_entry: start 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:51.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.872+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:51.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.873+0000 7fb38113c800 1 NOTICE: finished shard 0 (0 entries found) 2024-02-23T06:29:51.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.873+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:51.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.873+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:51.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.874+0000 7fb38113c800 1 NOTICE: finished shard 2 (0 entries found) 2024-02-23T06:29:51.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.874+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:51.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.874+0000 7fb38113c800 1 NOTICE: finished shard 3 (0 entries found) 2024-02-23T06:29:51.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.874+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:51.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.875+0000 7fb38113c800 1 NOTICE: finished shard 4 (0 entries found) 2024-02-23T06:29:51.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.875+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:51.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.875+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.875+0000 7fb38113c800 1 NOTICE: finished shard 6 (0 entries found) 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.875+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.876+0000 7fb38113c800 1 NOTICE: finished shard 7 (0 entries found) 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.876+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.876+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.877+0000 7fb38113c800 1 NOTICE: finished shard 9 (0 entries found) 2024-02-23T06:29:51.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.877+0000 7fb38113c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:51.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.877+0000 7fb38113c800 1 NOTICE: finished shard 1 (1 entries found) 2024-02-23T06:29:51.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.877+0000 7fb38113c800 1 NOTICE: finished shard 5 (1 entries found) 2024-02-23T06:29:51.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.877+0000 7fb38113c800 1 NOTICE: finished shard 8 (1 entries found) 2024-02-23T06:29:51.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.878+0000 7fb38113c800 1 NOTICE: finished shard 10 (1 entries found) 2024-02-23T06:29:51.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.878+0000 7fb38113c800 1 NOTICE: finished all shards (4 entries found) 2024-02-23T06:29:51.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.878+0000 7fb232fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:51.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.881+0000 7fb38113c800 20 remove_watcher() i=0 2024-02-23T06:29:51.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.881+0000 7fb38113c800 2 removed watcher, disabling cache 2024-02-23T06:29:51.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.882+0000 7fb38113c800 20 remove_watcher() i=1 2024-02-23T06:29:51.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.883+0000 7fb38113c800 20 remove_watcher() i=2 2024-02-23T06:29:51.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.884+0000 7fb38113c800 20 remove_watcher() i=3 2024-02-23T06:29:51.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.885+0000 7fb38113c800 20 remove_watcher() i=4 2024-02-23T06:29:51.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.886+0000 7fb38113c800 20 remove_watcher() i=5 2024-02-23T06:29:51.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.887+0000 7fb38113c800 20 remove_watcher() i=6 2024-02-23T06:29:51.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:51.888+0000 7fb38113c800 20 remove_watcher() i=7 2024-02-23T06:29:51.897 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: unlinked entries are not listable 2024-02-23T06:29:51.898 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:51.905 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-02-23T06:29:51.905 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:51.996 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-02-23T06:29:51.996 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:51.996 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-02-23T06:29:52.028 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:52.028 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:52.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.061+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.062+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.062+0000 7f26a922e800 20 realm 2024-02-23T06:29:52.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.062+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.063+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.063+0000 7f26a922e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:52.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.063+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.063+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.063+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.064+0000 7f26a922e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.064+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.064+0000 7f26a922e800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:52.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.064+0000 7f26a922e800 20 searching for the correct realm 2024-02-23T06:29:52.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.065+0000 7f26a4ba4640 0 -- 172.21.15.142:0/2060649864 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f268c04f040 msgr2=0x7f268c01b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:52.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.068+0000 7f26a4ba4640 0 -- 172.21.15.142:0/2060649864 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f26900030f0 msgr2=0x7f268c043820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:52.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.276+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 zone default found 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 4 Realm: () 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:52.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 zonegroup default 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.277+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 started sync module instance, tier type = 2024-02-23T06:29:52.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.278+0000 7f26a922e800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=0 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=1 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=2 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=3 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=4 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=5 2024-02-23T06:29:52.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.288+0000 7f26a922e800 20 add_watcher() i=6 2024-02-23T06:29:52.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.289+0000 7f26a922e800 20 add_watcher() i=7 2024-02-23T06:29:52.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.289+0000 7f26a922e800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:52.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.292+0000 7f255afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 5 note: GC not initialized 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f2559fdb640 20 reqs_thread_entry: start 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 20 Filter name: none 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f24cb7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.293+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:52.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:52.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:52.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:52.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:52.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:52.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.294+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.295+0000 7f26a922e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.295+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.295+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:52.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.296+0000 7f26a922e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-02-23T06:29:52.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.296+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:52.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.296+0000 7f26a922e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-02-23T06:29:52.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.296+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:52.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.297+0000 7f26a922e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-02-23T06:29:52.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.297+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.297+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:52.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.298+0000 7f26a922e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-02-23T06:29:52.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.298+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:52.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.298+0000 7f26a922e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-02-23T06:29:52.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.298+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.299+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:52.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.299+0000 7f26a922e800 1 NOTICE: finished shard 9 (0 entries removed) 2024-02-23T06:29:52.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.299+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.300+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.300+0000 7f26a922e800 20 get_obj_state: octx=0x56508c585400 obj=check-bucket:e state=0x56508c84f088 s->prefetch_data=0 2024-02-23T06:29:52.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.300+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.300+0000 7f26a922e800 20 get_obj_state: octx=0x56508c5acdd0 obj=check-bucket:d state=0x56508c84ba28 s->prefetch_data=0 2024-02-23T06:29:52.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.300+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state: octx=0x56508c853e70 obj=check-bucket:c state=0x56508c84c588 s->prefetch_data=0 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state: octx=0x56508c854870 obj=check-bucket:f state=0x56508c8e9558 s->prefetch_data=0 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 2gdpzfvtz93c68lh6c4s95osc8r9k0n9 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state_impl: setting s->olh_tag to e6rvjl5c1ajduj0vn7oxb9m6ntcqhfeo 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=e6rvjl5c1ajduj0vn7oxb9m6ntcqhfeo 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 9wsfbdzolk14623uk5s5gwzhndnnj3to 2024-02-23T06:29:52.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state_impl: setting s->olh_tag to mygtw16dhgrb973fih8m9m0v7zkbwwr6 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mygtw16dhgrb973fih8m9m0v7zkbwwr6 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to xpz0p3nb0ospams2fffazhxphc1gybjo 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state_impl: setting s->olh_tag to jf2btny2ecyaga9auujvr1d2y93g1nxf 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jf2btny2ecyaga9auujvr1d2y93g1nxf 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 4h7qds8t5lvkjffqkg9ahshu9v4b6hu5 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 get_obj_state_impl: setting s->olh_tag to 6izc24br96h4i8iwcy7d2rup60v0ouhj 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.301+0000 7f26a922e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6izc24br96h4i8iwcy7d2rup60v0ouhj 2024-02-23T06:29:52.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.303+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.304+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.304+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.304+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.304+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 olh_log_entry: epoch=2 op=3 key=e[GjbvGb.kviPg4.0cYBh6aVQ4B-CnD.E] 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 get_obj_state: octx=0x56508c585400 obj=check-bucket:_:GjbvGb.kviPg4.0cYBh6aVQ4B-CnD.E_e state=0x56508c905968 s->prefetch_data=0 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 10 manifest: total_size = 22 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5956509811195885674 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 get_obj_state: octx=0x56508c585400 obj=check-bucket:_:GjbvGb.kviPg4.0cYBh6aVQ4B-CnD.E_e state=0x56508c905968 s->prefetch_data=0 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 prepare_atomic_modification: state is not atomic. state=0x56508c905968 2024-02-23T06:29:52.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.305+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.306+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.306+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.306+0000 7f26a922e800 20 olh_log_entry: epoch=3 op=3 key=d[GFov17m9OxhVg9VLY8LsJ8uEEIkXyxQ] 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.306+0000 7f26a922e800 20 get_obj_state: octx=0x56508c5acdd0 obj=check-bucket:_:GFov17m9OxhVg9VLY8LsJ8uEEIkXyxQ_d state=0x56508c90bc88 s->prefetch_data=0 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.306+0000 7f26a922e800 20 olh_log_entry: epoch=3 op=3 key=c[cQsa8q0K5RmT3QidxgTUaolWILkIEZ-] 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.306+0000 7f26a922e800 20 get_obj_state: octx=0x56508c853e70 obj=check-bucket:_:cQsa8q0K5RmT3QidxgTUaolWILkIEZ-_c state=0x56508c911138 s->prefetch_data=0 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 10 manifest: total_size = 9 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11830166729166948531 2024-02-23T06:29:52.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: octx=0x56508c5acdd0 obj=check-bucket:_:GFov17m9OxhVg9VLY8LsJ8uEEIkXyxQ_d state=0x56508c90bc88 s->prefetch_data=0 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 prepare_atomic_modification: state is not atomic. state=0x56508c90bc88 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 10 manifest: total_size = 9 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12556264545581605301 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: octx=0x56508c853e70 obj=check-bucket:_:cQsa8q0K5RmT3QidxgTUaolWILkIEZ-_c state=0x56508c911138 s->prefetch_data=0 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 prepare_atomic_modification: state is not atomic. state=0x56508c911138 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 olh_log_entry: epoch=2 op=3 key=f[08w.WOFHN1FUYz4xx0uy0W64UUE1lUQ] 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: octx=0x56508c854870 obj=check-bucket:_:08w.WOFHN1FUYz4xx0uy0W64UUE1lUQ_f state=0x56508c91f628 s->prefetch_data=0 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 10 manifest: total_size = 9 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18288762045372451088 2024-02-23T06:29:52.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 get_obj_state: octx=0x56508c854870 obj=check-bucket:_:08w.WOFHN1FUYz4xx0uy0W64UUE1lUQ_f state=0x56508c91f628 s->prefetch_data=0 2024-02-23T06:29:52.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.307+0000 7f26a922e800 20 prepare_atomic_modification: state is not atomic. state=0x56508c91f628 2024-02-23T06:29:52.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.308+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.309+0000 7f26a922e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:52.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.309+0000 7f26a922e800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-02-23T06:29:52.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.309+0000 7f26a922e800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:52.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.309+0000 7f26a922e800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:GjbvGb.kviPg4.0cYBh6aVQ4B-CnD.E_.FBnhARiUNxyW1eAR2rFu-gjlagBIqwe_0 2024-02-23T06:29:52.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.312+0000 7f26a922e800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:52.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.312+0000 7f26a922e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:52.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.312+0000 7f26a922e800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-02-23T06:29:52.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.312+0000 7f26a922e800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:52.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.312+0000 7f26a922e800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:cQsa8q0K5RmT3QidxgTUaolWILkIEZ-_.pPmZGJe2JFX-Z0vdzjJ3u_GT9y_c9yz_0 2024-02-23T06:29:52.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.313+0000 7f257b7fe640 20 handle_completion(): completion ok for obj=e[GjbvGb.kviPg4.0cYBh6aVQ4B-CnD.E] 2024-02-23T06:29:52.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.316+0000 7f257affd640 20 handle_completion(): completion ok for obj=c[cQsa8q0K5RmT3QidxgTUaolWILkIEZ-] 2024-02-23T06:29:52.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.316+0000 7f26a922e800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:52.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.316+0000 7f26a922e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:52.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.316+0000 7f26a922e800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-02-23T06:29:52.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.316+0000 7f26a922e800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:52.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.316+0000 7f26a922e800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:GFov17m9OxhVg9VLY8LsJ8uEEIkXyxQ_.owSvCX4P8d-zclSUXkQMS5VRCqL-taj_0 2024-02-23T06:29:52.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.318+0000 7f26a922e800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:52.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.318+0000 7f26a922e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:52.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.318+0000 7f26a922e800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-02-23T06:29:52.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.318+0000 7f26a922e800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:52.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.318+0000 7f26a922e800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:08w.WOFHN1FUYz4xx0uy0W64UUE1lUQ_.ceU_iEktwByvb0ZpQnaQd0JRGn4IlqI_0 2024-02-23T06:29:52.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.319+0000 7f257b7fe640 20 handle_completion(): completion ok for obj=d[GFov17m9OxhVg9VLY8LsJ8uEEIkXyxQ] 2024-02-23T06:29:52.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.322+0000 7f257affd640 20 handle_completion(): completion ok for obj=f[08w.WOFHN1FUYz4xx0uy0W64UUE1lUQ] 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 20 get_obj_state: octx=0x56508c585400 obj=check-bucket:e state=0x56508c84f088 s->prefetch_data=0 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=e6rvjl5c1ajduj0vn7oxb9m6ntcqhfeo 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.324+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.327+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.327+0000 7f26a922e800 1 NOTICE: finished shard 8 (1 entries removed) 2024-02-23T06:29:52.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.327+0000 7f26a922e800 20 get_obj_state: octx=0x56508c854870 obj=check-bucket:f state=0x56508c8e9558 s->prefetch_data=0 2024-02-23T06:29:52.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.327+0000 7f26a922e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6izc24br96h4i8iwcy7d2rup60v0ouhj 2024-02-23T06:29:52.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.330+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.330+0000 7f26a922e800 1 NOTICE: finished shard 5 (1 entries removed) 2024-02-23T06:29:52.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.334+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.339+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.339+0000 7f26a922e800 1 NOTICE: finished shard 1 (1 entries removed) 2024-02-23T06:29:52.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.339+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.340+0000 7f26a922e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.340+0000 7f26a922e800 1 NOTICE: finished shard 10 (1 entries removed) 2024-02-23T06:29:52.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.340+0000 7f26a922e800 1 NOTICE: finished all shards (4 entries removed) 2024-02-23T06:29:52.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.341+0000 7f255afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:52.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.343+0000 7f26a922e800 20 remove_watcher() i=0 2024-02-23T06:29:52.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.343+0000 7f26a922e800 2 removed watcher, disabling cache 2024-02-23T06:29:52.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.344+0000 7f26a922e800 20 remove_watcher() i=1 2024-02-23T06:29:52.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.347+0000 7f26a922e800 20 remove_watcher() i=2 2024-02-23T06:29:52.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.348+0000 7f26a922e800 20 remove_watcher() i=3 2024-02-23T06:29:52.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.349+0000 7f26a922e800 20 remove_watcher() i=4 2024-02-23T06:29:52.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.350+0000 7f26a922e800 20 remove_watcher() i=5 2024-02-23T06:29:52.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.351+0000 7f26a922e800 20 remove_watcher() i=6 2024-02-23T06:29:52.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.352+0000 7f26a922e800 20 remove_watcher() i=7 2024-02-23T06:29:52.373 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check unlinked does not affect normal entries 2024-02-23T06:29:52.373 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:52.429 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-02-23T06:29:52.429 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:52.430 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-02-23T06:29:52.461 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:52.461 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:52.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.494+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 realm 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.495+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.496+0000 7f8a8449d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.496+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.497+0000 7f8a8449d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.497+0000 7f8a8449d800 20 searching for the correct realm 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.500+0000 7f8a82550640 0 -- 172.21.15.142:0/3839714438 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x561e8d8a6e90 msgr2=0x561e8d8a9350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.503+0000 7f8a81d4f640 0 -- 172.21.15.142:0/3839714438 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f8a6c088610 msgr2=0x7f8a6c070130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.507+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 zone default found 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 4 Realm: () 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 zonegroup default 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.508+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.509+0000 7f8a8449d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.509+0000 7f8a8449d800 20 started sync module instance, tier type = 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.509+0000 7f8a8449d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=0 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=1 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=2 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=3 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=4 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=5 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.520+0000 7f8a8449d800 20 add_watcher() i=6 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.523+0000 7f8a8449d800 20 add_watcher() i=7 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.523+0000 7f8a8449d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.524+0000 7f89337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:52.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.524+0000 7f8a8449d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.524+0000 7f8a8449d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 5 note: GC not initialized 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f89327fc640 20 reqs_thread_entry: start 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 20 Filter name: none 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f88a3fff640 20 reqs_thread_entry: start 2024-02-23T06:29:52.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.525+0000 7f8a8449d800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:52.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 1 NOTICE: finished shard 0 (0 entries found) 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.526+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.527+0000 7f8a8449d800 1 NOTICE: finished shard 1 (0 entries found) 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.527+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.527+0000 7f8a8449d800 1 NOTICE: finished shard 2 (0 entries found) 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.527+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.528+0000 7f8a8449d800 1 NOTICE: finished shard 3 (0 entries found) 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.528+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.528+0000 7f8a8449d800 1 NOTICE: finished shard 4 (0 entries found) 2024-02-23T06:29:52.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.528+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.528+0000 7f8a8449d800 1 NOTICE: finished shard 5 (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.528+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.529+0000 7f8a8449d800 1 NOTICE: finished shard 6 (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.529+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.529+0000 7f8a8449d800 1 NOTICE: finished shard 7 (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.529+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.530+0000 7f8a8449d800 1 NOTICE: finished shard 8 (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.530+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.530+0000 7f8a8449d800 1 NOTICE: finished shard 9 (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.530+0000 7f8a8449d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.530+0000 7f8a8449d800 1 NOTICE: finished shard 10 (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.531+0000 7f8a8449d800 1 NOTICE: finished all shards (0 entries found) 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.531+0000 7f89337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:52.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.533+0000 7f8a8449d800 20 remove_watcher() i=0 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.533+0000 7f8a8449d800 2 removed watcher, disabling cache 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.535+0000 7f8a8449d800 20 remove_watcher() i=1 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.538+0000 7f8a8449d800 20 remove_watcher() i=2 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.539+0000 7f8a8449d800 20 remove_watcher() i=3 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.540+0000 7f8a8449d800 20 remove_watcher() i=4 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.541+0000 7f8a8449d800 20 remove_watcher() i=5 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.542+0000 7f8a8449d800 20 remove_watcher() i=6 2024-02-23T06:29:52.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.543+0000 7f8a8449d800 20 remove_watcher() i=7 2024-02-23T06:29:52.592 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-02-23T06:29:52.623 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:52.624 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:52.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.656+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.657+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.657+0000 7fc890511800 20 realm 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.657+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.657+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.657+0000 7fc890511800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.657+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.658+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.658+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.658+0000 7fc890511800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.658+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.659+0000 7fc890511800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:52.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.659+0000 7fc890511800 20 searching for the correct realm 2024-02-23T06:29:52.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.662+0000 7fc88e5a4640 0 -- 172.21.15.142:0/1344062250 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fc884061440 msgr2=0x7fc884058080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:52.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.666+0000 7fc88dda3640 0 -- 172.21.15.142:0/1344062250 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fc884057780 msgr2=0x7fc8840176f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.872+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 zone default found 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 4 Realm: () 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 zonegroup default 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.873+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.874+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.874+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.874+0000 7fc890511800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.874+0000 7fc890511800 20 started sync module instance, tier type = 2024-02-23T06:29:52.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.874+0000 7fc890511800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=0 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=1 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=2 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=3 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=4 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=5 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.884+0000 7fc890511800 20 add_watcher() i=6 2024-02-23T06:29:52.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.885+0000 7fc890511800 20 add_watcher() i=7 2024-02-23T06:29:52.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.885+0000 7fc890511800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:52.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.888+0000 7fc73f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:52.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.888+0000 7fc890511800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:52.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.888+0000 7fc890511800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.888+0000 7fc890511800 5 note: GC not initialized 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc73e7fc640 20 reqs_thread_entry: start 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc890511800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc890511800 20 Filter name: none 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc6b3fff640 20 reqs_thread_entry: start 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc890511800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:52.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.889+0000 7fc890511800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:52.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:52.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:52.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 INFO: main: starting shard=0 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 INFO: main: starting shard=1 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.890+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 INFO: main: starting shard=2 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 INFO: main: starting shard=3 2024-02-23T06:29:52.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 INFO: main: starting shard=4 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.891+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.892+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.892+0000 7fc890511800 20 INFO: main: starting shard=5 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.892+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.892+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.892+0000 7fc890511800 20 INFO: main: starting shard=6 2024-02-23T06:29:52.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.892+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:52.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.893+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.893+0000 7fc890511800 20 INFO: main: starting shard=7 2024-02-23T06:29:52.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.893+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:52.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.893+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.893+0000 7fc890511800 20 INFO: main: starting shard=8 2024-02-23T06:29:52.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.893+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.894+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.894+0000 7fc890511800 20 INFO: main: starting shard=9 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.894+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.894+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.894+0000 7fc890511800 20 INFO: main: starting shard=10 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.894+0000 7fc890511800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:52.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.895+0000 7fc890511800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:52.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.895+0000 7fc890511800 20 INFO: main: done 2024-02-23T06:29:52.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.896+0000 7fc73f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:52.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.898+0000 7fc890511800 20 remove_watcher() i=0 2024-02-23T06:29:52.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.898+0000 7fc890511800 2 removed watcher, disabling cache 2024-02-23T06:29:52.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.900+0000 7fc890511800 20 remove_watcher() i=1 2024-02-23T06:29:52.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.902+0000 7fc890511800 20 remove_watcher() i=2 2024-02-23T06:29:52.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.904+0000 7fc890511800 20 remove_watcher() i=3 2024-02-23T06:29:52.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.905+0000 7fc890511800 20 remove_watcher() i=4 2024-02-23T06:29:52.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.906+0000 7fc890511800 20 remove_watcher() i=5 2024-02-23T06:29:52.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.907+0000 7fc890511800 20 remove_watcher() i=6 2024-02-23T06:29:52.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.908+0000 7fc890511800 20 remove_watcher() i=7 2024-02-23T06:29:52.920 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-02-23T06:29:52.949 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:52.949 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:52.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.981+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 realm 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:52.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.983+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.984+0000 7fb434d31800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:52.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.984+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:52.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.984+0000 7fb434d31800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:52.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.984+0000 7fb434d31800 20 searching for the correct realm 2024-02-23T06:29:52.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.987+0000 7fb427fa2640 0 -- 172.21.15.142:0/2555587715 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fb420081060 msgr2=0x7fb4200d2aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:52.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:52.990+0000 7fb4307a3640 0 -- 172.21.15.142:0/2555587715 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb418008930 msgr2=0x7fb418057410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.196+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 20 zone default found 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 4 Realm: () 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 20 zonegroup default 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.197+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 started sync module instance, tier type = 2024-02-23T06:29:53.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.198+0000 7fb434d31800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=0 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=1 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=2 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=3 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=4 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=5 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.218+0000 7fb434d31800 20 add_watcher() i=6 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.219+0000 7fb434d31800 20 add_watcher() i=7 2024-02-23T06:29:53.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.219+0000 7fb434d31800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:53.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.220+0000 7fb2e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb434d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb434d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb434d31800 5 note: GC not initialized 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb2e5fdb640 20 reqs_thread_entry: start 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb434d31800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb434d31800 20 Filter name: none 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb2577fe640 20 reqs_thread_entry: start 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.221+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:53.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:53.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 INFO: main: starting shard=0 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 INFO: main: starting shard=1 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.222+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.223+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.223+0000 7fb434d31800 20 INFO: main: starting shard=2 2024-02-23T06:29:53.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.223+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.224+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.224+0000 7fb434d31800 20 INFO: main: starting shard=3 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.224+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.224+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.224+0000 7fb434d31800 20 INFO: main: starting shard=4 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.224+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 INFO: main: starting shard=5 2024-02-23T06:29:53.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:53.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 INFO: main: starting shard=6 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 INFO: main: starting shard=7 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.225+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.226+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.226+0000 7fb434d31800 20 INFO: main: starting shard=8 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.226+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.226+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.226+0000 7fb434d31800 20 INFO: main: starting shard=9 2024-02-23T06:29:53.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.226+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:53.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.227+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.227+0000 7fb434d31800 20 INFO: main: starting shard=10 2024-02-23T06:29:53.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.227+0000 7fb434d31800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:53.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.227+0000 7fb434d31800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:53.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.227+0000 7fb434d31800 20 INFO: main: done 2024-02-23T06:29:53.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.228+0000 7fb2e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:53.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.230+0000 7fb434d31800 20 remove_watcher() i=0 2024-02-23T06:29:53.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.230+0000 7fb434d31800 2 removed watcher, disabling cache 2024-02-23T06:29:53.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.231+0000 7fb434d31800 20 remove_watcher() i=1 2024-02-23T06:29:53.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.232+0000 7fb434d31800 20 remove_watcher() i=2 2024-02-23T06:29:53.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.233+0000 7fb434d31800 20 remove_watcher() i=3 2024-02-23T06:29:53.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.234+0000 7fb434d31800 20 remove_watcher() i=4 2024-02-23T06:29:53.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.235+0000 7fb434d31800 20 remove_watcher() i=5 2024-02-23T06:29:53.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.238+0000 7fb434d31800 20 remove_watcher() i=6 2024-02-23T06:29:53.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.239+0000 7fb434d31800 20 remove_watcher() i=7 2024-02-23T06:29:53.249 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check olh finds leftover OLH entries 2024-02-23T06:29:53.249 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:53.250 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-02-23T06:29:53.280 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:53.280 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:53.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.312+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.313+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.313+0000 7febc474b800 20 realm 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.313+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.313+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.313+0000 7febc474b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.313+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.314+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.314+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.314+0000 7febc474b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:53.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.314+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.315+0000 7febc474b800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:53.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.315+0000 7febc474b800 20 searching for the correct realm 2024-02-23T06:29:53.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.318+0000 7febc284c640 0 -- 172.21.15.142:0/2452790776 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7febac01a040 msgr2=0x7febac038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:53.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.321+0000 7febc204b640 0 -- 172.21.15.142:0/2452790776 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7febac017400 msgr2=0x7febac017880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:53.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:53.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.526+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 zone default found 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 4 Realm: () 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:53.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 zonegroup default 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.527+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.528+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.528+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.528+0000 7febc474b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.528+0000 7febc474b800 20 started sync module instance, tier type = 2024-02-23T06:29:53.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.528+0000 7febc474b800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=0 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=1 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=2 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=3 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=4 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=5 2024-02-23T06:29:53.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.540+0000 7febc474b800 20 add_watcher() i=6 2024-02-23T06:29:53.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.541+0000 7febc474b800 20 add_watcher() i=7 2024-02-23T06:29:53.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.541+0000 7febc474b800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7fea78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7febc474b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7febc474b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7febc474b800 5 note: GC not initialized 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7fe9f37fe640 20 reqs_thread_entry: start 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7febc474b800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:53.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7febc474b800 20 Filter name: none 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.543+0000 7fe9f17fa640 20 reqs_thread_entry: start 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:53.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.544+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.545+0000 7febc474b800 1 NOTICE: finished shard 0 (0 entries found) 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.545+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.546+0000 7febc474b800 1 NOTICE: finished shard 1 (0 entries found) 2024-02-23T06:29:53.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.546+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:53.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.546+0000 7febc474b800 1 NOTICE: finished shard 2 (0 entries found) 2024-02-23T06:29:53.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.546+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:53.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.546+0000 7febc474b800 1 NOTICE: finished shard 3 (0 entries found) 2024-02-23T06:29:53.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.546+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:53.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.547+0000 7febc474b800 1 NOTICE: finished shard 4 (0 entries found) 2024-02-23T06:29:53.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.547+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.547+0000 7febc474b800 1 NOTICE: finished shard 5 (1 entries found) 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.547+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.548+0000 7febc474b800 1 NOTICE: finished shard 6 (0 entries found) 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.548+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.548+0000 7febc474b800 1 NOTICE: finished shard 7 (0 entries found) 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.548+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.549+0000 7febc474b800 1 NOTICE: finished shard 8 (1 entries found) 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.549+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:53.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.549+0000 7febc474b800 1 NOTICE: finished shard 9 (0 entries found) 2024-02-23T06:29:53.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.549+0000 7febc474b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:53.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.550+0000 7febc474b800 1 NOTICE: finished shard 10 (0 entries found) 2024-02-23T06:29:53.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.550+0000 7febc474b800 1 NOTICE: finished all shards (2 entries found) 2024-02-23T06:29:53.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.551+0000 7fea78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:53.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.553+0000 7febc474b800 20 remove_watcher() i=0 2024-02-23T06:29:53.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.553+0000 7febc474b800 2 removed watcher, disabling cache 2024-02-23T06:29:53.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.567+0000 7febc474b800 20 remove_watcher() i=1 2024-02-23T06:29:53.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.568+0000 7febc474b800 20 remove_watcher() i=2 2024-02-23T06:29:53.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.569+0000 7febc474b800 20 remove_watcher() i=3 2024-02-23T06:29:53.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.570+0000 7febc474b800 20 remove_watcher() i=4 2024-02-23T06:29:53.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.571+0000 7febc474b800 20 remove_watcher() i=5 2024-02-23T06:29:53.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.573+0000 7febc474b800 20 remove_watcher() i=6 2024-02-23T06:29:53.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.574+0000 7febc474b800 20 remove_watcher() i=7 2024-02-23T06:29:53.584 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-02-23T06:29:53.584 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:53.586 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-02-23T06:29:53.617 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:53.617 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:53.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.650+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 realm 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:53.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.651+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.652+0000 7fe716c24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:53.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.652+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:53.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.652+0000 7fe716c24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:53.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.652+0000 7fe716c24800 20 searching for the correct realm 2024-02-23T06:29:53.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.655+0000 7fe70bc4a640 0 -- 172.21.15.142:0/3770099557 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fe704076270 msgr2=0x7fe70406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:53.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:53.860+0000 7fe71444b640 0 -- 172.21.15.142:0/3770099557 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fe6fc0a8210 msgr2=0x7fe6fc0a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:54.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:54.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:54.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:54.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.066+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 zone default found 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 4 Realm: () 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:54.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 zonegroup default 2024-02-23T06:29:54.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 started sync module instance, tier type = 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.067+0000 7fe716c24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=0 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=1 2024-02-23T06:29:54.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=2 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=3 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=4 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=5 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.085+0000 7fe716c24800 20 add_watcher() i=6 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.088+0000 7fe716c24800 20 add_watcher() i=7 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.088+0000 7fe716c24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.090+0000 7fe5cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.090+0000 7fe716c24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.090+0000 7fe716c24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.090+0000 7fe716c24800 5 note: GC not initialized 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.090+0000 7fe5c9fdb640 20 reqs_thread_entry: start 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.090+0000 7fe716c24800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 20 Filter name: none 2024-02-23T06:29:54.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe53b7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:54.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.091+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.092+0000 7fe716c24800 1 NOTICE: finished shard 0 (0 entries removed) 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.092+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.093+0000 7fe716c24800 1 NOTICE: finished shard 1 (0 entries removed) 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.093+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.093+0000 7fe716c24800 1 NOTICE: finished shard 2 (0 entries removed) 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.093+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.093+0000 7fe716c24800 1 NOTICE: finished shard 3 (0 entries removed) 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.093+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.094+0000 7fe716c24800 1 NOTICE: finished shard 4 (0 entries removed) 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.094+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.094+0000 7fe716c24800 20 get_obj_state: octx=0x56386dbc43e0 obj=check-bucket:d state=0x56386de8a1e8 s->prefetch_data=0 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.095+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.095+0000 7fe716c24800 1 NOTICE: finished shard 6 (0 entries removed) 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.095+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:54.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.095+0000 7fe716c24800 1 NOTICE: finished shard 7 (0 entries removed) 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.095+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.096+0000 7fe716c24800 20 get_obj_state: octx=0x56386dbebdb0 obj=check-bucket:c state=0x56386de8ad48 s->prefetch_data=0 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.096+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.096+0000 7fe716c24800 1 NOTICE: finished shard 9 (0 entries removed) 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.096+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 1 NOTICE: finished shard 10 (0 entries removed) 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 get_obj_state: setting s->obj_tag to 9wsfbdzolk14623uk5s5gwzhndnnj3to 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 get_obj_state_impl: setting s->olh_tag to mygtw16dhgrb973fih8m9m0v7zkbwwr6 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 get_obj_state: setting s->obj_tag to xpz0p3nb0ospams2fffazhxphc1gybjo 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 get_obj_state_impl: setting s->olh_tag to jf2btny2ecyaga9auujvr1d2y93g1nxf 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 olh_log_entry: epoch=4 op=3 key=d[0JVXXIN-BcTqwhFz2zAJwfyGu10uRGy] 2024-02-23T06:29:54.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 get_obj_state: octx=0x56386dec8cb0 obj=check-bucket:_:0JVXXIN-BcTqwhFz2zAJwfyGu10uRGy_d state=0x56386def04e8 s->prefetch_data=0 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 olh_log_entry: epoch=4 op=3 key=c[ftVGA.FKT1wzZyZ4.lzNrOaAaJZouv8] 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.097+0000 7fe716c24800 20 get_obj_state: octx=0x56386dee8cb0 obj=check-bucket:_:ftVGA.FKT1wzZyZ4.lzNrOaAaJZouv8_c state=0x56386def6098 s->prefetch_data=0 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 get_obj_state: octx=0x56386dec8cb0 obj=check-bucket:d state=0x56386deeb498 s->prefetch_data=0 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 get_obj_state: octx=0x56386dee8cb0 obj=check-bucket:c state=0x56386dee9478 s->prefetch_data=0 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 get_obj_state: setting s->obj_tag to 9wsfbdzolk14623uk5s5gwzhndnnj3to 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 get_obj_state_impl: setting s->olh_tag to mygtw16dhgrb973fih8m9m0v7zkbwwr6 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mygtw16dhgrb973fih8m9m0v7zkbwwr6 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 get_obj_state: setting s->obj_tag to xpz0p3nb0ospams2fffazhxphc1gybjo 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 get_obj_state_impl: setting s->olh_tag to jf2btny2ecyaga9auujvr1d2y93g1nxf 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.099+0000 7fe716c24800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jf2btny2ecyaga9auujvr1d2y93g1nxf 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.114+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.114+0000 7fe716c24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:54.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.115+0000 7fe716c24800 1 NOTICE: finished shard 5 (1 entries removed) 2024-02-23T06:29:54.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.120+0000 7fe716c24800 1 NOTICE: finished shard 8 (1 entries removed) 2024-02-23T06:29:54.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.120+0000 7fe716c24800 1 NOTICE: finished all shards (2 entries removed) 2024-02-23T06:29:54.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.120+0000 7fe5cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.123+0000 7fe716c24800 20 remove_watcher() i=0 2024-02-23T06:29:54.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.123+0000 7fe716c24800 2 removed watcher, disabling cache 2024-02-23T06:29:54.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.124+0000 7fe716c24800 20 remove_watcher() i=1 2024-02-23T06:29:54.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.125+0000 7fe716c24800 20 remove_watcher() i=2 2024-02-23T06:29:54.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.126+0000 7fe716c24800 20 remove_watcher() i=3 2024-02-23T06:29:54.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.127+0000 7fe716c24800 20 remove_watcher() i=4 2024-02-23T06:29:54.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.128+0000 7fe716c24800 20 remove_watcher() i=5 2024-02-23T06:29:54.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.129+0000 7fe716c24800 20 remove_watcher() i=6 2024-02-23T06:29:54.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.130+0000 7fe716c24800 20 remove_watcher() i=7 2024-02-23T06:29:54.142 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-02-23T06:29:54.170 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:54.171 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:54.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.203+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 realm 2024-02-23T06:29:54.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:54.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.205+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.206+0000 7f3fd5a8c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.206+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.206+0000 7f3fd5a8c800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:54.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.206+0000 7f3fd5a8c800 20 searching for the correct realm 2024-02-23T06:29:54.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.209+0000 7f3fd2b4e640 0 -- 172.21.15.142:0/173066865 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f3fc4054bf0 msgr2=0x7f3fc409cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:54.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.212+0000 7f3fd334f640 0 -- 172.21.15.142:0/173066865 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f3fbc0037e0 msgr2=0x7f3fbc038030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:54.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.418+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 zone default found 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 4 Realm: () 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 zonegroup default 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.419+0000 7f3fd5a8c800 20 started sync module instance, tier type = 2024-02-23T06:29:54.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.420+0000 7f3fd5a8c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:54.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=0 2024-02-23T06:29:54.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=1 2024-02-23T06:29:54.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=2 2024-02-23T06:29:54.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=3 2024-02-23T06:29:54.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=4 2024-02-23T06:29:54.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=5 2024-02-23T06:29:54.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.436+0000 7f3fd5a8c800 20 add_watcher() i=6 2024-02-23T06:29:54.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.439+0000 7f3fd5a8c800 20 add_watcher() i=7 2024-02-23T06:29:54.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.439+0000 7f3fd5a8c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:54.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.441+0000 7f3e89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3fd5a8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3fd5a8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3fd5a8c800 5 note: GC not initialized 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3e88fe1640 20 reqs_thread_entry: start 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3fd5a8c800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3fd5a8c800 20 Filter name: none 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3e027fc640 20 reqs_thread_entry: start 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.442+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:54.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 INFO: main: starting shard=0 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.443+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.444+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.444+0000 7f3fd5a8c800 20 INFO: main: starting shard=1 2024-02-23T06:29:54.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.444+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:54.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.444+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.444+0000 7f3fd5a8c800 20 INFO: main: starting shard=2 2024-02-23T06:29:54.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.444+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:54.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.445+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.445+0000 7f3fd5a8c800 20 INFO: main: starting shard=3 2024-02-23T06:29:54.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.445+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:54.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.445+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.445+0000 7f3fd5a8c800 20 INFO: main: starting shard=4 2024-02-23T06:29:54.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.445+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:54.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.446+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.446+0000 7f3fd5a8c800 20 INFO: main: starting shard=5 2024-02-23T06:29:54.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.446+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.446+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.446+0000 7f3fd5a8c800 20 INFO: main: starting shard=6 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.446+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.447+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.447+0000 7f3fd5a8c800 20 INFO: main: starting shard=7 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.447+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.447+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.447+0000 7f3fd5a8c800 20 INFO: main: starting shard=8 2024-02-23T06:29:54.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.447+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.448+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.448+0000 7f3fd5a8c800 20 INFO: main: starting shard=9 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.448+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.448+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.448+0000 7f3fd5a8c800 20 INFO: main: starting shard=10 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.448+0000 7f3fd5a8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.449+0000 7f3fd5a8c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.449+0000 7f3fd5a8c800 20 INFO: main: done 2024-02-23T06:29:54.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.449+0000 7f3e89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.452+0000 7f3fd5a8c800 20 remove_watcher() i=0 2024-02-23T06:29:54.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.452+0000 7f3fd5a8c800 2 removed watcher, disabling cache 2024-02-23T06:29:54.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.453+0000 7f3fd5a8c800 20 remove_watcher() i=1 2024-02-23T06:29:54.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.454+0000 7f3fd5a8c800 20 remove_watcher() i=2 2024-02-23T06:29:54.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.456+0000 7f3fd5a8c800 20 remove_watcher() i=3 2024-02-23T06:29:54.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.458+0000 7f3fd5a8c800 20 remove_watcher() i=4 2024-02-23T06:29:54.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.459+0000 7f3fd5a8c800 20 remove_watcher() i=5 2024-02-23T06:29:54.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.460+0000 7f3fd5a8c800 20 remove_watcher() i=6 2024-02-23T06:29:54.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.461+0000 7f3fd5a8c800 20 remove_watcher() i=7 2024-02-23T06:29:54.473 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-02-23T06:29:54.502 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:54.502 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:54.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.535+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 realm 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.537+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.538+0000 7fa1ec34b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.538+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.538+0000 7fa1ec34b800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:54.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.538+0000 7fa1ec34b800 20 searching for the correct realm 2024-02-23T06:29:54.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.540+0000 7fa1e9c4b640 0 -- 172.21.15.142:0/3502545520 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7fa1d8003b20 msgr2=0x7fa1e405b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:54.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.745+0000 7fa1ea44c640 0 -- 172.21.15.142:0/3502545520 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fa1d80030f0 msgr2=0x7fa1d4057350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:54.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:54.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:54.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:54.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.750+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:54.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 zone default found 2024-02-23T06:29:54.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 4 Realm: () 2024-02-23T06:29:54.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:54.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 zonegroup default 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.751+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.752+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.752+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.752+0000 7fa1ec34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.752+0000 7fa1ec34b800 20 started sync module instance, tier type = 2024-02-23T06:29:54.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.752+0000 7fa1ec34b800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:54.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=0 2024-02-23T06:29:54.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=1 2024-02-23T06:29:54.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=2 2024-02-23T06:29:54.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=3 2024-02-23T06:29:54.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=4 2024-02-23T06:29:54.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=5 2024-02-23T06:29:54.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.768+0000 7fa1ec34b800 20 add_watcher() i=6 2024-02-23T06:29:54.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.770+0000 7fa1ec34b800 20 add_watcher() i=7 2024-02-23T06:29:54.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.770+0000 7fa1ec34b800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:54.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.772+0000 7fa09b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.772+0000 7fa1ec34b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.772+0000 7fa1ec34b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa1ec34b800 5 note: GC not initialized 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa09a7fc640 20 reqs_thread_entry: start 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa1ec34b800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa1ec34b800 20 Filter name: none 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa00bfff640 20 reqs_thread_entry: start 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa1ec34b800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:54.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.773+0000 7fa1ec34b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 INFO: main: starting shard=0 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 INFO: main: starting shard=1 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.774+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.775+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.775+0000 7fa1ec34b800 20 INFO: main: starting shard=2 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.775+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:54.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.775+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.775+0000 7fa1ec34b800 20 INFO: main: starting shard=3 2024-02-23T06:29:54.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.775+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 INFO: main: starting shard=4 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 INFO: main: starting shard=5 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 INFO: main: starting shard=6 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.776+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:54.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.777+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.777+0000 7fa1ec34b800 20 INFO: main: starting shard=7 2024-02-23T06:29:54.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.777+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:54.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.777+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.777+0000 7fa1ec34b800 20 INFO: main: starting shard=8 2024-02-23T06:29:54.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.777+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.778+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.778+0000 7fa1ec34b800 20 INFO: main: starting shard=9 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.778+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.778+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.778+0000 7fa1ec34b800 20 INFO: main: starting shard=10 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.778+0000 7fa1ec34b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.779+0000 7fa1ec34b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.779+0000 7fa1ec34b800 20 INFO: main: done 2024-02-23T06:29:54.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.779+0000 7fa09b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.782+0000 7fa1ec34b800 20 remove_watcher() i=0 2024-02-23T06:29:54.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.782+0000 7fa1ec34b800 2 removed watcher, disabling cache 2024-02-23T06:29:54.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.783+0000 7fa1ec34b800 20 remove_watcher() i=1 2024-02-23T06:29:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.784+0000 7fa1ec34b800 20 remove_watcher() i=2 2024-02-23T06:29:54.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.785+0000 7fa1ec34b800 20 remove_watcher() i=3 2024-02-23T06:29:54.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.786+0000 7fa1ec34b800 20 remove_watcher() i=4 2024-02-23T06:29:54.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.787+0000 7fa1ec34b800 20 remove_watcher() i=5 2024-02-23T06:29:54.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.788+0000 7fa1ec34b800 20 remove_watcher() i=6 2024-02-23T06:29:54.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.789+0000 7fa1ec34b800 20 remove_watcher() i=7 2024-02-23T06:29:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-02-23T06:29:54.800 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-02-23T06:29:54.829 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:54.829 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:54.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.862+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.863+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.863+0000 7fad28b33800 20 realm 2024-02-23T06:29:54.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.863+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.863+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.863+0000 7fad28b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:54.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.863+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.864+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.864+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.864+0000 7fad28b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.864+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.865+0000 7fad28b33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:54.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.865+0000 7fad28b33800 20 searching for the correct realm 2024-02-23T06:29:54.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.868+0000 7fad23da2640 0 -- 172.21.15.142:0/660034924 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x55d7067cb9a0 msgr2=0x55d7067cde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:54.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.871+0000 7fad245a3640 0 -- 172.21.15.142:0/660034924 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fad180d1b90 msgr2=0x7fad180ca5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:54.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:54.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:54.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:54.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:54.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:54.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:54.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.875+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:54.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 zone default found 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 4 Realm: () 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 zonegroup default 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.876+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.877+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.877+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.877+0000 7fad28b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:54.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.877+0000 7fad28b33800 20 started sync module instance, tier type = 2024-02-23T06:29:54.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.877+0000 7fad28b33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.891+0000 7fad28b33800 20 add_watcher() i=0 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.891+0000 7fad28b33800 20 add_watcher() i=1 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.891+0000 7fad28b33800 20 add_watcher() i=2 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.891+0000 7fad28b33800 20 add_watcher() i=3 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.891+0000 7fad28b33800 20 add_watcher() i=4 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.892+0000 7fad28b33800 20 add_watcher() i=5 2024-02-23T06:29:54.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.892+0000 7fad28b33800 20 add_watcher() i=6 2024-02-23T06:29:54.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.893+0000 7fad28b33800 20 add_watcher() i=7 2024-02-23T06:29:54.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.893+0000 7fad28b33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:54.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.896+0000 7fabdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.896+0000 7fad28b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.896+0000 7fad28b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.896+0000 7fad28b33800 5 note: GC not initialized 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.896+0000 7fabd9fdb640 20 reqs_thread_entry: start 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 20 Filter name: none 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fab4b7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:54.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:54.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:54.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:54.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.897+0000 7fad28b33800 20 rados->read ofs=0 len=0 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 1 NOTICE: finished shard 0 (0 entries found) 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.898+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.899+0000 7fad28b33800 1 NOTICE: finished shard 1 (0 entries found) 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.899+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.899+0000 7fad28b33800 1 NOTICE: finished shard 2 (0 entries found) 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.899+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.900+0000 7fad28b33800 1 NOTICE: finished shard 3 (0 entries found) 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.900+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.900+0000 7fad28b33800 1 NOTICE: finished shard 4 (0 entries found) 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.900+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.900+0000 7fad28b33800 1 NOTICE: finished shard 5 (0 entries found) 2024-02-23T06:29:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.900+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.901+0000 7fad28b33800 1 NOTICE: finished shard 6 (0 entries found) 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.901+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.901+0000 7fad28b33800 1 NOTICE: finished shard 7 (0 entries found) 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.901+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.902+0000 7fad28b33800 1 NOTICE: finished shard 8 (0 entries found) 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.902+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.902+0000 7fad28b33800 1 NOTICE: finished shard 9 (0 entries found) 2024-02-23T06:29:54.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.902+0000 7fad28b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:54.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.903+0000 7fad28b33800 1 NOTICE: finished shard 10 (0 entries found) 2024-02-23T06:29:54.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.903+0000 7fad28b33800 1 NOTICE: finished all shards (0 entries found) 2024-02-23T06:29:54.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.904+0000 7fabdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:54.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.906+0000 7fad28b33800 20 remove_watcher() i=0 2024-02-23T06:29:54.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.906+0000 7fad28b33800 2 removed watcher, disabling cache 2024-02-23T06:29:54.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.907+0000 7fad28b33800 20 remove_watcher() i=1 2024-02-23T06:29:54.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.908+0000 7fad28b33800 20 remove_watcher() i=2 2024-02-23T06:29:54.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.909+0000 7fad28b33800 20 remove_watcher() i=3 2024-02-23T06:29:54.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.911+0000 7fad28b33800 20 remove_watcher() i=4 2024-02-23T06:29:54.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.912+0000 7fad28b33800 20 remove_watcher() i=5 2024-02-23T06:29:54.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.912+0000 7fad28b33800 20 remove_watcher() i=6 2024-02-23T06:29:54.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:54.913+0000 7fad28b33800 20 remove_watcher() i=7 2024-02-23T06:29:54.923 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-02-23T06:29:54.923 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:54.975 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-02-23T06:29:54.975 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:29:55.186 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-02-23T06:29:55.567 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-02-23T06:29:57.018 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:57.019 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-02-23T06:29:57.051 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:57.051 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:57.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.089+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 realm 2024-02-23T06:29:57.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:57.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.091+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.092+0000 7f395cbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.092+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.092+0000 7f395cbaf800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:57.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.092+0000 7f395cbaf800 20 searching for the correct realm 2024-02-23T06:29:57.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.097+0000 7f395ac4c640 0 -- 172.21.15.142:0/2289871525 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x561b58bd7860 msgr2=0x561b58bd9d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:57.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.101+0000 7f3951c4a640 0 -- 172.21.15.142:0/2289871525 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f394c06b040 msgr2=0x7f394c05d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:57.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.106+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 zone default found 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 4 Realm: () 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:57.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 zonegroup default 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.107+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.108+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.108+0000 7f395cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.108+0000 7f395cbaf800 20 started sync module instance, tier type = 2024-02-23T06:29:57.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.108+0000 7f395cbaf800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.122+0000 7f395cbaf800 20 add_watcher() i=0 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.122+0000 7f395cbaf800 20 add_watcher() i=1 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.122+0000 7f395cbaf800 20 add_watcher() i=2 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.122+0000 7f395cbaf800 20 add_watcher() i=3 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.122+0000 7f395cbaf800 20 add_watcher() i=4 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.122+0000 7f395cbaf800 20 add_watcher() i=5 2024-02-23T06:29:57.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.123+0000 7f395cbaf800 20 add_watcher() i=6 2024-02-23T06:29:57.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.125+0000 7f395cbaf800 20 add_watcher() i=7 2024-02-23T06:29:57.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.125+0000 7f395cbaf800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:57.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.128+0000 7f3810fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.128+0000 7f395cbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.128+0000 7f395cbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.128+0000 7f395cbaf800 5 note: GC not initialized 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f378b7fe640 20 reqs_thread_entry: start 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f395cbaf800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f395cbaf800 20 Filter name: none 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f37897fa640 20 reqs_thread_entry: start 2024-02-23T06:29:57.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f395cbaf800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:57.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.129+0000 7f395cbaf800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:57.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:57.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:57.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 INFO: main: starting shard=0 2024-02-23T06:29:57.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:57.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 INFO: main: starting shard=1 2024-02-23T06:29:57.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.130+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:57.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.131+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.131+0000 7f395cbaf800 20 INFO: main: starting shard=2 2024-02-23T06:29:57.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.131+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:57.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.131+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.131+0000 7f395cbaf800 20 INFO: main: starting shard=3 2024-02-23T06:29:57.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.131+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:57.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.132+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.132+0000 7f395cbaf800 20 INFO: main: starting shard=4 2024-02-23T06:29:57.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.132+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.132+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.132+0000 7f395cbaf800 20 INFO: main: starting shard=5 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.132+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.133+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.133+0000 7f395cbaf800 20 INFO: main: starting shard=6 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.133+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.133+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.133+0000 7f395cbaf800 20 INFO: main: starting shard=7 2024-02-23T06:29:57.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.133+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:57.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.134+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.134+0000 7f395cbaf800 20 INFO: main: starting shard=8 2024-02-23T06:29:57.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.134+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:57.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.134+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.134+0000 7f395cbaf800 20 INFO: main: starting shard=9 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.134+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.135+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.135+0000 7f395cbaf800 20 INFO: main: starting shard=10 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.135+0000 7f395cbaf800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.135+0000 7f395cbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.135+0000 7f395cbaf800 20 INFO: main: done 2024-02-23T06:29:57.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.136+0000 7f3810fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.140+0000 7f395cbaf800 20 remove_watcher() i=0 2024-02-23T06:29:57.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.140+0000 7f395cbaf800 2 removed watcher, disabling cache 2024-02-23T06:29:57.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.141+0000 7f395cbaf800 20 remove_watcher() i=1 2024-02-23T06:29:57.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.142+0000 7f395cbaf800 20 remove_watcher() i=2 2024-02-23T06:29:57.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.143+0000 7f395cbaf800 20 remove_watcher() i=3 2024-02-23T06:29:57.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.144+0000 7f395cbaf800 20 remove_watcher() i=4 2024-02-23T06:29:57.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.145+0000 7f395cbaf800 20 remove_watcher() i=5 2024-02-23T06:29:57.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.148+0000 7f395cbaf800 20 remove_watcher() i=6 2024-02-23T06:29:57.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.149+0000 7f395cbaf800 20 remove_watcher() i=7 2024-02-23T06:29:57.227 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:57.229 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-02-23T06:29:57.258 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:57.258 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:57.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.290+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 realm 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.292+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.293+0000 7fca5f51f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.293+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.293+0000 7fca5f51f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:57.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.293+0000 7fca5f51f800 20 searching for the correct realm 2024-02-23T06:29:57.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.297+0000 7fca5b7a4640 0 -- 172.21.15.142:0/4211590309 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fca440c4040 msgr2=0x7fca440a3730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:57.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.299+0000 7fca5b7a4640 0 -- 172.21.15.142:0/4211590309 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x5566015c7850 msgr2=0x5566015c9c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:57.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:57.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.305+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:57.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 zone default found 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 4 Realm: () 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 zonegroup default 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.306+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.307+0000 7fca5f51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.307+0000 7fca5f51f800 20 started sync module instance, tier type = 2024-02-23T06:29:57.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.307+0000 7fca5f51f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:57.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.319+0000 7fca5f51f800 20 add_watcher() i=0 2024-02-23T06:29:57.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.319+0000 7fca5f51f800 20 add_watcher() i=1 2024-02-23T06:29:57.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.319+0000 7fca5f51f800 20 add_watcher() i=2 2024-02-23T06:29:57.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.319+0000 7fca5f51f800 20 add_watcher() i=3 2024-02-23T06:29:57.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.319+0000 7fca5f51f800 20 add_watcher() i=4 2024-02-23T06:29:57.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.319+0000 7fca5f51f800 20 add_watcher() i=5 2024-02-23T06:29:57.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.321+0000 7fca5f51f800 20 add_watcher() i=6 2024-02-23T06:29:57.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.321+0000 7fca5f51f800 20 add_watcher() i=7 2024-02-23T06:29:57.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.321+0000 7fca5f51f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:57.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.323+0000 7fc9117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 5 note: GC not initialized 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fc88bfff640 20 reqs_thread_entry: start 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 20 Filter name: none 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fc889ffb640 20 reqs_thread_entry: start 2024-02-23T06:29:57.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.324+0000 7fca5f51f800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.325+0000 7fca5f51f800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.325+0000 7fca5f51f800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.325+0000 7fca5f51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.325+0000 7fca5f51f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.325+0000 7fca5f51f800 20 INFO: main: starting shard=0 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.325+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:57.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.326+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.326+0000 7fca5f51f800 20 INFO: main: starting shard=1 2024-02-23T06:29:57.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.326+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:57.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.326+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.326+0000 7fca5f51f800 20 INFO: main: starting shard=2 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.326+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.327+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.327+0000 7fca5f51f800 20 INFO: main: starting shard=3 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.327+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.327+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.327+0000 7fca5f51f800 20 INFO: main: starting shard=4 2024-02-23T06:29:57.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.327+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.328+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.328+0000 7fca5f51f800 20 INFO: main: starting shard=5 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.328+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.328+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.328+0000 7fca5f51f800 20 INFO: main: starting shard=6 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.328+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.329+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.329+0000 7fca5f51f800 20 INFO: main: starting shard=7 2024-02-23T06:29:57.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.329+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:57.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.329+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.329+0000 7fca5f51f800 20 INFO: main: starting shard=8 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.329+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 INFO: main: starting shard=9 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 INFO: main: starting shard=10 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.330+0000 7fca5f51f800 20 INFO: main: done 2024-02-23T06:29:57.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.331+0000 7fc9117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.333+0000 7fca5f51f800 20 remove_watcher() i=0 2024-02-23T06:29:57.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.333+0000 7fca5f51f800 2 removed watcher, disabling cache 2024-02-23T06:29:57.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.334+0000 7fca5f51f800 20 remove_watcher() i=1 2024-02-23T06:29:57.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.336+0000 7fca5f51f800 20 remove_watcher() i=2 2024-02-23T06:29:57.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.337+0000 7fca5f51f800 20 remove_watcher() i=3 2024-02-23T06:29:57.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.338+0000 7fca5f51f800 20 remove_watcher() i=4 2024-02-23T06:29:57.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.339+0000 7fca5f51f800 20 remove_watcher() i=5 2024-02-23T06:29:57.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.341+0000 7fca5f51f800 20 remove_watcher() i=6 2024-02-23T06:29:57.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.342+0000 7fca5f51f800 20 remove_watcher() i=7 2024-02-23T06:29:57.411 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:57.413 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-02-23T06:29:57.441 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:57.441 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:57.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.473+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 realm 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.475+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.476+0000 7fd281c67800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.476+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.477+0000 7fd281c67800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:57.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.477+0000 7fd281c67800 20 searching for the correct realm 2024-02-23T06:29:57.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.480+0000 7fd276d4e640 0 -- 172.21.15.142:0/2103832403 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fd270066c20 msgr2=0x7fd27005d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:29:57.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.484+0000 7fd276d4e640 0 -- 172.21.15.142:0/2103832403 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fd148077bd0 msgr2=0x7fd14807a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:57.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 zone default found 2024-02-23T06:29:57.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 4 Realm: () 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 zonegroup default 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.488+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 started sync module instance, tier type = 2024-02-23T06:29:57.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.489+0000 7fd281c67800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:57.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.499+0000 7fd281c67800 20 add_watcher() i=0 2024-02-23T06:29:57.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.499+0000 7fd281c67800 20 add_watcher() i=1 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.499+0000 7fd281c67800 20 add_watcher() i=2 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.499+0000 7fd281c67800 20 add_watcher() i=3 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.499+0000 7fd281c67800 20 add_watcher() i=4 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.499+0000 7fd281c67800 20 add_watcher() i=5 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.500+0000 7fd281c67800 20 add_watcher() i=6 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.500+0000 7fd281c67800 20 add_watcher() i=7 2024-02-23T06:29:57.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.500+0000 7fd281c67800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:57.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd281c67800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd281c67800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd281c67800 5 note: GC not initialized 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd134fe1640 20 reqs_thread_entry: start 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd281c67800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd281c67800 20 Filter name: none 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.502+0000 7fd0ae7fc640 20 reqs_thread_entry: start 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:57.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 INFO: main: starting shard=0 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.503+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.504+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.504+0000 7fd281c67800 20 INFO: main: starting shard=1 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.504+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.504+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.504+0000 7fd281c67800 20 INFO: main: starting shard=2 2024-02-23T06:29:57.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.504+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.505+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.505+0000 7fd281c67800 20 INFO: main: starting shard=3 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.505+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.505+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.505+0000 7fd281c67800 20 INFO: main: starting shard=4 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.505+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.506+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.506+0000 7fd281c67800 20 INFO: main: starting shard=5 2024-02-23T06:29:57.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.506+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:57.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.506+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.506+0000 7fd281c67800 20 INFO: main: starting shard=6 2024-02-23T06:29:57.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.506+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:57.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.507+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.507+0000 7fd281c67800 20 INFO: main: starting shard=7 2024-02-23T06:29:57.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.507+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:57.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.507+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.507+0000 7fd281c67800 20 INFO: main: starting shard=8 2024-02-23T06:29:57.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.507+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.508+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.508+0000 7fd281c67800 20 INFO: main: starting shard=9 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.508+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.508+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.508+0000 7fd281c67800 20 INFO: main: starting shard=10 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.508+0000 7fd281c67800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.509+0000 7fd281c67800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.509+0000 7fd281c67800 20 INFO: main: done 2024-02-23T06:29:57.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.509+0000 7fd135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.511+0000 7fd281c67800 20 remove_watcher() i=0 2024-02-23T06:29:57.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.511+0000 7fd281c67800 2 removed watcher, disabling cache 2024-02-23T06:29:57.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.512+0000 7fd281c67800 20 remove_watcher() i=1 2024-02-23T06:29:57.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.513+0000 7fd281c67800 20 remove_watcher() i=2 2024-02-23T06:29:57.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.514+0000 7fd281c67800 20 remove_watcher() i=3 2024-02-23T06:29:57.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.515+0000 7fd281c67800 20 remove_watcher() i=4 2024-02-23T06:29:57.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.516+0000 7fd281c67800 20 remove_watcher() i=5 2024-02-23T06:29:57.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.517+0000 7fd281c67800 20 remove_watcher() i=6 2024-02-23T06:29:57.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.518+0000 7fd281c67800 20 remove_watcher() i=7 2024-02-23T06:29:57.585 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:29:57.586 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-02-23T06:29:57.617 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:57.617 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:57.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.649+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 realm 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.651+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.652+0000 7ff1e9b24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.652+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.652+0000 7ff1e9b24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:57.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.652+0000 7ff1e9b24800 20 searching for the correct realm 2024-02-23T06:29:57.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.657+0000 7ff1e5da4640 0 -- 172.21.15.142:0/2121908943 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7ff1d00708e0 msgr2=0x7ff1d00887e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:57.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.862+0000 7ff1e55a3640 0 -- 172.21.15.142:0/2121908943 >> [v2:172.21.15.152:6824/160508611,v1:172.21.15.152:6825/160508611] conn(0x559817c24ab0 msgr2=0x559817c26ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:57.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.865+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 zone default found 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 4 Realm: () 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:57.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:57.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 zonegroup default 2024-02-23T06:29:57.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:57.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 started sync module instance, tier type = 2024-02-23T06:29:57.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.866+0000 7ff1e9b24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:57.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=0 2024-02-23T06:29:57.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=1 2024-02-23T06:29:57.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=2 2024-02-23T06:29:57.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=3 2024-02-23T06:29:57.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=4 2024-02-23T06:29:57.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=5 2024-02-23T06:29:57.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.879+0000 7ff1e9b24800 20 add_watcher() i=6 2024-02-23T06:29:57.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.880+0000 7ff1e9b24800 20 add_watcher() i=7 2024-02-23T06:29:57.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.880+0000 7ff1e9b24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:57.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.882+0000 7ff09b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.882+0000 7ff1e9b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:57.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.882+0000 7ff1e9b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:57.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.882+0000 7ff1e9b24800 5 note: GC not initialized 2024-02-23T06:29:57.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.882+0000 7ff09a7e4640 20 reqs_thread_entry: start 2024-02-23T06:29:57.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.882+0000 7ff1e9b24800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:57.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 Filter name: none 2024-02-23T06:29:57.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff00bfff640 20 reqs_thread_entry: start 2024-02-23T06:29:57.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:57.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 rados->read ofs=0 len=0 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 INFO: main: starting shard=0 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.883+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.884+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.884+0000 7ff1e9b24800 20 INFO: main: starting shard=1 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.884+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 INFO: main: starting shard=2 2024-02-23T06:29:57.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:57.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 INFO: main: starting shard=3 2024-02-23T06:29:57.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:57.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 INFO: main: starting shard=4 2024-02-23T06:29:57.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.885+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:57.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.886+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.886+0000 7ff1e9b24800 20 INFO: main: starting shard=5 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.886+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.886+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.886+0000 7ff1e9b24800 20 INFO: main: starting shard=6 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.886+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.887+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.887+0000 7ff1e9b24800 20 INFO: main: starting shard=7 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.887+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.887+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.887+0000 7ff1e9b24800 20 INFO: main: starting shard=8 2024-02-23T06:29:57.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.887+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.888+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.888+0000 7ff1e9b24800 20 INFO: main: starting shard=9 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.888+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.888+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.888+0000 7ff1e9b24800 20 INFO: main: starting shard=10 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.888+0000 7ff1e9b24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.889+0000 7ff1e9b24800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:29:57.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.889+0000 7ff1e9b24800 20 INFO: main: done 2024-02-23T06:29:57.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.890+0000 7ff09b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:57.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.895+0000 7ff1e9b24800 20 remove_watcher() i=0 2024-02-23T06:29:57.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.895+0000 7ff1e9b24800 2 removed watcher, disabling cache 2024-02-23T06:29:57.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.896+0000 7ff1e9b24800 20 remove_watcher() i=1 2024-02-23T06:29:57.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.896+0000 7ff1e9b24800 20 remove_watcher() i=2 2024-02-23T06:29:57.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.898+0000 7ff1e9b24800 20 remove_watcher() i=3 2024-02-23T06:29:57.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.900+0000 7ff1e9b24800 20 remove_watcher() i=4 2024-02-23T06:29:57.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.901+0000 7ff1e9b24800 20 remove_watcher() i=5 2024-02-23T06:29:57.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.902+0000 7ff1e9b24800 20 remove_watcher() i=6 2024-02-23T06:29:57.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:57.903+0000 7ff1e9b24800 20 remove_watcher() i=7 2024-02-23T06:29:57.918 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-02-23T06:29:58.297 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-02-23T06:29:58.682 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-02-23T06:29:58.710 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:58.711 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:58.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.744+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 realm 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.745+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.746+0000 7ff40c130800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:58.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.746+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.746+0000 7ff40c130800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:58.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.747+0000 7ff40c130800 20 searching for the correct realm 2024-02-23T06:29:58.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.751+0000 7ff3fffff640 0 -- 172.21.15.142:0/2070366474 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7ff3f806c050 msgr2=0x7ff3f8058080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:58.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.754+0000 7ff40844c640 0 -- 172.21.15.142:0/2070366474 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7ff3f0083040 msgr2=0x7ff3f00763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:58.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:58.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.757+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:58.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 zone default found 2024-02-23T06:29:58.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 4 Realm: () 2024-02-23T06:29:58.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:58.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:58.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:58.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 zonegroup default 2024-02-23T06:29:58.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.758+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.759+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.759+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.759+0000 7ff40c130800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.759+0000 7ff40c130800 20 started sync module instance, tier type = 2024-02-23T06:29:58.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.759+0000 7ff40c130800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:58.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=0 2024-02-23T06:29:58.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=1 2024-02-23T06:29:58.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=2 2024-02-23T06:29:58.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=3 2024-02-23T06:29:58.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=4 2024-02-23T06:29:58.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=5 2024-02-23T06:29:58.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.777+0000 7ff40c130800 20 add_watcher() i=6 2024-02-23T06:29:58.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.778+0000 7ff40c130800 20 add_watcher() i=7 2024-02-23T06:29:58.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.778+0000 7ff40c130800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:58.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff2bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 5 note: GC not initialized 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff2bcfe1640 20 reqs_thread_entry: start 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 20 Filter name: none 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff2367fc640 20 reqs_thread_entry: start 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.780+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:29:58.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.781+0000 7ff40c130800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:29:58.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.782+0000 7ff40c130800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:29:58.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.782+0000 7ff40c130800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:29:58.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.782+0000 7ff40c130800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:29:58.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.782+0000 7ff40c130800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:29:58.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.794+0000 7ff2bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:58.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.796+0000 7ff40c130800 20 remove_watcher() i=0 2024-02-23T06:29:58.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.796+0000 7ff40c130800 2 removed watcher, disabling cache 2024-02-23T06:29:58.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.798+0000 7ff40c130800 20 remove_watcher() i=1 2024-02-23T06:29:58.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.799+0000 7ff40c130800 20 remove_watcher() i=2 2024-02-23T06:29:58.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.801+0000 7ff40c130800 20 remove_watcher() i=3 2024-02-23T06:29:58.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.802+0000 7ff40c130800 20 remove_watcher() i=4 2024-02-23T06:29:58.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.802+0000 7ff40c130800 20 remove_watcher() i=5 2024-02-23T06:29:58.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.803+0000 7ff40c130800 20 remove_watcher() i=6 2024-02-23T06:29:58.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.804+0000 7ff40c130800 20 remove_watcher() i=7 2024-02-23T06:29:58.815 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-02-23T06:29:58.848 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:58.848 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:58.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.881+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 realm 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.882+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.883+0000 7f7e63a30800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:58.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.883+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.884+0000 7f7e63a30800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:58.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.884+0000 7f7e63a30800 20 searching for the correct realm 2024-02-23T06:29:58.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.887+0000 7f7e5624a640 0 -- 172.21.15.142:0/3419706187 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f7e50015070 msgr2=0x7f7e50046910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:58.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.891+0000 7f7e5624a640 0 -- 172.21.15.142:0/3419706187 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f7d28077c30 msgr2=0x7f7d2807a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:58.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.894+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 zone default found 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 4 Realm: () 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:58.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 zonegroup default 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.895+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 started sync module instance, tier type = 2024-02-23T06:29:58.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.896+0000 7f7e63a30800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=0 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=1 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=2 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=3 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=4 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=5 2024-02-23T06:29:58.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.910+0000 7f7e63a30800 20 add_watcher() i=6 2024-02-23T06:29:58.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.913+0000 7f7e63a30800 20 add_watcher() i=7 2024-02-23T06:29:58.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.913+0000 7f7e63a30800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:58.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7d157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 5 note: GC not initialized 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7c8ffff640 20 reqs_thread_entry: start 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 20 Filter name: none 2024-02-23T06:29:58.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7c8dffb640 20 reqs_thread_entry: start 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.915+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 : miss 2024-02-23T06:29:58.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 20 rados->read ofs=0 len=0 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 info.flags=0x17 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 to cache LRU end 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.916+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.0 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.917+0000 7f7e63a30800 1 NOTICE: finished shard 0 (0 entries removed) 2024-02-23T06:29:58.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.917+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.917+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.2 2024-02-23T06:29:58.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.918+0000 7f7e63a30800 1 NOTICE: finished shard 2 (0 entries removed) 2024-02-23T06:29:58.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.918+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.3 2024-02-23T06:29:58.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.918+0000 7f7e63a30800 1 NOTICE: finished shard 3 (0 entries removed) 2024-02-23T06:29:58.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.918+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.4 2024-02-23T06:29:58.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.919+0000 7f7e63a30800 1 NOTICE: finished shard 4 (0 entries removed) 2024-02-23T06:29:58.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.919+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.919+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.6 2024-02-23T06:29:58.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.920+0000 7f7e63a30800 1 NOTICE: finished shard 6 (0 entries removed) 2024-02-23T06:29:58.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.920+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.7 2024-02-23T06:29:58.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.920+0000 7f7e63a30800 1 NOTICE: finished shard 7 (0 entries removed) 2024-02-23T06:29:58.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.920+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.921+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.9 2024-02-23T06:29:58.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.921+0000 7f7e63a30800 1 NOTICE: finished shard 9 (0 entries removed) 2024-02-23T06:29:58.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.921+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.921+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.922+0000 7f7e63a30800 20 get_obj_state: octx=0x560160f94400 obj=check-bucket:e state=0x560161259e68 s->prefetch_data=0 2024-02-23T06:29:58.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.922+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.922+0000 7f7e63a30800 20 get_obj_state: octx=0x560160fbbdd0 obj=check-bucket:d state=0x56016125c208 s->prefetch_data=0 2024-02-23T06:29:58.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.922+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state: octx=0x560161264910 obj=check-bucket:c state=0x5601612f9108 s->prefetch_data=0 2024-02-23T06:29:58.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state: octx=0x56016125e9c0 obj=check-bucket:f state=0x5601612f9c68 s->prefetch_data=0 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to jlnu6a1a797nz3gob81xl9tm9ofp3bf9 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state_impl: setting s->olh_tag to 4o8xdeuayq1jdltizjwo7lxhn7vha4vw 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4o8xdeuayq1jdltizjwo7lxhn7vha4vw 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to gdv36pvlwry830wkm6cfcigrx09w2hwc 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state_impl: setting s->olh_tag to yctssr259818nyviyodcgv28vspf1ayf 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yctssr259818nyviyodcgv28vspf1ayf 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to g8v1hku1gr5ms27aqkoqhos7ihyoxl8w 2024-02-23T06:29:58.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state_impl: setting s->olh_tag to 32amocrdee20331xqw6ipn94aoqjekby 2024-02-23T06:29:58.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=32amocrdee20331xqw6ipn94aoqjekby 2024-02-23T06:29:58.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to lm789c73gif8hjnpvpx2ynhnc34zcqyd 2024-02-23T06:29:58.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 get_obj_state_impl: setting s->olh_tag to lzk3ejfjafyikwdqaog117pni0btwnam 2024-02-23T06:29:58.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.923+0000 7f7e63a30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lzk3ejfjafyikwdqaog117pni0btwnam 2024-02-23T06:29:58.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.925+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.925+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.925+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 olh_log_entry: epoch=3 op=3 key=d[QzX7cySwCt-02OBeFBQkXz0KPUGSJGn] 2024-02-23T06:29:58.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 get_obj_state: octx=0x560160fbbdd0 obj=check-bucket:_:QzX7cySwCt-02OBeFBQkXz0KPUGSJGn_d state=0x560161313ff8 s->prefetch_data=0 2024-02-23T06:29:58.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 10 manifest: total_size = 22 2024-02-23T06:29:58.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4558912040906915051 2024-02-23T06:29:58.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 get_obj_state: octx=0x560160fbbdd0 obj=check-bucket:_:QzX7cySwCt-02OBeFBQkXz0KPUGSJGn_d state=0x560161313ff8 s->prefetch_data=0 2024-02-23T06:29:58.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 prepare_atomic_modification: state is not atomic. state=0x560161313ff8 2024-02-23T06:29:58.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.928+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.930+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.930+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 olh_log_entry: epoch=3 op=3 key=c[zk4rZOtQs2vJo6gPE3AAbZZ2LPZ2Agb] 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 get_obj_state: octx=0x560161264910 obj=check-bucket:_:zk4rZOtQs2vJo6gPE3AAbZZ2LPZ2Agb_c state=0x5601612fa7c8 s->prefetch_data=0 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 olh_log_entry: epoch=2 op=3 key=e[r14fnZJ2OL1bGw.SSOhhaHnE4706X6w] 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 get_obj_state: octx=0x560160f94400 obj=check-bucket:_:r14fnZJ2OL1bGw.SSOhhaHnE4706X6w_e state=0x560161320e48 s->prefetch_data=0 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 10 manifest: total_size = 11 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.914874013399736891 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 get_obj_state: octx=0x560161264910 obj=check-bucket:_:zk4rZOtQs2vJo6gPE3AAbZZ2LPZ2Agb_c state=0x5601612fa7c8 s->prefetch_data=0 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 prepare_atomic_modification: state is not atomic. state=0x5601612fa7c8 2024-02-23T06:29:58.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 10 manifest: total_size = 9 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5885873642171350510 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 get_obj_state: octx=0x560160f94400 obj=check-bucket:_:r14fnZJ2OL1bGw.SSOhhaHnE4706X6w_e state=0x560161320e48 s->prefetch_data=0 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 prepare_atomic_modification: state is not atomic. state=0x560161320e48 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.931+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 olh_log_entry: epoch=2 op=3 key=f[4wvwSfET3ZlzolusX2X7136OyM.xAX8] 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 get_obj_state: octx=0x56016125e9c0 obj=check-bucket:_:4wvwSfET3ZlzolusX2X7136OyM.xAX8_f state=0x56016132d638 s->prefetch_data=0 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 10 manifest: total_size = 22 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.866763053938113127 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 get_obj_state: octx=0x56016125e9c0 obj=check-bucket:_:4wvwSfET3ZlzolusX2X7136OyM.xAX8_f state=0x56016132d638 s->prefetch_data=0 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.933+0000 7f7e63a30800 20 prepare_atomic_modification: state is not atomic. state=0x56016132d638 2024-02-23T06:29:58.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.934+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.936+0000 7f7e63a30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:58.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.936+0000 7f7e63a30800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-02-23T06:29:58.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.936+0000 7f7e63a30800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:58.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.936+0000 7f7e63a30800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:QzX7cySwCt-02OBeFBQkXz0KPUGSJGn_.3elTstgB4DWrKwa0wqmP44mH-LwWdSy_0 2024-02-23T06:29:58.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.938+0000 7f7d41ffb640 20 handle_completion(): completion ok for obj=d[QzX7cySwCt-02OBeFBQkXz0KPUGSJGn] 2024-02-23T06:29:58.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.938+0000 7f7e63a30800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:58.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.938+0000 7f7e63a30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:58.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.938+0000 7f7e63a30800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-02-23T06:29:58.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.938+0000 7f7e63a30800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:58.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.938+0000 7f7e63a30800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:4wvwSfET3ZlzolusX2X7136OyM.xAX8_.QI6T-SQW5CuRIfanfyRoNZX2Jb6wqX1_0 2024-02-23T06:29:58.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.941+0000 7f7e63a30800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:58.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.941+0000 7f7e63a30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:58.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.941+0000 7f7e63a30800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-02-23T06:29:58.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.941+0000 7f7e63a30800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:58.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.941+0000 7f7e63a30800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:zk4rZOtQs2vJo6gPE3AAbZZ2LPZ2Agb_.UbOfqh_45nt186_keo_jjiqi56viNpX_0 2024-02-23T06:29:58.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.942+0000 7f7d427fc640 20 handle_completion(): completion ok for obj=f[4wvwSfET3ZlzolusX2X7136OyM.xAX8] 2024-02-23T06:29:58.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.944+0000 7f7e63a30800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:58.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.944+0000 7f7e63a30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:29:58.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.944+0000 7f7e63a30800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-02-23T06:29:58.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.944+0000 7f7e63a30800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:29:58.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.944+0000 7f7e63a30800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1__shadow:r14fnZJ2OL1bGw.SSOhhaHnE4706X6w_.Q6QEZYoQXrp1BkjNJbktbo7GSJkV7sg_0 2024-02-23T06:29:58.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.944+0000 7f7d427fc640 20 handle_completion(): completion ok for obj=c[zk4rZOtQs2vJo6gPE3AAbZZ2LPZ2Agb] 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 20 get_obj_state: octx=0x56016125e9c0 obj=check-bucket:f state=0x5601612f9c68 s->prefetch_data=0 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lzk3ejfjafyikwdqaog117pni0btwnam 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7d427fc640 20 handle_completion(): completion ok for obj=e[r14fnZJ2OL1bGw.SSOhhaHnE4706X6w] 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.950+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.951+0000 7f7e63a30800 20 get_obj_state: octx=0x560160f94400 obj=check-bucket:e state=0x560161259e68 s->prefetch_data=0 2024-02-23T06:29:58.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.951+0000 7f7e63a30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4o8xdeuayq1jdltizjwo7lxhn7vha4vw 2024-02-23T06:29:58.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.952+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.5 2024-02-23T06:29:58.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.952+0000 7f7e63a30800 1 NOTICE: finished shard 5 (1 entries removed) 2024-02-23T06:29:58.954 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.954+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.8 2024-02-23T06:29:58.954 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.954+0000 7f7e63a30800 1 NOTICE: finished shard 8 (1 entries removed) 2024-02-23T06:29:58.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.958+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.958+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.960+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.1 2024-02-23T06:29:58.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.960+0000 7f7e63a30800 1 NOTICE: finished shard 1 (1 entries removed) 2024-02-23T06:29:58.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.964+0000 7f7e63a30800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1.10 2024-02-23T06:29:58.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.964+0000 7f7e63a30800 1 NOTICE: finished shard 10 (1 entries removed) 2024-02-23T06:29:58.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.964+0000 7f7e63a30800 1 NOTICE: finished all shards (4 entries removed) 2024-02-23T06:29:58.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.964+0000 7f7d157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:58.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.966+0000 7f7e63a30800 20 remove_watcher() i=0 2024-02-23T06:29:58.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.966+0000 7f7e63a30800 2 removed watcher, disabling cache 2024-02-23T06:29:58.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.967+0000 7f7e63a30800 20 remove_watcher() i=1 2024-02-23T06:29:58.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.968+0000 7f7e63a30800 20 remove_watcher() i=2 2024-02-23T06:29:58.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.969+0000 7f7e63a30800 20 remove_watcher() i=3 2024-02-23T06:29:58.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.970+0000 7f7e63a30800 20 remove_watcher() i=4 2024-02-23T06:29:58.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.971+0000 7f7e63a30800 20 remove_watcher() i=5 2024-02-23T06:29:58.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.972+0000 7f7e63a30800 20 remove_watcher() i=6 2024-02-23T06:29:58.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:58.973+0000 7f7e63a30800 20 remove_watcher() i=7 2024-02-23T06:29:59.048 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-02-23T06:29:59.074 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:29:59.075 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:29:59.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.107+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.108+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.108+0000 7fd53f54b800 20 realm 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.108+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.109+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.109+0000 7fd53f54b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.109+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.109+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.109+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.110+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:59.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.110+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.110+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:29:59.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.110+0000 7fd53f54b800 20 searching for the correct realm 2024-02-23T06:29:59.113 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.113+0000 7fd53464a640 0 -- 172.21.15.142:0/1023377046 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fd52c0b9000 msgr2=0x7fd52c0a14e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:59.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.116+0000 7fd53ce4b640 0 -- 172.21.15.142:0/1023377046 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fd524057910 msgr2=0x7fd524049420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:29:59.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:29:59.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:29:59.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:29:59.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:29:59.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 zone default found 2024-02-23T06:29:59.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 4 Realm: () 2024-02-23T06:29:59.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:29:59.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:29:59.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 zonegroup default 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.322+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 started sync module instance, tier type = 2024-02-23T06:29:59.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.323+0000 7fd53f54b800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=0 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=1 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=2 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=3 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=4 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=5 2024-02-23T06:29:59.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.343+0000 7fd53f54b800 20 add_watcher() i=6 2024-02-23T06:29:59.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.344+0000 7fd53f54b800 20 add_watcher() i=7 2024-02-23T06:29:59.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.344+0000 7fd53f54b800 2 all 8 watchers are set, enabling cache 2024-02-23T06:29:59.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.345+0000 7fd3f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd53f54b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd53f54b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd53f54b800 5 note: GC not initialized 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd3f1fe3640 20 reqs_thread_entry: start 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd53f54b800 20 init_complete bucket index max shards: 11 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd53f54b800 20 Filter name: none 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd3637fe640 20 reqs_thread_entry: start 2024-02-23T06:29:59.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.346+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:59.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:59.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:59.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=190 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 rados_obj.operate() r=0 bl.length=368 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.347+0000 7fd53f54b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.348+0000 7fd53f54b800 20 rados->read ofs=0 len=0 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.348+0000 7fd53f54b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:29:59.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.349+0000 7fd3f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:29:59.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.351+0000 7fd53f54b800 20 remove_watcher() i=0 2024-02-23T06:29:59.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.351+0000 7fd53f54b800 2 removed watcher, disabling cache 2024-02-23T06:29:59.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.353+0000 7fd53f54b800 20 remove_watcher() i=1 2024-02-23T06:29:59.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.354+0000 7fd53f54b800 20 remove_watcher() i=2 2024-02-23T06:29:59.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.359+0000 7fd53f54b800 20 remove_watcher() i=3 2024-02-23T06:29:59.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.360+0000 7fd53f54b800 20 remove_watcher() i=4 2024-02-23T06:29:59.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.361+0000 7fd53f54b800 20 remove_watcher() i=5 2024-02-23T06:29:59.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.363+0000 7fd53f54b800 20 remove_watcher() i=6 2024-02-23T06:29:59.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:29:59.364+0000 7fd53f54b800 20 remove_watcher() i=7 2024-02-23T06:29:59.374 INFO:tasks.workunit.client.0.smithi142.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-02-23T06:29:59.374 INFO:tasks.workunit.client.0.smithi142.stderr:Deleting bucket check-bucket 2024-02-23T06:29:59.410 INFO:tasks.workunit.client.0.smithi142.stderr:Completed bucket check tests 2024-02-23T06:29:59.411 INFO:tasks.workunit.client.0.smithi142.stdout:connected to http://localhost:80 2024-02-23T06:29:59.467 INFO:tasks.workunit.client.0.smithi142.stderr:+ deactivate 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ export PATH 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ unset _OLD_VIRTUAL_PATH 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n '' ']' 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ hash -r 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n '' ']' 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ unset VIRTUAL_ENV 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' '!' '' = nondestructive ']' 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ unset -f deactivate 2024-02-23T06:29:59.468 INFO:tasks.workunit.client.0.smithi142.stderr:+ echo OK. 2024-02-23T06:29:59.469 INFO:tasks.workunit.client.0.smithi142.stdout:OK. 2024-02-23T06:29:59.470 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:29:59.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:29:59.549 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-02-23T06:29:59.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-23T06:29:59.895 DEBUG:teuthology.parallel:result is None 2024-02-23T06:29:59.896 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:29:59.936 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:29:59.936 DEBUG:teuthology.orchestra.run.smithi142:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:30:00.013 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:30:00.014 INFO:teuthology.run_tasks:Running task workunit... 2024-02-23T06:30:00.023 INFO:tasks.workunit:Pulling workunits from ref 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:30:00.023 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-23T06:30:00.023 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:30:00.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:30:00.080 INFO:teuthology.orchestra.run.smithi142.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-23T06:30:00.080 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:30:00.147 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-23T06:30:00.147 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-23T06:30:00.214 INFO:tasks.workunit:timeout=3h 2024-02-23T06:30:00.214 INFO:tasks.workunit:cleanup=True 2024-02-23T06:30:00.215 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:30:00.281 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-23T06:31:19.426 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'. 2024-02-23T06:31:19.441 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.441 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-23T06:31:19.441 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-23T06:31:19.441 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.442 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-23T06:31:19.443 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:31:19.443 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at 1fb7413ec44 Merge branches 'pr-55565', 'pr-55627' and 'wip-64543' into wip-cbodley-testing 2024-02-23T06:31:19.444 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-23T06:31:19.512 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-23T06:31:19.513 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:31:19.514 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-23T06:31:19.563 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-23T06:31:19.612 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-23T06:31:19.651 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:31:19.653 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:31:19.653 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-23T06:31:19.692 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:31:19.695 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:31:19.695 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-23T06:31:19.764 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-02-23T06:31:19.765 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-02-23T06:31:19.765 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-02-23T06:31:19.845 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:31:19.845 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 11 tests from 1 test suite. 2024-02-23T06:31:19.845 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:31:19.845 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 11 tests from ClsLock 2024-02-23T06:31:19.845 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-02-23T06:31:20.985 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:20.986 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: exclusive 2024-02-23T06:31:20.986 INFO:tasks.workunit.client.0.smithi142.stdout: tag: 2024-02-23T06:31:20.986 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:20.986 INFO:tasks.workunit.client.0.smithi142.stdout: client.5036 expiration=2024-02-23T06:33:20.981818+0000 addr=v1:172.21.15.142:0/772131767 cookie= 2024-02-23T06:31:20.994 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:20.994 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: shared 2024-02-23T06:31:20.994 INFO:tasks.workunit.client.0.smithi142.stdout: tag: 2024-02-23T06:31:20.994 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:20.994 INFO:tasks.workunit.client.0.smithi142.stdout: client.5036 expiration=2024-02-23T06:33:20.991694+0000 addr=v1:172.21.15.142:0/772131767 cookie= 2024-02-23T06:31:20.994 INFO:tasks.workunit.client.0.smithi142.stdout: client.5139 expiration=0.000000 addr=v1:172.21.15.142:0/68204908 cookie= 2024-02-23T06:31:20.996 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:20.996 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: shared 2024-02-23T06:31:20.996 INFO:tasks.workunit.client.0.smithi142.stdout: tag: 2024-02-23T06:31:20.996 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:20.996 INFO:tasks.workunit.client.0.smithi142.stdout: client.5139 expiration=0.000000 addr=v1:172.21.15.142:0/68204908 cookie= 2024-02-23T06:31:21.959 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestMultiLocking (2115 ms) 2024-02-23T06:31:21.959 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestMeta 2024-02-23T06:31:24.210 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:24.211 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: shared 2024-02-23T06:31:24.211 INFO:tasks.workunit.client.0.smithi142.stdout: tag: 2024-02-23T06:31:24.211 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:24.211 INFO:tasks.workunit.client.0.smithi142.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.142:0/1786182129 cookie= 2024-02-23T06:31:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:24.214 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: exclusive 2024-02-23T06:31:24.214 INFO:tasks.workunit.client.0.smithi142.stdout: tag: new_tag 2024-02-23T06:31:24.214 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:24.214 INFO:tasks.workunit.client.0.smithi142.stdout: client.5042 expiration=0.000000 addr=v1:172.21.15.142:0/3696557865 cookie= 2024-02-23T06:31:24.978 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestMeta (3019 ms) 2024-02-23T06:31:24.979 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestCookie 2024-02-23T06:31:27.015 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:27.015 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: exclusive 2024-02-23T06:31:27.015 INFO:tasks.workunit.client.0.smithi142.stdout: tag: 2024-02-23T06:31:27.015 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:27.020 INFO:tasks.workunit.client.0.smithi142.stdout:lock: mylock 2024-02-23T06:31:27.020 INFO:tasks.workunit.client.0.smithi142.stdout: lock_type: shared 2024-02-23T06:31:27.020 INFO:tasks.workunit.client.0.smithi142.stdout: tag: 2024-02-23T06:31:27.020 INFO:tasks.workunit.client.0.smithi142.stdout: lockers: 2024-02-23T06:31:27.020 INFO:tasks.workunit.client.0.smithi142.stdout: client.5051 expiration=0.000000 addr=v1:172.21.15.142:0/622582731 cookie= 2024-02-23T06:31:27.020 INFO:tasks.workunit.client.0.smithi142.stdout: client.5051 expiration=0.000000 addr=v1:172.21.15.142:0/622582731 cookie=new cookie 2024-02-23T06:31:28.007 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestCookie (3029 ms) 2024-02-23T06:31:28.008 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-02-23T06:31:31.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestMultipleLocks (3016 ms) 2024-02-23T06:31:31.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestLockDuration 2024-02-23T06:31:39.062 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestLockDuration (8038 ms) 2024-02-23T06:31:39.062 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-02-23T06:31:42.089 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestAssertLocked (3027 ms) 2024-02-23T06:31:42.089 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestSetCookie 2024-02-23T06:31:45.104 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestSetCookie (3015 ms) 2024-02-23T06:31:45.104 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestRenew 2024-02-23T06:32:06.146 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestRenew (21042 ms) 2024-02-23T06:32:06.146 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-02-23T06:32:13.181 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7035 ms) 2024-02-23T06:32:13.181 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-02-23T06:32:21.219 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8039 ms) 2024-02-23T06:32:21.220 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-02-23T06:32:29.259 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8039 ms) 2024-02-23T06:32:29.259 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 11 tests from ClsLock (69414 ms total) 2024-02-23T06:32:29.259 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:32:29.259 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:32:29.259 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 11 tests from 1 test suite ran. (69414 ms total) 2024-02-23T06:32:29.259 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 11 tests. 2024-02-23T06:32:29.262 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:32:29.262 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:32:29.347 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-02-23T06:32:29.348 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-02-23T06:32:29.348 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-02-23T06:32:29.431 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:32:29.431 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 4 tests from 1 test suite. 2024-02-23T06:32:29.431 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:32:29.432 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 4 tests from cls_log 2024-02-23T06:32:29.432 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-02-23T06:32:32.286 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_log.test_log_add_same_time (2856 ms) 2024-02-23T06:32:32.287 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-02-23T06:32:35.303 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_log.test_log_add_different_time (3016 ms) 2024-02-23T06:32:35.303 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_log.trim_by_time 2024-02-23T06:32:38.330 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_log.trim_by_time (3027 ms) 2024-02-23T06:32:38.330 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_log.trim_by_marker 2024-02-23T06:32:41.347 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_log.trim_by_marker (3018 ms) 2024-02-23T06:32:41.347 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 4 tests from cls_log (11917 ms total) 2024-02-23T06:32:41.347 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:32:41.348 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:32:41.348 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 4 tests from 1 test suite ran. (11917 ms total) 2024-02-23T06:32:41.348 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 4 tests. 2024-02-23T06:32:41.350 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:32:41.350 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:32:41.435 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-02-23T06:32:41.437 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-02-23T06:32:41.437 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-02-23T06:32:41.481 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:32:41.481 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 10 tests from 1 test suite. 2024-02-23T06:32:41.481 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:32:41.481 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 10 tests from cls_refcount 2024-02-23T06:32:41.481 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_implicit 2024-02-23T06:32:44.373 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_implicit (2892 ms) 2024-02-23T06:32:44.373 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-02-23T06:32:47.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3018 ms) 2024-02-23T06:32:47.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_put_snap 2024-02-23T06:32:56.461 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_put_snap (9070 ms) 2024-02-23T06:32:56.461 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_explicit 2024-02-23T06:32:59.479 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_explicit (3018 ms) 2024-02-23T06:32:59.479 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.set 2024-02-23T06:33:02.496 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.set (3016 ms) 2024-02-23T06:33:02.497 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-02-23T06:33:09.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_implicit_ec (7044 ms) 2024-02-23T06:33:09.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-02-23T06:33:16.562 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7023 ms) 2024-02-23T06:33:16.562 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-02-23T06:33:28.694 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_put_snap_ec (12132 ms) 2024-02-23T06:33:28.694 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-02-23T06:33:35.705 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.test_explicit_ec (7012 ms) 2024-02-23T06:33:35.705 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_refcount.set_ec 2024-02-23T06:33:42.728 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_refcount.set_ec (7022 ms) 2024-02-23T06:33:42.728 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 10 tests from cls_refcount (61247 ms total) 2024-02-23T06:33:42.728 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:33:42.728 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:33:42.728 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 10 tests from 1 test suite ran. (61247 ms total) 2024-02-23T06:33:42.728 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 10 tests. 2024-02-23T06:33:42.731 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:33:42.731 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:33:42.815 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-02-23T06:33:42.816 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-02-23T06:33:42.820 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-02-23T06:33:42.899 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:33:42.899 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 16 tests from 1 test suite. 2024-02-23T06:33:42.899 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:33:42.899 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 16 tests from cls_rgw 2024-02-23T06:33:44.752 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_basic 2024-02-23T06:33:44.792 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_basic (41 ms) 2024-02-23T06:33:44.792 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-02-23T06:33:44.826 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-02-23T06:33:44.826 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_remove_object 2024-02-23T06:33:44.870 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2024-02-23T06:33:44.870 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_suggest 2024-02-23T06:33:46.340 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_suggest (1469 ms) 2024-02-23T06:33:46.340 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-02-23T06:33:46.347 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-02-23T06:33:46.347 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_list 2024-02-23T06:33:46.373 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_list (25 ms) 2024-02-23T06:33:46.373 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-02-23T06:34:05.311 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_list_delimited (18938 ms) 2024-02-23T06:34:05.311 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.bi_list 2024-02-23T06:34:05.384 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.bi_list (73 ms) 2024-02-23T06:34:05.384 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.gc_set 2024-02-23T06:34:05.393 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-02-23T06:34:05.394 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.gc_list 2024-02-23T06:34:05.403 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2024-02-23T06:34:05.403 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.gc_defer 2024-02-23T06:34:12.902 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.gc_defer (7500 ms) 2024-02-23T06:34:12.902 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.usage_basic 2024-02-23T06:34:12.984 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.usage_basic (82 ms) 2024-02-23T06:34:12.985 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-02-23T06:34:12.985 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-02-23T06:34:12.986 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.usage_clear 2024-02-23T06:34:13.079 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-02-23T06:34:13.079 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-02-23T06:34:13.121 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.bi_log_trim (42 ms) 2024-02-23T06:34:13.121 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-02-23T06:34:13.137 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw.index_racing_removes (17 ms) 2024-02-23T06:34:13.911 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 16 tests from cls_rgw (28386 ms total) 2024-02-23T06:34:13.911 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:34:13.911 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:34:13.911 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 16 tests from 1 test suite ran. (31011 ms total) 2024-02-23T06:34:13.912 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 16 tests. 2024-02-23T06:34:13.914 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:34:13.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:34:13.956 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-02-23T06:34:13.957 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-02-23T06:34:13.957 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-02-23T06:34:14.038 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:34:14.038 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 9 tests from 1 test suite. 2024-02-23T06:34:14.038 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:34:14.038 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 9 tests from cls_rgw_gc 2024-02-23T06:34:14.038 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.init 2024-02-23T06:34:15.928 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.init (1889 ms) 2024-02-23T06:34:15.929 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-02-23T06:34:15.942 INFO:tasks.workunit.client.0.smithi142.stderr:[ ] list info tag = chain-0 2024-02-23T06:34:15.943 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (15 ms) 2024-02-23T06:34:15.943 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-02-23T06:34:15.950 INFO:tasks.workunit.client.0.smithi142.stderr:[ ] next_marker is: = 0/4263 2024-02-23T06:34:15.951 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-02-23T06:34:15.951 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-02-23T06:34:15.960 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-02-23T06:34:15.960 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-02-23T06:34:16.517 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (557 ms) 2024-02-23T06:34:16.517 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-02-23T06:34:16.526 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (9 ms) 2024-02-23T06:34:16.526 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-02-23T06:34:16.537 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (12 ms) 2024-02-23T06:34:16.537 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-02-23T06:34:16.545 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-02-23T06:34:16.545 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_gc.finalize 2024-02-23T06:34:16.935 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_gc.finalize (389 ms) 2024-02-23T06:34:16.935 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 9 tests from cls_rgw_gc (2895 ms total) 2024-02-23T06:34:16.935 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:34:16.935 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:34:16.935 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 9 tests from 1 test suite ran. (2895 ms total) 2024-02-23T06:34:16.935 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 9 tests. 2024-02-23T06:34:16.937 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:34:16.937 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:34:17.025 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-02-23T06:34:17.026 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-02-23T06:34:17.027 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-02-23T06:34:17.079 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:34:17.079 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:34:17.079 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 1 test from 1 test suite. 2024-02-23T06:34:17.079 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:34:18.931 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 1 test from cls_rgw_stats 2024-02-23T06:34:18.931 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] cls_rgw_stats.simulate 2024-02-23T06:34:18.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.950+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=ZVV58JKYYBN1 type=del size=2384643 2024-02-23T06:34:18.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.951+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=K28P07SKTI8R type=del size=799377 2024-02-23T06:34:18.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.952+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=DPFH8TTGZPSH type=write size=777632 2024-02-23T06:34:18.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.955+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~RAWZ3997D8QD.0 size=1048576 2024-02-23T06:34:18.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.956+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~RAWZ3997D8QD.1 size=840643 2024-02-23T06:34:18.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.956+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=RAWZ3997D8QD tag=8STJKO8ZQGGC type=write size=2937795 2024-02-23T06:34:18.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.959+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~Z7IAUM71LB6W.0 size=445581 2024-02-23T06:34:18.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.959+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=Z7IAUM71LB6W tag=NEWPYGH0T88J type=write size=1494157 2024-02-23T06:34:18.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.961+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~G519SLM3TJN1.0 size=1048576 2024-02-23T06:34:18.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.962+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~G519SLM3TJN1.1 size=68295 2024-02-23T06:34:18.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.962+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=G519SLM3TJN1 tag=WH3YHUL83LAM type=write size=2165447 2024-02-23T06:34:18.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.964+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=EDLOS4J8FWHM type=del size=478585 2024-02-23T06:34:18.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.966+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~RC3ZYVS71MVJ.0 size=1048576 2024-02-23T06:34:18.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.967+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~RC3ZYVS71MVJ.1 size=1048576 2024-02-23T06:34:18.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.968+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~RC3ZYVS71MVJ.2 size=876950 2024-02-23T06:34:18.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.968+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=RC3ZYVS71MVJ tag=HXJCWEE1FAO3 type=write size=4022678 2024-02-23T06:34:18.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.969+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=SYE5YN4DER76 type=del size=960578 2024-02-23T06:34:18.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.970+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=FTP6DWVUMCZD type=del size=1366380 2024-02-23T06:34:18.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.972+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=0PKLDVPLUP6T type=del size=1225907 2024-02-23T06:34:18.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.973+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=MM210W3JSF4B type=del size=2280676 2024-02-23T06:34:18.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.974+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=FWHJC1MCTBUH type=del size=3327432 2024-02-23T06:34:18.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.976+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~RJUMXQ1LETX3.0 size=1048576 2024-02-23T06:34:18.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.978+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~RJUMXQ1LETX3.1 size=1048576 2024-02-23T06:34:18.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.979+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~RJUMXQ1LETX3.2 size=339902 2024-02-23T06:34:18.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.979+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=RJUMXQ1LETX3 tag=1UJZAONG1PD2 type=write size=3485630 2024-02-23T06:34:18.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.980+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=YQPIP1I1DWBC type=del size=3239301 2024-02-23T06:34:18.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.982+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~ISRQVKK6PRN7.0 size=1048576 2024-02-23T06:34:18.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.983+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~ISRQVKK6PRN7.1 size=328167 2024-02-23T06:34:18.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.983+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=ISRQVKK6PRN7 tag=NQ305Z3JGC3G type=write size=2425319 2024-02-23T06:34:18.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.984+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=ZVV58JKYYBN1 type=del 2024-02-23T06:34:18.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.986+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~LDJU2LHV160L.0 size=1048576 2024-02-23T06:34:18.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.987+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~LDJU2LHV160L.1 size=24269 2024-02-23T06:34:18.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.987+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=LDJU2LHV160L tag=K4UILCCEEV90 type=write size=2121421 2024-02-23T06:34:18.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.990+0000 7f5e72834780 1 < suggested update operation key=ZM1YKZOUFSCY tag=K28P07SKTI8R type=del size=799377 2024-02-23T06:34:18.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.992+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~RLE1M62CSURQ.0 size=1048576 2024-02-23T06:34:18.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.993+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~RLE1M62CSURQ.1 size=369541 2024-02-23T06:34:18.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.993+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=RLE1M62CSURQ tag=STDL0CKABLHQ type=write size=2466693 2024-02-23T06:34:18.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.995+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=DPFH8TTGZPSH type=write size=777632 2024-02-23T06:34:18.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.996+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=JH1FN2XHML9M type=write size=33158 2024-02-23T06:34:18.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.998+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~RAWZ3997D8QD.0 size=1048576 2024-02-23T06:34:18.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:18.999+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~RAWZ3997D8QD.1 size=840643 2024-02-23T06:34:19.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.001+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=RAWZ3997D8QD tag=8STJKO8ZQGGC type=write size=2937795 2024-02-23T06:34:19.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.003+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=FV9Q132LSNFB type=del size=612871 2024-02-23T06:34:19.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.003+0000 7f5e72834780 1 < canceled part key=_multipart_R4YA9DUAJABL.2~Z7IAUM71LB6W.0 size=445581 2024-02-23T06:34:19.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.005+0000 7f5e72834780 1 < canceled multipart upload key=R4YA9DUAJABL upload=Z7IAUM71LB6W tag=NEWPYGH0T88J type=write size=1494157 2024-02-23T06:34:19.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.006+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=89UIWK7F715V type=del size=682666 2024-02-23T06:34:19.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.008+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~G519SLM3TJN1.0 size=1048576 2024-02-23T06:34:19.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.009+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~G519SLM3TJN1.1 size=68295 2024-02-23T06:34:19.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.011+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=G519SLM3TJN1 tag=WH3YHUL83LAM type=write size=2165447 2024-02-23T06:34:19.012 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.012+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=3X7KQ0S2S1P4 type=del size=162770 2024-02-23T06:34:19.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.013+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=EDLOS4J8FWHM type=del 2024-02-23T06:34:19.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.015+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=3T9MNUZNJ6HT type=del size=1369360 2024-02-23T06:34:19.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.016+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~RC3ZYVS71MVJ.0 size=1048576 2024-02-23T06:34:19.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.017+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~RC3ZYVS71MVJ.1 size=1048576 2024-02-23T06:34:19.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.018+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~RC3ZYVS71MVJ.2 size=876950 2024-02-23T06:34:19.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.020+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=RC3ZYVS71MVJ tag=HXJCWEE1FAO3 type=write size=4022678 2024-02-23T06:34:19.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.022+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=ZBDN0TRSGUV4 type=del size=3254980 2024-02-23T06:34:19.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.023+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=SYE5YN4DER76 type=del 2024-02-23T06:34:19.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.024+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=X20A1EZ3GOCE type=write size=389053 2024-02-23T06:34:19.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.026+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=FTP6DWVUMCZD type=del 2024-02-23T06:34:19.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.027+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=4RDLRG45ZRDM type=del size=656363 2024-02-23T06:34:19.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.029+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=0PKLDVPLUP6T type=del 2024-02-23T06:34:19.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.030+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=3EI7Y8W60TJZ type=del size=864515 2024-02-23T06:34:19.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.032+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=MM210W3JSF4B type=del 2024-02-23T06:34:19.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.033+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=2DBF7PHQC4E5 type=del size=3707377 2024-02-23T06:34:19.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.035+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=FWHJC1MCTBUH type=del 2024-02-23T06:34:19.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.036+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=121644LT8PZV type=del size=575878 2024-02-23T06:34:19.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.036+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~RJUMXQ1LETX3.0 size=1048576 2024-02-23T06:34:19.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.037+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~RJUMXQ1LETX3.1 size=1048576 2024-02-23T06:34:19.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.039+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~RJUMXQ1LETX3.2 size=339902 2024-02-23T06:34:19.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.041+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=RJUMXQ1LETX3 tag=1UJZAONG1PD2 type=write size=3485630 2024-02-23T06:34:19.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.044+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~SN6XRSN5JIGO.0 size=1048576 2024-02-23T06:34:19.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.045+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~SN6XRSN5JIGO.1 size=1048576 2024-02-23T06:34:19.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.046+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~SN6XRSN5JIGO.2 size=54103 2024-02-23T06:34:19.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.046+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=SN6XRSN5JIGO tag=516XH3B40BZM type=write size=3199831 2024-02-23T06:34:19.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.047+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=YQPIP1I1DWBC type=del 2024-02-23T06:34:19.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.050+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~K5VHGBC6NT2C.0 size=1048576 2024-02-23T06:34:19.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.051+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~K5VHGBC6NT2C.1 size=1048576 2024-02-23T06:34:19.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.052+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~K5VHGBC6NT2C.2 size=625508 2024-02-23T06:34:19.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.052+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=K5VHGBC6NT2C tag=6D57CXS6AHDR type=write size=3771236 2024-02-23T06:34:19.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.053+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~ISRQVKK6PRN7.0 size=1048576 2024-02-23T06:34:19.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.053+0000 7f5e72834780 1 < canceled part key=_multipart_LUERFL6AN6HF.2~ISRQVKK6PRN7.1 size=328167 2024-02-23T06:34:19.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.055+0000 7f5e72834780 1 < canceled multipart upload key=LUERFL6AN6HF upload=ISRQVKK6PRN7 tag=NQ305Z3JGC3G type=write size=2425319 2024-02-23T06:34:19.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.057+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=64MPRN3J0FHW type=del size=836785 2024-02-23T06:34:19.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.058+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~LDJU2LHV160L.0 size=1048576 2024-02-23T06:34:19.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.059+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~LDJU2LHV160L.1 size=24269 2024-02-23T06:34:19.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.061+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=LDJU2LHV160L tag=K4UILCCEEV90 type=write size=2121421 2024-02-23T06:34:19.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.062+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=3A14O8LB1GRH type=write size=441440 2024-02-23T06:34:19.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.064+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~RLE1M62CSURQ.0 size=1048576 2024-02-23T06:34:19.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.065+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~RLE1M62CSURQ.1 size=369541 2024-02-23T06:34:19.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.067+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=RLE1M62CSURQ tag=STDL0CKABLHQ type=write size=2466693 2024-02-23T06:34:19.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.071+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~60EB8YC0W2OG.0 size=1048576 2024-02-23T06:34:19.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.072+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~60EB8YC0W2OG.1 size=1048576 2024-02-23T06:34:19.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.073+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~60EB8YC0W2OG.2 size=375533 2024-02-23T06:34:19.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.073+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=60EB8YC0W2OG tag=J4XZQ9V4DPRF type=write size=3521261 2024-02-23T06:34:19.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.074+0000 7f5e72834780 1 < completed write operation key=LUERFL6AN6HF tag=JH1FN2XHML9M type=write size=33158 2024-02-23T06:34:19.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.075+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=2AP442ALLC4D type=del size=1522682 2024-02-23T06:34:19.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.077+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=FV9Q132LSNFB type=del 2024-02-23T06:34:19.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.078+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=45LSH8DSROT7 type=write size=89937 2024-02-23T06:34:19.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.079+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=89UIWK7F715V type=del 2024-02-23T06:34:19.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.080+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=SIJSO1XEH0CI type=del size=68512 2024-02-23T06:34:19.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.082+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=3X7KQ0S2S1P4 type=del 2024-02-23T06:34:19.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.084+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~0BPA8GG516E9.0 size=768433 2024-02-23T06:34:19.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.084+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=0BPA8GG516E9 tag=T3WL8009WOLB type=write size=1817009 2024-02-23T06:34:19.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.085+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=3T9MNUZNJ6HT type=del 2024-02-23T06:34:19.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.087+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~EQOBKIONPPEB.0 size=1048576 2024-02-23T06:34:19.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.088+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~EQOBKIONPPEB.1 size=277715 2024-02-23T06:34:19.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.088+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=EQOBKIONPPEB tag=I9FE1EUHS06H type=write size=2374867 2024-02-23T06:34:19.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.090+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=ZBDN0TRSGUV4 type=del 2024-02-23T06:34:19.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.092+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~8OI6TBH04H2E.0 size=1048576 2024-02-23T06:34:19.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.092+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~8OI6TBH04H2E.1 size=1048576 2024-02-23T06:34:19.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.093+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~8OI6TBH04H2E.2 size=87149 2024-02-23T06:34:19.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.093+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=8OI6TBH04H2E tag=S2Q4PX80MAZN type=write size=3232877 2024-02-23T06:34:19.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.095+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=X20A1EZ3GOCE type=write size=389053 2024-02-23T06:34:19.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.097+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~MA8Y8BRIFA4G.0 size=232982 2024-02-23T06:34:19.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.097+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=MA8Y8BRIFA4G tag=WJCBO0HJ3DYW type=write size=1281558 2024-02-23T06:34:19.099 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.099+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=4RDLRG45ZRDM type=del 2024-02-23T06:34:19.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.101+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~AY3KYBEGGPT5.0 size=768125 2024-02-23T06:34:19.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.101+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=AY3KYBEGGPT5 tag=72RE2F7OFQM5 type=write size=1816701 2024-02-23T06:34:19.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.102+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=3EI7Y8W60TJZ type=del 2024-02-23T06:34:19.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.103+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=FN726ZYU09NA type=del size=2453268 2024-02-23T06:34:19.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.105+0000 7f5e72834780 1 < suggested remove operation key=GWTK3YV0RY21 tag=2DBF7PHQC4E5 type=del 2024-02-23T06:34:19.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.106+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=S14NLJ9F2P6C type=del size=1536998 2024-02-23T06:34:19.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.108+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=121644LT8PZV type=del 2024-02-23T06:34:19.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.109+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=TVKGKTKW3T42 type=write size=827647 2024-02-23T06:34:19.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.110+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~SN6XRSN5JIGO.0 size=1048576 2024-02-23T06:34:19.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.111+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~SN6XRSN5JIGO.1 size=1048576 2024-02-23T06:34:19.112 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.112+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~SN6XRSN5JIGO.2 size=54103 2024-02-23T06:34:19.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.114+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=SN6XRSN5JIGO tag=516XH3B40BZM type=write size=3199831 2024-02-23T06:34:19.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.116+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~3YTGID9UUAM3.0 size=396221 2024-02-23T06:34:19.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.116+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=3YTGID9UUAM3 tag=8AXHISIQOBHH type=write size=1444797 2024-02-23T06:34:19.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.117+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~K5VHGBC6NT2C.0 size=1048576 2024-02-23T06:34:19.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.117+0000 7f5e72834780 1 < canceled part key=_multipart_LUERFL6AN6HF.2~K5VHGBC6NT2C.1 size=1048576 2024-02-23T06:34:19.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.118+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~K5VHGBC6NT2C.2 size=625508 2024-02-23T06:34:19.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.120+0000 7f5e72834780 1 < canceled multipart upload key=LUERFL6AN6HF upload=K5VHGBC6NT2C tag=6D57CXS6AHDR type=write size=3771236 2024-02-23T06:34:19.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.121+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=IQABAFJLEJDI type=del size=3402170 2024-02-23T06:34:19.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.124+0000 7f5e72834780 1 < suggested remove operation key=721UW0AGSKVR tag=64MPRN3J0FHW type=del 2024-02-23T06:34:19.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.126+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~JOD9XL43F2P2.0 size=479597 2024-02-23T06:34:19.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.126+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=JOD9XL43F2P2 tag=76VICRQILXQZ type=write size=1528173 2024-02-23T06:34:19.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.127+0000 7f5e72834780 1 < completed write operation key=M5LH10WTDP0P tag=3A14O8LB1GRH type=write size=441440 2024-02-23T06:34:19.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.128+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=ODZWB4QL8NEV type=write size=783921 2024-02-23T06:34:19.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.129+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~60EB8YC0W2OG.0 size=1048576 2024-02-23T06:34:19.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.130+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~60EB8YC0W2OG.1 size=1048576 2024-02-23T06:34:19.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.131+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~60EB8YC0W2OG.2 size=375533 2024-02-23T06:34:19.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.133+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=60EB8YC0W2OG tag=J4XZQ9V4DPRF type=write size=3521261 2024-02-23T06:34:19.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.134+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=SI3T4J4Y4808 type=del size=3237344 2024-02-23T06:34:19.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.135+0000 7f5e72834780 -1 < failed to complete operation key=GWTK3YV0RY21 tag=2AP442ALLC4D type=del size=1522682: (22) Invalid argument 2024-02-23T06:34:19.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.136+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=0QIA33K0XUIZ type=del size=3721442 2024-02-23T06:34:19.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.138+0000 7f5e72834780 1 < canceled operation key=TPADM4812N0Z tag=45LSH8DSROT7 type=write size=89937 2024-02-23T06:34:19.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.140+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~2SLHQCN014KX.0 size=140566 2024-02-23T06:34:19.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.140+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=2SLHQCN014KX tag=8J2T92V40RVS type=write size=1189142 2024-02-23T06:34:19.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.141+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=SIJSO1XEH0CI type=del 2024-02-23T06:34:19.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.143+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~Z7WSH9WOSFRU.0 size=1048576 2024-02-23T06:34:19.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.144+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~Z7WSH9WOSFRU.1 size=1048576 2024-02-23T06:34:19.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.145+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~Z7WSH9WOSFRU.2 size=42844 2024-02-23T06:34:19.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.145+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=Z7WSH9WOSFRU tag=UP4OPF8LB3JF type=write size=3188572 2024-02-23T06:34:19.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.147+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~0BPA8GG516E9.0 size=768433 2024-02-23T06:34:19.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.148+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=0BPA8GG516E9 tag=T3WL8009WOLB type=write size=1817009 2024-02-23T06:34:19.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.150+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=7RG9EKSUFLBM type=del size=1341184 2024-02-23T06:34:19.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.151+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~EQOBKIONPPEB.0 size=1048576 2024-02-23T06:34:19.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.152+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~EQOBKIONPPEB.1 size=277715 2024-02-23T06:34:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.154+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=EQOBKIONPPEB tag=I9FE1EUHS06H type=write size=2374867 2024-02-23T06:34:19.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.155+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=TO5MWD5PUQ53 type=del size=2305994 2024-02-23T06:34:19.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.156+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~8OI6TBH04H2E.0 size=1048576 2024-02-23T06:34:19.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.157+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~8OI6TBH04H2E.1 size=1048576 2024-02-23T06:34:19.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.157+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~8OI6TBH04H2E.2 size=87149 2024-02-23T06:34:19.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.159+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=8OI6TBH04H2E tag=S2Q4PX80MAZN type=write size=3232877 2024-02-23T06:34:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.161+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~PTGX3BVCP2K1.0 size=1048576 2024-02-23T06:34:19.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.161+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~PTGX3BVCP2K1.1 size=228742 2024-02-23T06:34:19.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.162+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=PTGX3BVCP2K1 tag=7L64RQVUCIZD type=write size=2325894 2024-02-23T06:34:19.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.163+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~MA8Y8BRIFA4G.0 size=232982 2024-02-23T06:34:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.165+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=MA8Y8BRIFA4G tag=WJCBO0HJ3DYW type=write size=1281558 2024-02-23T06:34:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.166+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=KME1827E131U type=del size=2783185 2024-02-23T06:34:19.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.167+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~AY3KYBEGGPT5.0 size=768125 2024-02-23T06:34:19.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.169+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=AY3KYBEGGPT5 tag=72RE2F7OFQM5 type=write size=1816701 2024-02-23T06:34:19.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.171+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~NS62RKNE0B8Z.0 size=786635 2024-02-23T06:34:19.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.171+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=NS62RKNE0B8Z tag=GHDA1E88LMIR type=write size=1835211 2024-02-23T06:34:19.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.172+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=FN726ZYU09NA type=del 2024-02-23T06:34:19.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.173+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=ZF0BQD7F0XWK type=del size=1989781 2024-02-23T06:34:19.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.174+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=S14NLJ9F2P6C type=del 2024-02-23T06:34:19.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.176+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~298Y8XY31ULB.0 size=1599 2024-02-23T06:34:19.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.176+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=298Y8XY31ULB tag=WHMYW5S1E0S7 type=write size=1050175 2024-02-23T06:34:19.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.178+0000 7f5e72834780 1 < completed write operation key=4M7BT05YB0C3 tag=TVKGKTKW3T42 type=write size=827647 2024-02-23T06:34:19.179 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.179+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=0915YPG8J3DY type=write size=43207 2024-02-23T06:34:19.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.180+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~3YTGID9UUAM3.0 size=396221 2024-02-23T06:34:19.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.182+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=3YTGID9UUAM3 tag=8AXHISIQOBHH type=write size=1444797 2024-02-23T06:34:19.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.183+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=DQFAVCEPFZT0 type=del size=2865986 2024-02-23T06:34:19.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.185+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=IQABAFJLEJDI type=del 2024-02-23T06:34:19.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.186+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=JHO3L3IW5CKD type=del size=1814697 2024-02-23T06:34:19.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.187+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~JOD9XL43F2P2.0 size=479597 2024-02-23T06:34:19.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.189+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=JOD9XL43F2P2 tag=76VICRQILXQZ type=write size=1528173 2024-02-23T06:34:19.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.190+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=TYS76YANOWIY type=del size=89126 2024-02-23T06:34:19.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.192+0000 7f5e72834780 1 < completed write operation key=IDTA5RV6IUF6 tag=ODZWB4QL8NEV type=write size=783921 2024-02-23T06:34:19.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.193+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=PG970OVPY4AJ type=del size=773040 2024-02-23T06:34:19.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.194+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=SI3T4J4Y4808 type=del 2024-02-23T06:34:19.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.196+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=8DI7A4TNYON8 type=del size=579499 2024-02-23T06:34:19.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.197+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=0QIA33K0XUIZ type=del 2024-02-23T06:34:19.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.199+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~75M2UW8849QD.0 size=636595 2024-02-23T06:34:19.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.199+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=75M2UW8849QD tag=11NPZRYOHV3R type=write size=1685171 2024-02-23T06:34:19.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.201+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~2SLHQCN014KX.0 size=140566 2024-02-23T06:34:19.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.203+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=2SLHQCN014KX tag=8J2T92V40RVS type=write size=1189142 2024-02-23T06:34:19.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.204+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=Q1N1P3F0E93F type=write size=162108 2024-02-23T06:34:19.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.205+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~Z7WSH9WOSFRU.0 size=1048576 2024-02-23T06:34:19.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.206+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~Z7WSH9WOSFRU.1 size=1048576 2024-02-23T06:34:19.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.206+0000 7f5e72834780 1 < canceled part key=_multipart_7N8OH7EETRN8.2~Z7WSH9WOSFRU.2 size=42844 2024-02-23T06:34:19.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.208+0000 7f5e72834780 1 < canceled multipart upload key=7N8OH7EETRN8 upload=Z7WSH9WOSFRU tag=UP4OPF8LB3JF type=write size=3188572 2024-02-23T06:34:19.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.209+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=YKAFRJGJN6BK type=del size=1729474 2024-02-23T06:34:19.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.210+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=7RG9EKSUFLBM type=del 2024-02-23T06:34:19.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.212+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~ZRYIA93FWKAE.0 size=206672 2024-02-23T06:34:19.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.212+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=ZRYIA93FWKAE tag=A3OUF24UDLPB type=write size=1255248 2024-02-23T06:34:19.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.213+0000 7f5e72834780 1 < canceled operation key=RS03NUABC1U2 tag=TO5MWD5PUQ53 type=del size=2305994 2024-02-23T06:34:19.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.215+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=4R10QNOH4BNF type=del size=3396779 2024-02-23T06:34:19.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.216+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~PTGX3BVCP2K1.0 size=1048576 2024-02-23T06:34:19.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.217+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~PTGX3BVCP2K1.1 size=228742 2024-02-23T06:34:19.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.219+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=PTGX3BVCP2K1 tag=7L64RQVUCIZD type=write size=2325894 2024-02-23T06:34:19.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.220+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=ZTKFQSI23BRI type=del size=3169429 2024-02-23T06:34:19.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.221+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=KME1827E131U type=del 2024-02-23T06:34:19.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.222+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=UFF3DLXFI71Q type=write size=657413 2024-02-23T06:34:19.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.223+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~NS62RKNE0B8Z.0 size=786635 2024-02-23T06:34:19.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.225+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=NS62RKNE0B8Z tag=GHDA1E88LMIR type=write size=1835211 2024-02-23T06:34:19.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.226+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=NGUYCFDNKEY7 type=del size=1592096 2024-02-23T06:34:19.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.228+0000 7f5e72834780 1 < suggested remove operation key=26EE3EHDK8EM tag=ZF0BQD7F0XWK type=del 2024-02-23T06:34:19.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.230+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~NWRYPVT8IGC2.0 size=1048576 2024-02-23T06:34:19.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.231+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~NWRYPVT8IGC2.1 size=871491 2024-02-23T06:34:19.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.231+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=NWRYPVT8IGC2 tag=23ZG0ZY92M9Y type=write size=2968643 2024-02-23T06:34:19.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.232+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~298Y8XY31ULB.0 size=1599 2024-02-23T06:34:19.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.234+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=298Y8XY31ULB tag=WHMYW5S1E0S7 type=write size=1050175 2024-02-23T06:34:19.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.235+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=IA7I3ZXQ1BIA type=del size=3471392 2024-02-23T06:34:19.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.236+0000 7f5e72834780 1 < canceled operation key=QZLNM2RQ9SDC tag=0915YPG8J3DY type=write size=43207 2024-02-23T06:34:19.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.238+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~TPP6SEB2Z48C.0 size=1048576 2024-02-23T06:34:19.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.239+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~TPP6SEB2Z48C.1 size=895538 2024-02-23T06:34:19.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.239+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=TPP6SEB2Z48C tag=8L5ILTO10M58 type=write size=2992690 2024-02-23T06:34:19.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.240+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=DQFAVCEPFZT0 type=del 2024-02-23T06:34:19.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.241+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=HWSO8EW5GTYM type=del size=2435817 2024-02-23T06:34:19.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.243+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=JHO3L3IW5CKD type=del 2024-02-23T06:34:19.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.244+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=H7WXC41J67RM type=del size=1244923 2024-02-23T06:34:19.245 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.245+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=TYS76YANOWIY type=del 2024-02-23T06:34:19.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.247+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~IDCBG1M2S861.0 size=1048576 2024-02-23T06:34:19.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.248+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~IDCBG1M2S861.1 size=1048576 2024-02-23T06:34:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.249+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~IDCBG1M2S861.2 size=764287 2024-02-23T06:34:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.249+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=IDCBG1M2S861 tag=W9JRWP7RRO6N type=write size=3910015 2024-02-23T06:34:19.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.252+0000 7f5e72834780 1 < suggested remove operation key=M5LH10WTDP0P tag=PG970OVPY4AJ type=del 2024-02-23T06:34:19.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.254+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~74LVFN7BADF7.0 size=1048576 2024-02-23T06:34:19.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.255+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~74LVFN7BADF7.1 size=1048576 2024-02-23T06:34:19.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.256+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~74LVFN7BADF7.2 size=35343 2024-02-23T06:34:19.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.256+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=74LVFN7BADF7 tag=OIK5EUEH6P5D type=write size=3181071 2024-02-23T06:34:19.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.258+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=8DI7A4TNYON8 type=del 2024-02-23T06:34:19.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.260+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~ZTM10UWDARSH.0 size=1048576 2024-02-23T06:34:19.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.261+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~ZTM10UWDARSH.1 size=790560 2024-02-23T06:34:19.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.261+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=ZTM10UWDARSH tag=J13U63L4VQGU type=write size=2887712 2024-02-23T06:34:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.262+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~75M2UW8849QD.0 size=636595 2024-02-23T06:34:19.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.264+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=75M2UW8849QD tag=11NPZRYOHV3R type=write size=1685171 2024-02-23T06:34:19.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.266+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=TX4WOT205AHM type=del size=3891465 2024-02-23T06:34:19.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.267+0000 7f5e72834780 1 < canceled operation key=QGGULCYZ0ZSA tag=Q1N1P3F0E93F type=write size=162108 2024-02-23T06:34:19.269 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.269+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~H04F1OE6PUSS.0 size=1048576 2024-02-23T06:34:19.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.270+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~H04F1OE6PUSS.1 size=389961 2024-02-23T06:34:19.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.270+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=H04F1OE6PUSS tag=5A1R0ZFDIVLN type=write size=2487113 2024-02-23T06:34:19.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.271+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=YKAFRJGJN6BK type=del 2024-02-23T06:34:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.272+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=4UXO0MJL25G0 type=del size=2301053 2024-02-23T06:34:19.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.273+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~ZRYIA93FWKAE.0 size=206672 2024-02-23T06:34:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.275+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=ZRYIA93FWKAE tag=A3OUF24UDLPB type=write size=1255248 2024-02-23T06:34:19.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.276+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=BTLBIWG6H0MW type=write size=732134 2024-02-23T06:34:19.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.277+0000 7f5e72834780 1 < canceled operation key=GACVVXC2Z1YO tag=4R10QNOH4BNF type=del size=3396779 2024-02-23T06:34:19.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.279+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~TPTZPT5R2536.0 size=633910 2024-02-23T06:34:19.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.279+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=TPTZPT5R2536 tag=UEADDIA3SN91 type=write size=1682486 2024-02-23T06:34:19.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.281+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=ZTKFQSI23BRI type=del 2024-02-23T06:34:19.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.283+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~JA8UTM09Z4SQ.0 size=389891 2024-02-23T06:34:19.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.283+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=JA8UTM09Z4SQ tag=K9PUDO2D2PMF type=write size=1438467 2024-02-23T06:34:19.284 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.284+0000 7f5e72834780 1 < completed write operation key=721UW0AGSKVR tag=UFF3DLXFI71Q type=write size=657413 2024-02-23T06:34:19.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.286+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~4CN985ZG6JVN.0 size=1048576 2024-02-23T06:34:19.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.287+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~4CN985ZG6JVN.1 size=1048576 2024-02-23T06:34:19.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.288+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~4CN985ZG6JVN.2 size=349263 2024-02-23T06:34:19.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.288+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=4CN985ZG6JVN tag=VJ7OTSO9NF5I type=write size=3494991 2024-02-23T06:34:19.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.289+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=NGUYCFDNKEY7 type=del 2024-02-23T06:34:19.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.290+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=E967XI58YC7R type=write size=660859 2024-02-23T06:34:19.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.292+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~NWRYPVT8IGC2.0 size=1048576 2024-02-23T06:34:19.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.293+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~NWRYPVT8IGC2.1 size=871491 2024-02-23T06:34:19.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.295+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=NWRYPVT8IGC2 tag=23ZG0ZY92M9Y type=write size=2968643 2024-02-23T06:34:19.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.296+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=ZYKPZNXGXZSG type=del size=1498198 2024-02-23T06:34:19.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.297+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=IA7I3ZXQ1BIA type=del 2024-02-23T06:34:19.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.299+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=55C331OXFV8M type=del size=1617560 2024-02-23T06:34:19.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.299+0000 7f5e72834780 1 < canceled part key=_multipart_03P6IEKSHB17.2~TPP6SEB2Z48C.0 size=1048576 2024-02-23T06:34:19.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.300+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~TPP6SEB2Z48C.1 size=895538 2024-02-23T06:34:19.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.303+0000 7f5e72834780 1 < canceled multipart upload key=03P6IEKSHB17 upload=TPP6SEB2Z48C tag=8L5ILTO10M58 type=write size=2992690 2024-02-23T06:34:19.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.304+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=XCWQ2RXA9AAL type=del size=3810471 2024-02-23T06:34:19.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.307+0000 7f5e72834780 1 < suggested update operation key=ZC75CQ2789VE tag=HWSO8EW5GTYM type=del size=2435817 2024-02-23T06:34:19.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.308+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=JWNLXATOWW8A type=del size=1640738 2024-02-23T06:34:19.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.309+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=H7WXC41J67RM type=del 2024-02-23T06:34:19.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.311+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=C7SPCZ002IAZ type=del size=1364392 2024-02-23T06:34:19.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.312+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~IDCBG1M2S861.0 size=1048576 2024-02-23T06:34:19.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.313+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~IDCBG1M2S861.1 size=1048576 2024-02-23T06:34:19.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.314+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~IDCBG1M2S861.2 size=764287 2024-02-23T06:34:19.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.316+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=IDCBG1M2S861 tag=W9JRWP7RRO6N type=write size=3910015 2024-02-23T06:34:19.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.318+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~V6KYNT9L52QV.0 size=90719 2024-02-23T06:34:19.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.318+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=V6KYNT9L52QV tag=OSMXVOIIB9ET type=write size=1139295 2024-02-23T06:34:19.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.319+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~74LVFN7BADF7.0 size=1048576 2024-02-23T06:34:19.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.320+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~74LVFN7BADF7.1 size=1048576 2024-02-23T06:34:19.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.321+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~74LVFN7BADF7.2 size=35343 2024-02-23T06:34:19.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.323+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=74LVFN7BADF7 tag=OIK5EUEH6P5D type=write size=3181071 2024-02-23T06:34:19.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.324+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=1GU1M436N1XS type=del size=3709606 2024-02-23T06:34:19.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.325+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~ZTM10UWDARSH.0 size=1048576 2024-02-23T06:34:19.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.326+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~ZTM10UWDARSH.1 size=790560 2024-02-23T06:34:19.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.328+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=ZTM10UWDARSH tag=J13U63L4VQGU type=write size=2887712 2024-02-23T06:34:19.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.330+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=HKDYF3OTPRIV type=write size=41921 2024-02-23T06:34:19.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.331+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=TX4WOT205AHM type=del 2024-02-23T06:34:19.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.332+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=YS419WEOMKVT type=del size=4153226 2024-02-23T06:34:19.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.334+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~H04F1OE6PUSS.0 size=1048576 2024-02-23T06:34:19.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.335+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~H04F1OE6PUSS.1 size=389961 2024-02-23T06:34:19.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.337+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=H04F1OE6PUSS tag=5A1R0ZFDIVLN type=write size=2487113 2024-02-23T06:34:19.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.339+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~YB3UV3A2P2ZV.0 size=871723 2024-02-23T06:34:19.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.339+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=YB3UV3A2P2ZV tag=MUT695ORJK70 type=write size=1920299 2024-02-23T06:34:19.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.340+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=4UXO0MJL25G0 type=del 2024-02-23T06:34:19.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.341+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=FP6CT0S7XDHU type=del size=2650136 2024-02-23T06:34:19.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.343+0000 7f5e72834780 1 < completed write operation key=883VBT1ADE6K tag=BTLBIWG6H0MW type=write size=732134 2024-02-23T06:34:19.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.344+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=XP37PWZA5LOX type=del size=2704034 2024-02-23T06:34:19.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.345+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~TPTZPT5R2536.0 size=633910 2024-02-23T06:34:19.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.347+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=TPTZPT5R2536 tag=UEADDIA3SN91 type=write size=1682486 2024-02-23T06:34:19.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.348+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=UF8XEKLL2J4T type=del size=586776 2024-02-23T06:34:19.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.349+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~JA8UTM09Z4SQ.0 size=389891 2024-02-23T06:34:19.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.351+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=JA8UTM09Z4SQ tag=K9PUDO2D2PMF type=write size=1438467 2024-02-23T06:34:19.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.353+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~LXDFMO35UQFK.0 size=1048576 2024-02-23T06:34:19.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.354+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~LXDFMO35UQFK.1 size=20852 2024-02-23T06:34:19.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.354+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=LXDFMO35UQFK tag=HIW11YZWF6IB type=write size=2118004 2024-02-23T06:34:19.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.355+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~4CN985ZG6JVN.0 size=1048576 2024-02-23T06:34:19.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.356+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~4CN985ZG6JVN.1 size=1048576 2024-02-23T06:34:19.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.357+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~4CN985ZG6JVN.2 size=349263 2024-02-23T06:34:19.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.359+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=4CN985ZG6JVN tag=VJ7OTSO9NF5I type=write size=3494991 2024-02-23T06:34:19.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.361+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~2X3DBFSGUYV1.0 size=745098 2024-02-23T06:34:19.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.361+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=2X3DBFSGUYV1 tag=EJEH5FPR4LYR type=write size=1793674 2024-02-23T06:34:19.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.363+0000 7f5e72834780 1 < completed write operation key=8Q6WC7B9BY5Q tag=E967XI58YC7R type=write size=660859 2024-02-23T06:34:19.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.364+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=OKMX409BROYO type=del size=1455886 2024-02-23T06:34:19.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.365+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=ZYKPZNXGXZSG type=del 2024-02-23T06:34:19.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.366+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=A7432OXTT4RU type=write size=541348 2024-02-23T06:34:19.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.367+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=55C331OXFV8M type=del 2024-02-23T06:34:19.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.369+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~0U8O2N4DDDVG.0 size=1048576 2024-02-23T06:34:19.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.370+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~0U8O2N4DDDVG.1 size=796087 2024-02-23T06:34:19.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.370+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=0U8O2N4DDDVG tag=E8MWJLDFSGNE type=write size=2893239 2024-02-23T06:34:19.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.371+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=XCWQ2RXA9AAL type=del 2024-02-23T06:34:19.373 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.373+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=63Z2N2RE687Z type=write size=210684 2024-02-23T06:34:19.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.374+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=JWNLXATOWW8A type=del 2024-02-23T06:34:19.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.375+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=K7CY4MBCOG7Q type=del size=497194 2024-02-23T06:34:19.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.376+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=C7SPCZ002IAZ type=del 2024-02-23T06:34:19.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.378+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~95QNJJ2J4QXW.0 size=1048576 2024-02-23T06:34:19.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.379+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~95QNJJ2J4QXW.1 size=507327 2024-02-23T06:34:19.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.379+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=95QNJJ2J4QXW tag=X5FON8HTZVUV type=write size=2604479 2024-02-23T06:34:19.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.379+0000 7f5e72834780 1 < canceled part key=_multipart_RS03NUABC1U2.2~V6KYNT9L52QV.0 size=90719 2024-02-23T06:34:19.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.381+0000 7f5e72834780 1 < canceled multipart upload key=RS03NUABC1U2 upload=V6KYNT9L52QV tag=OSMXVOIIB9ET type=write size=1139295 2024-02-23T06:34:19.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.383+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~EF4HV78JZSSU.0 size=322111 2024-02-23T06:34:19.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.383+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=EF4HV78JZSSU tag=DOZNBMTVBEZS type=write size=1370687 2024-02-23T06:34:19.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.384+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=1GU1M436N1XS type=del 2024-02-23T06:34:19.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.385+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=Y3DMWCURRAMF type=write size=308302 2024-02-23T06:34:19.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.386+0000 7f5e72834780 1 < completed write operation key=M5LH10WTDP0P tag=HKDYF3OTPRIV type=write size=41921 2024-02-23T06:34:19.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.387+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=HPFKBS7TZA62 type=del size=3634595 2024-02-23T06:34:19.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.389+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=YS419WEOMKVT type=del 2024-02-23T06:34:19.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.391+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~J224S5RJTFSX.0 size=1048576 2024-02-23T06:34:19.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.394+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~J224S5RJTFSX.1 size=1048576 2024-02-23T06:34:19.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.394+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~J224S5RJTFSX.2 size=598942 2024-02-23T06:34:19.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.394+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=J224S5RJTFSX tag=J3DLL0I4U7Y3 type=write size=3744670 2024-02-23T06:34:19.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.396+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~YB3UV3A2P2ZV.0 size=871723 2024-02-23T06:34:19.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.398+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=YB3UV3A2P2ZV tag=MUT695ORJK70 type=write size=1920299 2024-02-23T06:34:19.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.400+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~C4ZZGUIH8L1P.0 size=1048576 2024-02-23T06:34:19.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.401+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~C4ZZGUIH8L1P.1 size=1048576 2024-02-23T06:34:19.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.401+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~C4ZZGUIH8L1P.2 size=653531 2024-02-23T06:34:19.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.401+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=C4ZZGUIH8L1P tag=ZQDHSD9J26TO type=write size=3799259 2024-02-23T06:34:19.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.404+0000 7f5e72834780 1 < suggested remove operation key=ZM1YKZOUFSCY tag=FP6CT0S7XDHU type=del 2024-02-23T06:34:19.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.406+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~E54QRRGVIAWP.0 size=1048576 2024-02-23T06:34:19.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.407+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~E54QRRGVIAWP.1 size=1048576 2024-02-23T06:34:19.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.408+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~E54QRRGVIAWP.2 size=1004575 2024-02-23T06:34:19.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.408+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=E54QRRGVIAWP tag=004C6QMUETKL type=write size=4150303 2024-02-23T06:34:19.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.408+0000 7f5e72834780 -1 < no bi entry to suggest for operation key=ZM1YKZOUFSCY tag=XP37PWZA5LOX type=del size=2704034: (2) No such file or directory 2024-02-23T06:34:19.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.409+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=755FMMFPL6EP type=del size=3450356 2024-02-23T06:34:19.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.411+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=UF8XEKLL2J4T type=del 2024-02-23T06:34:19.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.412+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=WQEQLA2NT0EV type=del size=2777127 2024-02-23T06:34:19.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.413+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~LXDFMO35UQFK.0 size=1048576 2024-02-23T06:34:19.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.413+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~LXDFMO35UQFK.1 size=20852 2024-02-23T06:34:19.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.416+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=LXDFMO35UQFK tag=HIW11YZWF6IB type=write size=2118004 2024-02-23T06:34:19.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.417+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=NF8JZZI8GZQZ type=del size=1904254 2024-02-23T06:34:19.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.418+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~2X3DBFSGUYV1.0 size=745098 2024-02-23T06:34:19.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.420+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=2X3DBFSGUYV1 tag=EJEH5FPR4LYR type=write size=1793674 2024-02-23T06:34:19.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.421+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=YYB3RSMWAYWI type=del size=2040529 2024-02-23T06:34:19.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.422+0000 7f5e72834780 -1 < failed to complete operation key=ZM1YKZOUFSCY tag=OKMX409BROYO type=del size=1455886: (22) Invalid argument 2024-02-23T06:34:19.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.423+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=TCIJ7F9ZUH3K type=del size=2140820 2024-02-23T06:34:19.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.425+0000 7f5e72834780 -1 < failed to complete operation key=ZM1YKZOUFSCY tag=A7432OXTT4RU type=write size=541348: (22) Invalid argument 2024-02-23T06:34:19.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.426+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=494A1E0OGWEZ type=del size=2525222 2024-02-23T06:34:19.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.426+0000 7f5e72834780 1 < canceled part key=_multipart_GW6EKQ84FQ6L.2~0U8O2N4DDDVG.0 size=1048576 2024-02-23T06:34:19.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.427+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~0U8O2N4DDDVG.1 size=796087 2024-02-23T06:34:19.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.429+0000 7f5e72834780 1 < canceled multipart upload key=GW6EKQ84FQ6L upload=0U8O2N4DDDVG tag=E8MWJLDFSGNE type=write size=2893239 2024-02-23T06:34:19.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.431+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~PM85BKLQR42G.0 size=846811 2024-02-23T06:34:19.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.431+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=PM85BKLQR42G tag=E7EEI13BCSXQ type=write size=1895387 2024-02-23T06:34:19.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.433+0000 7f5e72834780 1 < suggested update operation key=883VBT1ADE6K tag=63Z2N2RE687Z type=write size=210684 2024-02-23T06:34:19.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.435+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=1TBZQFNVPTJD type=del size=410223 2024-02-23T06:34:19.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.436+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=K7CY4MBCOG7Q type=del 2024-02-23T06:34:19.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.437+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=1KMQ7FPU0TOJ type=del size=1472380 2024-02-23T06:34:19.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.438+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~95QNJJ2J4QXW.0 size=1048576 2024-02-23T06:34:19.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.438+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~95QNJJ2J4QXW.1 size=507327 2024-02-23T06:34:19.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.440+0000 7f5e72834780 1 < canceled multipart upload key=26EE3EHDK8EM upload=95QNJJ2J4QXW tag=X5FON8HTZVUV type=write size=2604479 2024-02-23T06:34:19.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.442+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~F7NTEXSAPIG5.0 size=1048576 2024-02-23T06:34:19.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.443+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~F7NTEXSAPIG5.1 size=588425 2024-02-23T06:34:19.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.443+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=F7NTEXSAPIG5 tag=GL4TZAH3VYR2 type=write size=2685577 2024-02-23T06:34:19.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.444+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~EF4HV78JZSSU.0 size=322111 2024-02-23T06:34:19.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.446+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=EF4HV78JZSSU tag=DOZNBMTVBEZS type=write size=1370687 2024-02-23T06:34:19.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.448+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~2U6PT5KFII09.0 size=1048576 2024-02-23T06:34:19.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.449+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~2U6PT5KFII09.1 size=1048576 2024-02-23T06:34:19.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.449+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~2U6PT5KFII09.2 size=486505 2024-02-23T06:34:19.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.449+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=2U6PT5KFII09 tag=HXYMVILXVCBH type=write size=3632233 2024-02-23T06:34:19.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.452+0000 7f5e72834780 1 < suggested remove operation key=03P6IEKSHB17 tag=Y3DMWCURRAMF type=write 2024-02-23T06:34:19.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.453+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=D5T2B03CCRHL type=del size=1299447 2024-02-23T06:34:19.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.454+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=HPFKBS7TZA62 type=del 2024-02-23T06:34:19.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.455+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=W02ALFDLRNKJ type=del size=48580 2024-02-23T06:34:19.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.456+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~J224S5RJTFSX.0 size=1048576 2024-02-23T06:34:19.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.457+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~J224S5RJTFSX.1 size=1048576 2024-02-23T06:34:19.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.458+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~J224S5RJTFSX.2 size=598942 2024-02-23T06:34:19.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.460+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=J224S5RJTFSX tag=J3DLL0I4U7Y3 type=write size=3744670 2024-02-23T06:34:19.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.461+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=TRW87EJV4N7M type=del size=2375368 2024-02-23T06:34:19.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.462+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~C4ZZGUIH8L1P.0 size=1048576 2024-02-23T06:34:19.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.462+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~C4ZZGUIH8L1P.1 size=1048576 2024-02-23T06:34:19.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.463+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~C4ZZGUIH8L1P.2 size=653531 2024-02-23T06:34:19.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.466+0000 7f5e72834780 1 < canceled multipart upload key=ZC75CQ2789VE upload=C4ZZGUIH8L1P tag=ZQDHSD9J26TO type=write size=3799259 2024-02-23T06:34:19.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.468+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~E2RAFJKED5XX.0 size=1048576 2024-02-23T06:34:19.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.469+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~E2RAFJKED5XX.1 size=1048576 2024-02-23T06:34:19.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.470+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~E2RAFJKED5XX.2 size=181414 2024-02-23T06:34:19.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.470+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=E2RAFJKED5XX tag=916Z0EO03BUD type=write size=3327142 2024-02-23T06:34:19.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.471+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~E54QRRGVIAWP.0 size=1048576 2024-02-23T06:34:19.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.472+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~E54QRRGVIAWP.1 size=1048576 2024-02-23T06:34:19.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.475+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~E54QRRGVIAWP.2 size=1004575 2024-02-23T06:34:19.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.477+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=E54QRRGVIAWP tag=004C6QMUETKL type=write size=4150303 2024-02-23T06:34:19.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.479+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~4IAISTIGVCYG.0 size=48363 2024-02-23T06:34:19.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.479+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=4IAISTIGVCYG tag=9SAZT0TQ150C type=write size=1096939 2024-02-23T06:34:19.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.480+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=755FMMFPL6EP type=del 2024-02-23T06:34:19.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.481+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=LBYQCCLKNY1U type=del size=2686343 2024-02-23T06:34:19.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.482+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=WQEQLA2NT0EV type=del 2024-02-23T06:34:19.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.483+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=KRE2EQNRWJLU type=write size=726170 2024-02-23T06:34:19.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.486+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=NF8JZZI8GZQZ type=del size=1904254 2024-02-23T06:34:19.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.487+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~G36B21SHA9FO.0 size=1048576 2024-02-23T06:34:19.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.488+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~G36B21SHA9FO.1 size=1048576 2024-02-23T06:34:19.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.489+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~G36B21SHA9FO.2 size=220715 2024-02-23T06:34:19.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.489+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=G36B21SHA9FO tag=CLB3Y60PI98T type=write size=3366443 2024-02-23T06:34:19.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.490+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=YYB3RSMWAYWI type=del 2024-02-23T06:34:19.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.492+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=5WY305C42SXU type=del size=1762184 2024-02-23T06:34:19.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.493+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=TCIJ7F9ZUH3K type=del 2024-02-23T06:34:19.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.494+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=6LGEGA5QV1A4 type=write size=940712 2024-02-23T06:34:19.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.496+0000 7f5e72834780 1 < suggested update operation key=GACVVXC2Z1YO tag=494A1E0OGWEZ type=del size=2525222 2024-02-23T06:34:19.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.498+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~QCLQ35C5QCHX.0 size=1048576 2024-02-23T06:34:19.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.499+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~QCLQ35C5QCHX.1 size=713160 2024-02-23T06:34:19.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.499+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=QCLQ35C5QCHX tag=GGHL2YL6O868 type=write size=2810312 2024-02-23T06:34:19.501 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.500+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~PM85BKLQR42G.0 size=846811 2024-02-23T06:34:19.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.502+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=PM85BKLQR42G tag=E7EEI13BCSXQ type=write size=1895387 2024-02-23T06:34:19.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.503+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=WQGX36GJ81AB type=del size=3512702 2024-02-23T06:34:19.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.506+0000 7f5e72834780 1 < suggested remove operation key=8Q6WC7B9BY5Q tag=1TBZQFNVPTJD type=del 2024-02-23T06:34:19.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.508+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~OZB5A5OKEPDU.0 size=1048576 2024-02-23T06:34:19.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.509+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~OZB5A5OKEPDU.1 size=822614 2024-02-23T06:34:19.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.509+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=OZB5A5OKEPDU tag=SC3XZVGL52K0 type=write size=2919766 2024-02-23T06:34:19.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.510+0000 7f5e72834780 -1 < failed to complete operation key=8Q6WC7B9BY5Q tag=1KMQ7FPU0TOJ type=del size=1472380: (22) Invalid argument 2024-02-23T06:34:19.511 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.511+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=NAFZ1BL5DKLV type=write size=834624 2024-02-23T06:34:19.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.512+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~F7NTEXSAPIG5.0 size=1048576 2024-02-23T06:34:19.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.513+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~F7NTEXSAPIG5.1 size=588425 2024-02-23T06:34:19.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.515+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=F7NTEXSAPIG5 tag=GL4TZAH3VYR2 type=write size=2685577 2024-02-23T06:34:19.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.516+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=DO76R2JT3N6W type=del size=2477057 2024-02-23T06:34:19.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.518+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~2U6PT5KFII09.0 size=1048576 2024-02-23T06:34:19.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.519+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~2U6PT5KFII09.1 size=1048576 2024-02-23T06:34:19.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.520+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~2U6PT5KFII09.2 size=486505 2024-02-23T06:34:19.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.522+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=2U6PT5KFII09 tag=HXYMVILXVCBH type=write size=3632233 2024-02-23T06:34:19.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.524+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=0E795L0R651T type=del size=1992557 2024-02-23T06:34:19.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.525+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=D5T2B03CCRHL type=del 2024-02-23T06:34:19.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.526+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=SRYUE1XS9NIJ type=del size=3651379 2024-02-23T06:34:19.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.527+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=W02ALFDLRNKJ type=del 2024-02-23T06:34:19.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.528+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=8EBIOBYW261Q type=del size=452918 2024-02-23T06:34:19.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.529+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=TRW87EJV4N7M type=del 2024-02-23T06:34:19.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.531+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~OJYPCQLLV6OO.0 size=255658 2024-02-23T06:34:19.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.531+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=OJYPCQLLV6OO tag=7H03YJHABKOH type=write size=1304234 2024-02-23T06:34:19.532 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.532+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~E2RAFJKED5XX.0 size=1048576 2024-02-23T06:34:19.532 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.532+0000 7f5e72834780 1 < canceled part key=_multipart_8Q6WC7B9BY5Q.2~E2RAFJKED5XX.1 size=1048576 2024-02-23T06:34:19.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.533+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~E2RAFJKED5XX.2 size=181414 2024-02-23T06:34:19.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.535+0000 7f5e72834780 1 < canceled multipart upload key=8Q6WC7B9BY5Q upload=E2RAFJKED5XX tag=916Z0EO03BUD type=write size=3327142 2024-02-23T06:34:19.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.536+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=K7OBLAIZIR7B type=del size=3957410 2024-02-23T06:34:19.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.537+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~4IAISTIGVCYG.0 size=48363 2024-02-23T06:34:19.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.539+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=4IAISTIGVCYG tag=9SAZT0TQ150C type=write size=1096939 2024-02-23T06:34:19.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.540+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=0MMKJOZXKE2S type=write size=604049 2024-02-23T06:34:19.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.541+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=LBYQCCLKNY1U type=del 2024-02-23T06:34:19.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.543+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=7TG6AT27FE5L type=del size=4136020 2024-02-23T06:34:19.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.544+0000 7f5e72834780 1 < canceled operation key=721UW0AGSKVR tag=KRE2EQNRWJLU type=write size=726170 2024-02-23T06:34:19.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.546+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~GR6YWRETXK7N.0 size=1048576 2024-02-23T06:34:19.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.547+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~GR6YWRETXK7N.1 size=14106 2024-02-23T06:34:19.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.547+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=GR6YWRETXK7N tag=C0QN5RSM9Y2R type=write size=2111258 2024-02-23T06:34:19.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.548+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~G36B21SHA9FO.0 size=1048576 2024-02-23T06:34:19.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.549+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~G36B21SHA9FO.1 size=1048576 2024-02-23T06:34:19.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.550+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~G36B21SHA9FO.2 size=220715 2024-02-23T06:34:19.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.551+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=G36B21SHA9FO tag=CLB3Y60PI98T type=write size=3366443 2024-02-23T06:34:19.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.554+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~DQS13S8ICIQM.0 size=794982 2024-02-23T06:34:19.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.554+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=DQS13S8ICIQM tag=INJC69K96GOE type=write size=1843558 2024-02-23T06:34:19.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.555+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=5WY305C42SXU type=del 2024-02-23T06:34:19.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.556+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=L354XV76SKJ7 type=del size=1523944 2024-02-23T06:34:19.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.557+0000 7f5e72834780 1 < completed write operation key=WETP4ONTU3HL tag=6LGEGA5QV1A4 type=write size=940712 2024-02-23T06:34:19.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.559+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~HBJF48FXRF8K.0 size=984914 2024-02-23T06:34:19.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.559+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=HBJF48FXRF8K tag=ZYOICKC50H2V type=write size=2033490 2024-02-23T06:34:19.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.560+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~QCLQ35C5QCHX.0 size=1048576 2024-02-23T06:34:19.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.560+0000 7f5e72834780 1 < canceled part key=_multipart_WK98HMHAZIUB.2~QCLQ35C5QCHX.1 size=713160 2024-02-23T06:34:19.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.562+0000 7f5e72834780 1 < canceled multipart upload key=WK98HMHAZIUB upload=QCLQ35C5QCHX tag=GGHL2YL6O868 type=write size=2810312 2024-02-23T06:34:19.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.563+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=DHWGLGZVRU2X type=del size=3973880 2024-02-23T06:34:19.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.565+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=WQGX36GJ81AB type=del 2024-02-23T06:34:19.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.566+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=XPRQZAHS51F6 type=del size=1358269 2024-02-23T06:34:19.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.566+0000 7f5e72834780 1 < canceled part key=_multipart_QGGULCYZ0ZSA.2~OZB5A5OKEPDU.0 size=1048576 2024-02-23T06:34:19.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.567+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~OZB5A5OKEPDU.1 size=822614 2024-02-23T06:34:19.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.569+0000 7f5e72834780 1 < canceled multipart upload key=QGGULCYZ0ZSA upload=OZB5A5OKEPDU tag=SC3XZVGL52K0 type=write size=2919766 2024-02-23T06:34:19.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.570+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=952ZNQ7BKYRU type=del size=264745 2024-02-23T06:34:19.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.571+0000 7f5e72834780 1 < completed write operation key=0WLEPDK2O30W tag=NAFZ1BL5DKLV type=write size=834624 2024-02-23T06:34:19.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.572+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=KBTWFDR02RGS type=del size=2104709 2024-02-23T06:34:19.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.573+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=DO76R2JT3N6W type=del 2024-02-23T06:34:19.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.575+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~44YMLJO3IF3F.0 size=1048576 2024-02-23T06:34:19.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.576+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~44YMLJO3IF3F.1 size=823987 2024-02-23T06:34:19.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.576+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=44YMLJO3IF3F tag=YREILOB1T2X3 type=write size=2921139 2024-02-23T06:34:19.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.578+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=0E795L0R651T type=del 2024-02-23T06:34:19.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.580+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~EJ79MV6TR4C2.0 size=1048576 2024-02-23T06:34:19.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.581+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~EJ79MV6TR4C2.1 size=1048576 2024-02-23T06:34:19.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.581+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~EJ79MV6TR4C2.2 size=313651 2024-02-23T06:34:19.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.581+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=EJ79MV6TR4C2 tag=LP429PU1G552 type=write size=3459379 2024-02-23T06:34:19.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.583+0000 7f5e72834780 1 < canceled operation key=VER8U5YMTPS6 tag=SRYUE1XS9NIJ type=del size=3651379 2024-02-23T06:34:19.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.584+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=0LYTE34F0PSX type=del size=1659624 2024-02-23T06:34:19.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.586+0000 7f5e72834780 1 < suggested remove operation key=0WLEPDK2O30W tag=8EBIOBYW261Q type=del 2024-02-23T06:34:19.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.589+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~WY0PS0R99Y26.0 size=548272 2024-02-23T06:34:19.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.589+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=WY0PS0R99Y26 tag=XO5MLZJA8STS type=write size=1596848 2024-02-23T06:34:19.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.590+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~OJYPCQLLV6OO.0 size=255658 2024-02-23T06:34:19.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.592+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=OJYPCQLLV6OO tag=7H03YJHABKOH type=write size=1304234 2024-02-23T06:34:19.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.594+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~D9NS9CD2Q2I5.0 size=1048576 2024-02-23T06:34:19.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.595+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~D9NS9CD2Q2I5.1 size=1048576 2024-02-23T06:34:19.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.596+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~D9NS9CD2Q2I5.2 size=275721 2024-02-23T06:34:19.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.596+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=D9NS9CD2Q2I5 tag=KCVZBGKV9NSK type=write size=3421449 2024-02-23T06:34:19.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.597+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=K7OBLAIZIR7B type=del 2024-02-23T06:34:19.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.598+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=R129MSXVZG6X type=del size=3047855 2024-02-23T06:34:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.601+0000 7f5e72834780 1 < suggested remove operation key=QZLNM2RQ9SDC tag=0MMKJOZXKE2S type=write 2024-02-23T06:34:19.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.602+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=WBQCW61NKOXI type=write size=94216 2024-02-23T06:34:19.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.603+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=7TG6AT27FE5L type=del 2024-02-23T06:34:19.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.605+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~B5XFBOJ5MU7P.0 size=1048576 2024-02-23T06:34:19.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.606+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~B5XFBOJ5MU7P.1 size=1048576 2024-02-23T06:34:19.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.607+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~B5XFBOJ5MU7P.2 size=410778 2024-02-23T06:34:19.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.607+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=B5XFBOJ5MU7P tag=87NIHIOV6GQL type=write size=3556506 2024-02-23T06:34:19.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.608+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~GR6YWRETXK7N.0 size=1048576 2024-02-23T06:34:19.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.609+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~GR6YWRETXK7N.1 size=14106 2024-02-23T06:34:19.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.611+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=GR6YWRETXK7N tag=C0QN5RSM9Y2R type=write size=2111258 2024-02-23T06:34:19.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.612+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=MUOM2LEYPT5E type=del size=4027148 2024-02-23T06:34:19.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.613+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~DQS13S8ICIQM.0 size=794982 2024-02-23T06:34:19.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.615+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=DQS13S8ICIQM tag=INJC69K96GOE type=write size=1843558 2024-02-23T06:34:19.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.616+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=N076P350Q5IH type=del size=4093460 2024-02-23T06:34:19.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.617+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=L354XV76SKJ7 type=del 2024-02-23T06:34:19.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.618+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=X5ENYP913JK6 type=write size=964166 2024-02-23T06:34:19.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.620+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~HBJF48FXRF8K.0 size=984914 2024-02-23T06:34:19.622 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.622+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=HBJF48FXRF8K tag=ZYOICKC50H2V type=write size=2033490 2024-02-23T06:34:19.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.623+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=P8IU21NQ84T2 type=del size=234976 2024-02-23T06:34:19.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.624+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=DHWGLGZVRU2X type=del 2024-02-23T06:34:19.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.625+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=ZBDP3TOAHAGH type=write size=357882 2024-02-23T06:34:19.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.628+0000 7f5e72834780 1 < suggested remove operation key=VEJ6D2J3LZI8 tag=XPRQZAHS51F6 type=del 2024-02-23T06:34:19.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.629+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=WQHDCQBM4RJI type=del size=1026225 2024-02-23T06:34:19.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.632+0000 7f5e72834780 1 < suggested update operation key=QGGULCYZ0ZSA tag=952ZNQ7BKYRU type=del size=264745 2024-02-23T06:34:19.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.634+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~296E9SJD1UA7.0 size=890911 2024-02-23T06:34:19.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.634+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=296E9SJD1UA7 tag=LSAHS77VX7VA type=write size=1939487 2024-02-23T06:34:19.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.635+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=KBTWFDR02RGS type=del 2024-02-23T06:34:19.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.636+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=I8QGVR6YJ5Q3 type=write size=288325 2024-02-23T06:34:19.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.637+0000 7f5e72834780 1 < canceled part key=_multipart_N8RXOY8X71MO.2~44YMLJO3IF3F.0 size=1048576 2024-02-23T06:34:19.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.638+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~44YMLJO3IF3F.1 size=823987 2024-02-23T06:34:19.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.639+0000 7f5e72834780 1 < canceled multipart upload key=N8RXOY8X71MO upload=44YMLJO3IF3F tag=YREILOB1T2X3 type=write size=2921139 2024-02-23T06:34:19.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.640+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=5K3R8ZSW9MP7 type=del size=3698887 2024-02-23T06:34:19.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.642+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~EJ79MV6TR4C2.0 size=1048576 2024-02-23T06:34:19.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.642+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~EJ79MV6TR4C2.1 size=1048576 2024-02-23T06:34:19.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.643+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~EJ79MV6TR4C2.2 size=313651 2024-02-23T06:34:19.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.645+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=EJ79MV6TR4C2 tag=LP429PU1G552 type=write size=3459379 2024-02-23T06:34:19.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.646+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=RPAA8NZVKQB2 type=del size=3087516 2024-02-23T06:34:19.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.647+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=0LYTE34F0PSX type=del 2024-02-23T06:34:19.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.649+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=D2FQ817WA7R7 type=del size=804725 2024-02-23T06:34:19.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.650+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~WY0PS0R99Y26.0 size=548272 2024-02-23T06:34:19.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.651+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=WY0PS0R99Y26 tag=XO5MLZJA8STS type=write size=1596848 2024-02-23T06:34:19.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.653+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=5Z7WPTF5VIGY type=del size=616747 2024-02-23T06:34:19.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.654+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~D9NS9CD2Q2I5.0 size=1048576 2024-02-23T06:34:19.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.655+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~D9NS9CD2Q2I5.1 size=1048576 2024-02-23T06:34:19.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.655+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~D9NS9CD2Q2I5.2 size=275721 2024-02-23T06:34:19.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.658+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=D9NS9CD2Q2I5 tag=KCVZBGKV9NSK type=write size=3421449 2024-02-23T06:34:19.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.659+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=27EOUQ5CE7Y1 type=write size=123979 2024-02-23T06:34:19.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.660+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=R129MSXVZG6X type=del 2024-02-23T06:34:19.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.661+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=53O72DR0HD9J type=del size=2699471 2024-02-23T06:34:19.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.662+0000 7f5e72834780 1 < completed write operation key=4M7BT05YB0C3 tag=WBQCW61NKOXI type=write size=94216 2024-02-23T06:34:19.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.663+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=QKXV8BQY3K6I type=del size=517823 2024-02-23T06:34:19.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.665+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~B5XFBOJ5MU7P.0 size=1048576 2024-02-23T06:34:19.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.666+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~B5XFBOJ5MU7P.1 size=1048576 2024-02-23T06:34:19.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.667+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~B5XFBOJ5MU7P.2 size=410778 2024-02-23T06:34:19.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.669+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=B5XFBOJ5MU7P tag=87NIHIOV6GQL type=write size=3556506 2024-02-23T06:34:19.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.670+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=ID0M2V1U86BZ type=del size=237588 2024-02-23T06:34:19.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.672+0000 7f5e72834780 1 < suggested update operation key=26EE3EHDK8EM tag=MUOM2LEYPT5E type=del size=4027148 2024-02-23T06:34:19.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.673+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=SA8VLH4E99GY type=del size=932234 2024-02-23T06:34:19.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.676+0000 7f5e72834780 1 < suggested remove operation key=WK98HMHAZIUB tag=N076P350Q5IH type=del 2024-02-23T06:34:19.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.677+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=JPCSZWPA85FS type=del size=1652703 2024-02-23T06:34:19.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.678+0000 7f5e72834780 -1 < failed to complete operation key=VEJ6D2J3LZI8 tag=X5ENYP913JK6 type=write size=964166: (22) Invalid argument 2024-02-23T06:34:19.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.680+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~FW1ZAHK636DW.0 size=1048576 2024-02-23T06:34:19.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.681+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~FW1ZAHK636DW.1 size=1048576 2024-02-23T06:34:19.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.682+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~FW1ZAHK636DW.2 size=864023 2024-02-23T06:34:19.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.682+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=FW1ZAHK636DW tag=R3GTT7DEILNN type=write size=4009751 2024-02-23T06:34:19.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.683+0000 7f5e72834780 1 < canceled operation key=QZLNM2RQ9SDC tag=P8IU21NQ84T2 type=del size=234976 2024-02-23T06:34:19.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.684+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=GIHWOY8CJMG5 type=del size=2246712 2024-02-23T06:34:19.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.686+0000 7f5e72834780 1 < suggested remove operation key=9ZCNDGBEPWMN tag=ZBDP3TOAHAGH type=write 2024-02-23T06:34:19.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.687+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=4R1PLL3TVD2E type=del size=2213797 2024-02-23T06:34:19.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.689+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=WQHDCQBM4RJI type=del 2024-02-23T06:34:19.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.690+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=NQRK12AAQDO7 type=del size=2278276 2024-02-23T06:34:19.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.691+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~296E9SJD1UA7.0 size=890911 2024-02-23T06:34:19.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.693+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=296E9SJD1UA7 tag=LSAHS77VX7VA type=write size=1939487 2024-02-23T06:34:19.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.694+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=P62QTMVK6GKM type=del size=893978 2024-02-23T06:34:19.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.694+0000 7f5e72834780 -1 < no bi entry to suggest for operation key=9ZCNDGBEPWMN tag=I8QGVR6YJ5Q3 type=write size=288325: (2) No such file or directory 2024-02-23T06:34:19.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.696+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=RX80VZNOZAJK type=del size=139481 2024-02-23T06:34:19.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.698+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=5K3R8ZSW9MP7 type=del 2024-02-23T06:34:19.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.699+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=51YWXUY8LJ44 type=del size=2218335 2024-02-23T06:34:19.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.700+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=RPAA8NZVKQB2 type=del 2024-02-23T06:34:19.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.701+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=NE0Y431E2VTJ type=del size=644535 2024-02-23T06:34:19.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.702+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=D2FQ817WA7R7 type=del 2024-02-23T06:34:19.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.704+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=0BLBN04MPPRZ type=del size=1313864 2024-02-23T06:34:19.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.705+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=5Z7WPTF5VIGY type=del 2024-02-23T06:34:19.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.706+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=SI3OL3FD1I8K type=del size=4071448 2024-02-23T06:34:19.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.707+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=27EOUQ5CE7Y1 type=write size=123979 2024-02-23T06:34:19.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.708+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=XUIGLSXAT41K type=del size=3780694 2024-02-23T06:34:19.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.709+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=53O72DR0HD9J type=del size=2699471 2024-02-23T06:34:19.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.711+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~CXQCNS5XQ9LE.0 size=871667 2024-02-23T06:34:19.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.711+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=CXQCNS5XQ9LE tag=2MEFVM5WHF9X type=write size=1920243 2024-02-23T06:34:19.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.712+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=QKXV8BQY3K6I type=del 2024-02-23T06:34:19.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.714+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=HAK7HD9M5Z71 type=write size=240232 2024-02-23T06:34:19.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.715+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=ID0M2V1U86BZ type=del 2024-02-23T06:34:19.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.716+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=02JCKCS0OGUM type=del size=3448150 2024-02-23T06:34:19.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.717+0000 7f5e72834780 1 < canceled operation key=WETP4ONTU3HL tag=SA8VLH4E99GY type=del size=932234 2024-02-23T06:34:19.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.718+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=GGHT9X8JM1RR type=del size=595994 2024-02-23T06:34:19.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.719+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=JPCSZWPA85FS type=del 2024-02-23T06:34:19.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.721+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~7SBGLCY3KI5M.0 size=1048576 2024-02-23T06:34:19.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.722+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~7SBGLCY3KI5M.1 size=726510 2024-02-23T06:34:19.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.722+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=7SBGLCY3KI5M tag=GPTSJHWNF1XB type=write size=2823662 2024-02-23T06:34:19.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.723+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~FW1ZAHK636DW.0 size=1048576 2024-02-23T06:34:19.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.724+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~FW1ZAHK636DW.1 size=1048576 2024-02-23T06:34:19.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.724+0000 7f5e72834780 1 < canceled part key=_multipart_R3STDBS79MV0.2~FW1ZAHK636DW.2 size=864023 2024-02-23T06:34:19.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.726+0000 7f5e72834780 1 < canceled multipart upload key=R3STDBS79MV0 upload=FW1ZAHK636DW tag=R3GTT7DEILNN type=write size=4009751 2024-02-23T06:34:19.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.728+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=29KYVBYOPFBZ type=write size=801749 2024-02-23T06:34:19.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.729+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=GIHWOY8CJMG5 type=del 2024-02-23T06:34:19.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.730+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=L2V1JR0FD9QJ type=write size=679050 2024-02-23T06:34:19.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.731+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=4R1PLL3TVD2E type=del 2024-02-23T06:34:19.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.733+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~32R0G7L2D35R.0 size=1048576 2024-02-23T06:34:19.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.734+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~32R0G7L2D35R.1 size=1021642 2024-02-23T06:34:19.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.734+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=32R0G7L2D35R tag=KH0AJNQJBS5A type=write size=3118794 2024-02-23T06:34:19.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.735+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=NQRK12AAQDO7 type=del 2024-02-23T06:34:19.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.736+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=PE6C3J9N4I2B type=del size=3111896 2024-02-23T06:34:19.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.738+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=P62QTMVK6GKM type=del 2024-02-23T06:34:19.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.740+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~ZWMXGICNLMC5.0 size=1048576 2024-02-23T06:34:19.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.741+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~ZWMXGICNLMC5.1 size=564562 2024-02-23T06:34:19.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.741+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=ZWMXGICNLMC5 tag=ULXA3B660TPK type=write size=2661714 2024-02-23T06:34:19.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.742+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=RX80VZNOZAJK type=del 2024-02-23T06:34:19.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.744+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~K2RR19JF9034.0 size=238597 2024-02-23T06:34:19.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.744+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=K2RR19JF9034 tag=HCB7FPMJT7DO type=write size=1287173 2024-02-23T06:34:19.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.746+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=51YWXUY8LJ44 type=del 2024-02-23T06:34:19.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.747+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=P5H1P0Y08Q9D type=del size=3949340 2024-02-23T06:34:19.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.748+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=NE0Y431E2VTJ type=del 2024-02-23T06:34:19.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.750+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~64J10WVAZKSG.0 size=1048576 2024-02-23T06:34:19.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.751+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~64J10WVAZKSG.1 size=1048576 2024-02-23T06:34:19.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.752+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~64J10WVAZKSG.2 size=398206 2024-02-23T06:34:19.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.752+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=64J10WVAZKSG tag=LV7HSXGB459H type=write size=3543934 2024-02-23T06:34:19.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.754+0000 7f5e72834780 1 < suggested update operation key=VEJ6D2J3LZI8 tag=0BLBN04MPPRZ type=del size=1313864 2024-02-23T06:34:19.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.755+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=KCM2R4DP1O57 type=del size=3223525 2024-02-23T06:34:19.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.756+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=SI3OL3FD1I8K type=del 2024-02-23T06:34:19.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.757+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=2FCC4OWT8T0M type=write size=734442 2024-02-23T06:34:19.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.760+0000 7f5e72834780 1 < suggested remove operation key=VER8U5YMTPS6 tag=XUIGLSXAT41K type=del 2024-02-23T06:34:19.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.761+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=FSERRFYSF22D type=del size=2270820 2024-02-23T06:34:19.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.762+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~CXQCNS5XQ9LE.0 size=871667 2024-02-23T06:34:19.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.764+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=CXQCNS5XQ9LE tag=2MEFVM5WHF9X type=write size=1920243 2024-02-23T06:34:19.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.766+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~1RQBZT06X5PZ.0 size=1048576 2024-02-23T06:34:19.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.768+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~1RQBZT06X5PZ.1 size=1048576 2024-02-23T06:34:19.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.769+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~1RQBZT06X5PZ.2 size=357815 2024-02-23T06:34:19.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.769+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=1RQBZT06X5PZ tag=3B0ZT0UCJ4JZ type=write size=3503543 2024-02-23T06:34:19.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.770+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=HAK7HD9M5Z71 type=write size=240232 2024-02-23T06:34:19.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.771+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=NHRJO0P1VKPU type=write size=572887 2024-02-23T06:34:19.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.771+0000 7f5e72834780 -1 < no bi entry to suggest for operation key=VER8U5YMTPS6 tag=02JCKCS0OGUM type=del size=3448150: (2) No such file or directory 2024-02-23T06:34:19.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.772+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=9A1CS3F3JCC8 type=del size=2141826 2024-02-23T06:34:19.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.774+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=GGHT9X8JM1RR type=del 2024-02-23T06:34:19.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.775+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=OE9JG2WEYQ3B type=del size=1586599 2024-02-23T06:34:19.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.776+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~7SBGLCY3KI5M.0 size=1048576 2024-02-23T06:34:19.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.777+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~7SBGLCY3KI5M.1 size=726510 2024-02-23T06:34:19.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.779+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=7SBGLCY3KI5M tag=GPTSJHWNF1XB type=write size=2823662 2024-02-23T06:34:19.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.780+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=UHJWEYEEQ54M type=write size=670285 2024-02-23T06:34:19.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.781+0000 7f5e72834780 1 < completed write operation key=TNH85ZWPALJN tag=29KYVBYOPFBZ type=write size=801749 2024-02-23T06:34:19.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.783+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~0LWM8MQY404D.0 size=1048576 2024-02-23T06:34:19.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.784+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~0LWM8MQY404D.1 size=1048576 2024-02-23T06:34:19.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.785+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~0LWM8MQY404D.2 size=662936 2024-02-23T06:34:19.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.785+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=0LWM8MQY404D tag=LYQ30HZI41BA type=write size=3808664 2024-02-23T06:34:19.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.786+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=L2V1JR0FD9QJ type=write size=679050 2024-02-23T06:34:19.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.788+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=3C1W405CJOS6 type=del size=3803922 2024-02-23T06:34:19.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.789+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~32R0G7L2D35R.0 size=1048576 2024-02-23T06:34:19.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.790+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~32R0G7L2D35R.1 size=1021642 2024-02-23T06:34:19.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.792+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=32R0G7L2D35R tag=KH0AJNQJBS5A type=write size=3118794 2024-02-23T06:34:19.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.793+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=3FDFS2BUIS8L type=del size=3310679 2024-02-23T06:34:19.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.794+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=PE6C3J9N4I2B type=del 2024-02-23T06:34:19.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.795+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=0FH79SSPXTFZ type=del size=1607932 2024-02-23T06:34:19.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.796+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~ZWMXGICNLMC5.0 size=1048576 2024-02-23T06:34:19.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.797+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~ZWMXGICNLMC5.1 size=564562 2024-02-23T06:34:19.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.799+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=ZWMXGICNLMC5 tag=ULXA3B660TPK type=write size=2661714 2024-02-23T06:34:19.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.800+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=VU8D1SMIERWF type=del size=1367987 2024-02-23T06:34:19.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.802+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~K2RR19JF9034.0 size=238597 2024-02-23T06:34:19.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.803+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=K2RR19JF9034 tag=HCB7FPMJT7DO type=write size=1287173 2024-02-23T06:34:19.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.805+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~DKP9706FXQJT.0 size=1048576 2024-02-23T06:34:19.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.806+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~DKP9706FXQJT.1 size=1048576 2024-02-23T06:34:19.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.807+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~DKP9706FXQJT.2 size=354205 2024-02-23T06:34:19.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.807+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=DKP9706FXQJT tag=J5ED0ZD5W9D6 type=write size=3499933 2024-02-23T06:34:19.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.810+0000 7f5e72834780 1 < suggested update operation key=QZLNM2RQ9SDC tag=P5H1P0Y08Q9D type=del size=3949340 2024-02-23T06:34:19.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.812+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~05R0H3TU6JBR.0 size=1048576 2024-02-23T06:34:19.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.813+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~05R0H3TU6JBR.1 size=670603 2024-02-23T06:34:19.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.813+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=05R0H3TU6JBR tag=JX0SH3P95660 type=write size=2767755 2024-02-23T06:34:19.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.813+0000 7f5e72834780 1 < canceled part key=_multipart_GW6EKQ84FQ6L.2~64J10WVAZKSG.0 size=1048576 2024-02-23T06:34:19.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.814+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~64J10WVAZKSG.1 size=1048576 2024-02-23T06:34:19.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.815+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~64J10WVAZKSG.2 size=398206 2024-02-23T06:34:19.817 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.817+0000 7f5e72834780 1 < canceled multipart upload key=GW6EKQ84FQ6L upload=64J10WVAZKSG tag=LV7HSXGB459H type=write size=3543934 2024-02-23T06:34:19.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.818+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=4SH2VZ7RUJ75 type=del size=3205489 2024-02-23T06:34:19.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.819+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=KCM2R4DP1O57 type=del 2024-02-23T06:34:19.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.821+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=J3KGN2AL91BX type=del size=3829169 2024-02-23T06:34:19.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.822+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=2FCC4OWT8T0M type=write size=734442 2024-02-23T06:34:19.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.825+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~LO1NIA921CAA.0 size=1048576 2024-02-23T06:34:19.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.826+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~LO1NIA921CAA.1 size=1048576 2024-02-23T06:34:19.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.827+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~LO1NIA921CAA.2 size=594548 2024-02-23T06:34:19.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.827+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=LO1NIA921CAA tag=F0X0EDGI1HD2 type=write size=3740276 2024-02-23T06:34:19.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.828+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=FSERRFYSF22D type=del 2024-02-23T06:34:19.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.830+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=H6HK4HDVDO45 type=del size=2287072 2024-02-23T06:34:19.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.831+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~1RQBZT06X5PZ.0 size=1048576 2024-02-23T06:34:19.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.832+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~1RQBZT06X5PZ.1 size=1048576 2024-02-23T06:34:19.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.833+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~1RQBZT06X5PZ.2 size=357815 2024-02-23T06:34:19.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.835+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=1RQBZT06X5PZ tag=3B0ZT0UCJ4JZ type=write size=3503543 2024-02-23T06:34:19.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.836+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=PSYO79IZDU2P type=del size=591223 2024-02-23T06:34:19.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.837+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=NHRJO0P1VKPU type=write size=572887 2024-02-23T06:34:19.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.839+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~Z2Z0X58OF2S7.0 size=1048576 2024-02-23T06:34:19.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.840+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~Z2Z0X58OF2S7.1 size=383923 2024-02-23T06:34:19.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.840+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=Z2Z0X58OF2S7 tag=HCL39RWEITOB type=write size=2481075 2024-02-23T06:34:19.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.841+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=9A1CS3F3JCC8 type=del 2024-02-23T06:34:19.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.843+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=NAY636KJ5YVX type=del size=261222 2024-02-23T06:34:19.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.844+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=OE9JG2WEYQ3B type=del 2024-02-23T06:34:19.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.845+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=MDG81RXILVHM type=del size=978962 2024-02-23T06:34:19.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.847+0000 7f5e72834780 1 < suggested update operation key=26EE3EHDK8EM tag=UHJWEYEEQ54M type=write size=670285 2024-02-23T06:34:19.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.848+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=8BY0MS16915N type=write size=141699 2024-02-23T06:34:19.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.850+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~0LWM8MQY404D.0 size=1048576 2024-02-23T06:34:19.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.851+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~0LWM8MQY404D.1 size=1048576 2024-02-23T06:34:19.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.852+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~0LWM8MQY404D.2 size=662936 2024-02-23T06:34:19.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.855+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=0LWM8MQY404D tag=LYQ30HZI41BA type=write size=3808664 2024-02-23T06:34:19.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.856+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=KDDZLY9OHG5K type=del size=2895238 2024-02-23T06:34:19.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.858+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=3C1W405CJOS6 type=del 2024-02-23T06:34:19.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.859+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=WJMQSEOSDQAO type=del size=1119285 2024-02-23T06:34:19.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.860+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=3FDFS2BUIS8L type=del 2024-02-23T06:34:19.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.862+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~I9MEE7BQLU00.0 size=1048576 2024-02-23T06:34:19.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.863+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~I9MEE7BQLU00.1 size=109732 2024-02-23T06:34:19.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.863+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=I9MEE7BQLU00 tag=REOQWXWRXDT0 type=write size=2206884 2024-02-23T06:34:19.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.864+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=0FH79SSPXTFZ type=del 2024-02-23T06:34:19.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.865+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=BE6BAGCWU10H type=del size=4066821 2024-02-23T06:34:19.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.867+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=VU8D1SMIERWF type=del 2024-02-23T06:34:19.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.868+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=1RW491T8910K type=write size=222379 2024-02-23T06:34:19.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.869+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~DKP9706FXQJT.0 size=1048576 2024-02-23T06:34:19.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.870+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~DKP9706FXQJT.1 size=1048576 2024-02-23T06:34:19.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.871+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~DKP9706FXQJT.2 size=354205 2024-02-23T06:34:19.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.873+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=DKP9706FXQJT tag=J5ED0ZD5W9D6 type=write size=3499933 2024-02-23T06:34:19.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.875+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~M60HDBT7VQ5K.0 size=1048576 2024-02-23T06:34:19.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.876+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~M60HDBT7VQ5K.1 size=965476 2024-02-23T06:34:19.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.876+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=M60HDBT7VQ5K tag=YJ8BMATSIRVU type=write size=3062628 2024-02-23T06:34:19.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.877+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~05R0H3TU6JBR.0 size=1048576 2024-02-23T06:34:19.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.878+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~05R0H3TU6JBR.1 size=670603 2024-02-23T06:34:19.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.880+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=05R0H3TU6JBR tag=JX0SH3P95660 type=write size=2767755 2024-02-23T06:34:19.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.881+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=9AAM7HVV67R2 type=write size=1044147 2024-02-23T06:34:19.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.882+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=4SH2VZ7RUJ75 type=del 2024-02-23T06:34:19.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.883+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=4C9TVI0Q90ZZ type=del size=4176083 2024-02-23T06:34:19.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.884+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=J3KGN2AL91BX type=del 2024-02-23T06:34:19.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.885+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=N31JBR4ZRRBS type=del size=458468 2024-02-23T06:34:19.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.886+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~LO1NIA921CAA.0 size=1048576 2024-02-23T06:34:19.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.886+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~LO1NIA921CAA.1 size=1048576 2024-02-23T06:34:19.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.887+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~LO1NIA921CAA.2 size=594548 2024-02-23T06:34:19.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.889+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=LO1NIA921CAA tag=F0X0EDGI1HD2 type=write size=3740276 2024-02-23T06:34:19.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.890+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=8VXBUEBXD8PO type=write size=617931 2024-02-23T06:34:19.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.892+0000 7f5e72834780 1 < suggested remove operation key=MB8BZ2BXZE9M tag=H6HK4HDVDO45 type=del 2024-02-23T06:34:19.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.894+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=AODE2AAP8101 type=del size=2637007 2024-02-23T06:34:19.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.896+0000 7f5e72834780 1 < suggested update operation key=IDTA5RV6IUF6 tag=PSYO79IZDU2P type=del size=591223 2024-02-23T06:34:19.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.897+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=27ZXQEOULC3Z type=del size=1322620 2024-02-23T06:34:19.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.899+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~Z2Z0X58OF2S7.0 size=1048576 2024-02-23T06:34:19.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.900+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~Z2Z0X58OF2S7.1 size=383923 2024-02-23T06:34:19.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.902+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=Z2Z0X58OF2S7 tag=HCL39RWEITOB type=write size=2481075 2024-02-23T06:34:19.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.903+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=IZUOB4IBRLGV type=del size=1430618 2024-02-23T06:34:19.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.904+0000 7f5e72834780 -1 < failed to complete operation key=26EE3EHDK8EM tag=NAY636KJ5YVX type=del size=261222: (22) Invalid argument 2024-02-23T06:34:19.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.905+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=TSKAY2NANQYG type=write size=990388 2024-02-23T06:34:19.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.906+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=MDG81RXILVHM type=del 2024-02-23T06:34:19.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.907+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=9BPZAPKE9DNL type=del size=2980305 2024-02-23T06:34:19.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.908+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=8BY0MS16915N type=write size=141699 2024-02-23T06:34:19.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.910+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=TRIJWBK5N9UD type=del size=2567268 2024-02-23T06:34:19.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.912+0000 7f5e72834780 1 < suggested remove operation key=N8RXOY8X71MO tag=KDDZLY9OHG5K type=del 2024-02-23T06:34:19.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.914+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~ZJR26EVFSKHP.0 size=1048576 2024-02-23T06:34:19.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.915+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~ZJR26EVFSKHP.1 size=246305 2024-02-23T06:34:19.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.915+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=ZJR26EVFSKHP tag=KP1M013JSZXC type=write size=2343457 2024-02-23T06:34:19.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.917+0000 7f5e72834780 1 < suggested update operation key=VER8U5YMTPS6 tag=WJMQSEOSDQAO type=del size=1119285 2024-02-23T06:34:19.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.918+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=MKZET0RQY9Q8 type=del size=3824296 2024-02-23T06:34:19.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.919+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~I9MEE7BQLU00.0 size=1048576 2024-02-23T06:34:19.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.920+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~I9MEE7BQLU00.1 size=109732 2024-02-23T06:34:19.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.922+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=I9MEE7BQLU00 tag=REOQWXWRXDT0 type=write size=2206884 2024-02-23T06:34:19.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.924+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~CMQYJMIU043F.0 size=324196 2024-02-23T06:34:19.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.924+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=CMQYJMIU043F tag=3W5EY9R064SR type=write size=1372772 2024-02-23T06:34:19.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.925+0000 7f5e72834780 1 < canceled operation key=9AQCXLBZW3EV tag=BE6BAGCWU10H type=del size=4066821 2024-02-23T06:34:19.927 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.927+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=3SXHRLWT0LA2 type=del size=221467 2024-02-23T06:34:19.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.928+0000 7f5e72834780 1 < completed write operation key=ZM1YKZOUFSCY tag=1RW491T8910K type=write size=222379 2024-02-23T06:34:19.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.934+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=2O9DKQFGEG7H type=write size=92502 2024-02-23T06:34:19.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.935+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~M60HDBT7VQ5K.0 size=1048576 2024-02-23T06:34:19.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.935+0000 7f5e72834780 1 < canceled part key=_multipart_RS03NUABC1U2.2~M60HDBT7VQ5K.1 size=965476 2024-02-23T06:34:19.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.937+0000 7f5e72834780 1 < canceled multipart upload key=RS03NUABC1U2 upload=M60HDBT7VQ5K tag=YJ8BMATSIRVU type=write size=3062628 2024-02-23T06:34:19.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.938+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=5DHV864N6D33 type=del size=4029870 2024-02-23T06:34:19.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.940+0000 7f5e72834780 -1 < failed to complete operation key=MB8BZ2BXZE9M tag=9AAM7HVV67R2 type=write size=1044147: (22) Invalid argument 2024-02-23T06:34:19.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.942+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~UWJPR5F27QM9.0 size=627361 2024-02-23T06:34:19.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.942+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=UWJPR5F27QM9 tag=4CAD6HU76G1O type=write size=1675937 2024-02-23T06:34:19.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.943+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=4C9TVI0Q90ZZ type=del 2024-02-23T06:34:19.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.947+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~HF51QFQHAFVC.0 size=1048576 2024-02-23T06:34:19.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.949+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~HF51QFQHAFVC.1 size=271503 2024-02-23T06:34:19.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.949+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=HF51QFQHAFVC tag=4U66URBD5RUY type=write size=2368655 2024-02-23T06:34:19.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.951+0000 7f5e72834780 -1 < failed to complete operation key=VER8U5YMTPS6 tag=N31JBR4ZRRBS type=del size=458468: (22) Invalid argument 2024-02-23T06:34:19.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.952+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=2UKSDWLD7Q4P type=del size=3451838 2024-02-23T06:34:19.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.953+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=8VXBUEBXD8PO type=write size=617931 2024-02-23T06:34:19.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.954+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=KNLRI12AJJB2 type=del size=2554051 2024-02-23T06:34:19.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.956+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=AODE2AAP8101 type=del 2024-02-23T06:34:19.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.957+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=S3CV4FFB7LZU type=write size=198132 2024-02-23T06:34:19.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.958+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=27ZXQEOULC3Z type=del 2024-02-23T06:34:19.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.959+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=SG7ZLAFDNCS1 type=del size=2485296 2024-02-23T06:34:19.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.960+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=IZUOB4IBRLGV type=del 2024-02-23T06:34:19.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.962+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=0BRNKN1YXXPO type=del size=2831765 2024-02-23T06:34:19.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.963+0000 7f5e72834780 1 < canceled operation key=GWTK3YV0RY21 tag=TSKAY2NANQYG type=write size=990388 2024-02-23T06:34:19.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.965+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~GJ2XWBKCOKPG.0 size=1048576 2024-02-23T06:34:19.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.966+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~GJ2XWBKCOKPG.1 size=668245 2024-02-23T06:34:19.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.966+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=GJ2XWBKCOKPG tag=2IFS0D2H6220 type=write size=2765397 2024-02-23T06:34:19.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.967+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=9BPZAPKE9DNL type=del 2024-02-23T06:34:19.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.968+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=VE9GDRMJGTPH type=del size=2725789 2024-02-23T06:34:19.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.970+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=TRIJWBK5N9UD type=del size=2567268 2024-02-23T06:34:19.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.971+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=JYPIFY7O2NN3 type=write size=542710 2024-02-23T06:34:19.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.973+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~ZJR26EVFSKHP.0 size=1048576 2024-02-23T06:34:19.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.975+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~ZJR26EVFSKHP.1 size=246305 2024-02-23T06:34:19.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.976+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=ZJR26EVFSKHP tag=KP1M013JSZXC type=write size=2343457 2024-02-23T06:34:19.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.977+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=ZNREEKGC5OZE type=write size=897362 2024-02-23T06:34:19.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.978+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=MKZET0RQY9Q8 type=del 2024-02-23T06:34:19.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.979+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=HCMY8SPSKTAX type=del size=3851218 2024-02-23T06:34:19.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.980+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~CMQYJMIU043F.0 size=324196 2024-02-23T06:34:19.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.981+0000 7f5e72834780 1 < canceled multipart upload key=26EE3EHDK8EM upload=CMQYJMIU043F tag=3W5EY9R064SR type=write size=1372772 2024-02-23T06:34:19.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.982+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=9V7GK0XGDFHI type=del size=3134172 2024-02-23T06:34:19.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.983+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=3SXHRLWT0LA2 type=del 2024-02-23T06:34:19.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.985+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~6KPQPIDYIIFM.0 size=796845 2024-02-23T06:34:19.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.985+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=6KPQPIDYIIFM tag=TRINMN6KLILE type=write size=1845421 2024-02-23T06:34:19.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.986+0000 7f5e72834780 1 < completed write operation key=R3STDBS79MV0 tag=2O9DKQFGEG7H type=write size=92502 2024-02-23T06:34:19.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.987+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=NTHCC3O1JBHH type=write size=482229 2024-02-23T06:34:19.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.989+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=5DHV864N6D33 type=del 2024-02-23T06:34:19.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.991+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~3RW9MI1JAYNL.0 size=1048576 2024-02-23T06:34:19.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.992+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~3RW9MI1JAYNL.1 size=1048576 2024-02-23T06:34:19.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.993+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~3RW9MI1JAYNL.2 size=334086 2024-02-23T06:34:19.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.993+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=3RW9MI1JAYNL tag=V7K84HP8ZLS8 type=write size=3479814 2024-02-23T06:34:19.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.994+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~UWJPR5F27QM9.0 size=627361 2024-02-23T06:34:19.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.996+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=UWJPR5F27QM9 tag=4CAD6HU76G1O type=write size=1675937 2024-02-23T06:34:19.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.997+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=7FIO3DBVEEUO type=del size=2080082 2024-02-23T06:34:19.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.998+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~HF51QFQHAFVC.0 size=1048576 2024-02-23T06:34:19.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:19.999+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~HF51QFQHAFVC.1 size=271503 2024-02-23T06:34:20.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.001+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=HF51QFQHAFVC tag=4U66URBD5RUY type=write size=2368655 2024-02-23T06:34:20.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.003+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~2BFF0C0SFG7E.0 size=1048576 2024-02-23T06:34:20.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.004+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~2BFF0C0SFG7E.1 size=1048576 2024-02-23T06:34:20.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.005+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~2BFF0C0SFG7E.2 size=430567 2024-02-23T06:34:20.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.005+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=2BFF0C0SFG7E tag=ZNFZ7FBRHRSL type=write size=3576295 2024-02-23T06:34:20.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.006+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=2UKSDWLD7Q4P type=del 2024-02-23T06:34:20.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.008+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~UDJBNWNMZXKG.0 size=1048576 2024-02-23T06:34:20.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.009+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~UDJBNWNMZXKG.1 size=611742 2024-02-23T06:34:20.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.009+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=UDJBNWNMZXKG tag=RDM2T8KR8FDD type=write size=2708894 2024-02-23T06:34:20.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.010+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=KNLRI12AJJB2 type=del 2024-02-23T06:34:20.012 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.011+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=S12KXLFD17KI type=del size=1097969 2024-02-23T06:34:20.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.013+0000 7f5e72834780 1 < canceled operation key=RS03NUABC1U2 tag=S3CV4FFB7LZU type=write size=198132 2024-02-23T06:34:20.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.015+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~6NOBFOPAS0P0.0 size=1048576 2024-02-23T06:34:20.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.016+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~6NOBFOPAS0P0.1 size=1048576 2024-02-23T06:34:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.017+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~6NOBFOPAS0P0.2 size=49067 2024-02-23T06:34:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.017+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=6NOBFOPAS0P0 tag=4QRGZZ09O73N type=write size=3194795 2024-02-23T06:34:20.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.018+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=SG7ZLAFDNCS1 type=del 2024-02-23T06:34:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.019+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=89G06HP2ROAE type=del size=2437137 2024-02-23T06:34:20.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.020+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=0BRNKN1YXXPO type=del 2024-02-23T06:34:20.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.021+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=CLFVMCE4D8JU type=del size=211150 2024-02-23T06:34:20.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.022+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~GJ2XWBKCOKPG.0 size=1048576 2024-02-23T06:34:20.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.023+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~GJ2XWBKCOKPG.1 size=668245 2024-02-23T06:34:20.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.025+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=GJ2XWBKCOKPG tag=2IFS0D2H6220 type=write size=2765397 2024-02-23T06:34:20.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.026+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=XKC8PTGMOQPO type=del size=3875795 2024-02-23T06:34:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.027+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=VE9GDRMJGTPH type=del 2024-02-23T06:34:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.030+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~LSUZ9J9FCXZH.0 size=1048576 2024-02-23T06:34:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.030+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~LSUZ9J9FCXZH.1 size=650328 2024-02-23T06:34:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.030+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=LSUZ9J9FCXZH tag=8CVIEN6VZ0ME type=write size=2747480 2024-02-23T06:34:20.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.032+0000 7f5e72834780 1 < completed write operation key=N8RXOY8X71MO tag=JYPIFY7O2NN3 type=write size=542710 2024-02-23T06:34:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.034+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~BM42W33F3WAT.0 size=1048576 2024-02-23T06:34:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.035+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~BM42W33F3WAT.1 size=476806 2024-02-23T06:34:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.035+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=BM42W33F3WAT tag=ZIPHJJ280BL0 type=write size=2573958 2024-02-23T06:34:20.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.036+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=ZNREEKGC5OZE type=write size=897362 2024-02-23T06:34:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.038+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~Q5957P3W0V4V.0 size=101405 2024-02-23T06:34:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.038+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=Q5957P3W0V4V tag=OJ93AE7ZUPQQ type=write size=1149981 2024-02-23T06:34:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.039+0000 7f5e72834780 1 < canceled operation key=26EE3EHDK8EM tag=HCMY8SPSKTAX type=del size=3851218 2024-02-23T06:34:20.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.041+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~H80D7R47Z8WF.0 size=168757 2024-02-23T06:34:20.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.041+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=H80D7R47Z8WF tag=HCYDMX9DNZVI type=write size=1217333 2024-02-23T06:34:20.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.042+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=9V7GK0XGDFHI type=del 2024-02-23T06:34:20.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.044+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~0ZRKOEQ7DAW3.0 size=217133 2024-02-23T06:34:20.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.044+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=0ZRKOEQ7DAW3 tag=R69C8PRE3E2M type=write size=1265709 2024-02-23T06:34:20.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.046+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~6KPQPIDYIIFM.0 size=796845 2024-02-23T06:34:20.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.048+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=6KPQPIDYIIFM tag=TRINMN6KLILE type=write size=1845421 2024-02-23T06:34:20.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.049+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=55GBE5VHOVS2 type=del size=3218040 2024-02-23T06:34:20.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.050+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=NTHCC3O1JBHH type=write size=482229 2024-02-23T06:34:20.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.051+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=LY6DCS19WUTS type=del size=1323934 2024-02-23T06:34:20.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.053+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~3RW9MI1JAYNL.0 size=1048576 2024-02-23T06:34:20.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.054+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~3RW9MI1JAYNL.1 size=1048576 2024-02-23T06:34:20.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.055+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~3RW9MI1JAYNL.2 size=334086 2024-02-23T06:34:20.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.057+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=3RW9MI1JAYNL tag=V7K84HP8ZLS8 type=write size=3479814 2024-02-23T06:34:20.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.058+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=PRU3T4WEVSH1 type=del size=402210 2024-02-23T06:34:20.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.059+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=7FIO3DBVEEUO type=del 2024-02-23T06:34:20.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.060+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=EMW7EAQPG806 type=write size=638093 2024-02-23T06:34:20.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.061+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~2BFF0C0SFG7E.0 size=1048576 2024-02-23T06:34:20.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.062+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~2BFF0C0SFG7E.1 size=1048576 2024-02-23T06:34:20.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.063+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~2BFF0C0SFG7E.2 size=430567 2024-02-23T06:34:20.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.065+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=2BFF0C0SFG7E tag=ZNFZ7FBRHRSL type=write size=3576295 2024-02-23T06:34:20.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.066+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=KZ0W818QV5U4 type=del size=1911236 2024-02-23T06:34:20.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.067+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~UDJBNWNMZXKG.0 size=1048576 2024-02-23T06:34:20.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.068+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~UDJBNWNMZXKG.1 size=611742 2024-02-23T06:34:20.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.070+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=UDJBNWNMZXKG tag=RDM2T8KR8FDD type=write size=2708894 2024-02-23T06:34:20.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.073+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~YDIA2QKKE4Q1.0 size=1048576 2024-02-23T06:34:20.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.074+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~YDIA2QKKE4Q1.1 size=1048576 2024-02-23T06:34:20.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.074+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~YDIA2QKKE4Q1.2 size=695620 2024-02-23T06:34:20.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.074+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=YDIA2QKKE4Q1 tag=7AD3DSXRPRE3 type=write size=3841348 2024-02-23T06:34:20.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.076+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=S12KXLFD17KI type=del 2024-02-23T06:34:20.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.078+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~97RER0CYNNFS.0 size=472673 2024-02-23T06:34:20.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.078+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=97RER0CYNNFS tag=Y66KZK8JZNGZ type=write size=1521249 2024-02-23T06:34:20.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.080+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~6NOBFOPAS0P0.0 size=1048576 2024-02-23T06:34:20.081 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.081+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~6NOBFOPAS0P0.1 size=1048576 2024-02-23T06:34:20.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.082+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~6NOBFOPAS0P0.2 size=49067 2024-02-23T06:34:20.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.084+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=6NOBFOPAS0P0 tag=4QRGZZ09O73N type=write size=3194795 2024-02-23T06:34:20.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.085+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=1QTXHJPL0UO7 type=del size=3523759 2024-02-23T06:34:20.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.086+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=89G06HP2ROAE type=del 2024-02-23T06:34:20.087 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.087+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=ZDTHR11F2HNF type=del size=3253868 2024-02-23T06:34:20.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.089+0000 7f5e72834780 1 < suggested update operation key=VEJ6D2J3LZI8 tag=CLFVMCE4D8JU type=del size=211150 2024-02-23T06:34:20.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.092+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~N5AZM4QB1YCH.0 size=108622 2024-02-23T06:34:20.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.092+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=N5AZM4QB1YCH tag=2I2AFZU5C965 type=write size=1157198 2024-02-23T06:34:20.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.093+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=XKC8PTGMOQPO type=del 2024-02-23T06:34:20.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.094+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=AHJN3UQHFGK9 type=del size=411225 2024-02-23T06:34:20.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.095+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~LSUZ9J9FCXZH.0 size=1048576 2024-02-23T06:34:20.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.096+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~LSUZ9J9FCXZH.1 size=650328 2024-02-23T06:34:20.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.098+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=LSUZ9J9FCXZH tag=8CVIEN6VZ0ME type=write size=2747480 2024-02-23T06:34:20.100 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.099+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~98UN3A0W2LXA.0 size=1048576 2024-02-23T06:34:20.100 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.100+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~98UN3A0W2LXA.1 size=1048576 2024-02-23T06:34:20.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.102+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~98UN3A0W2LXA.2 size=676600 2024-02-23T06:34:20.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.102+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=98UN3A0W2LXA tag=Q4DGWU8LUUKW type=write size=3822328 2024-02-23T06:34:20.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.103+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~BM42W33F3WAT.0 size=1048576 2024-02-23T06:34:20.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.104+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~BM42W33F3WAT.1 size=476806 2024-02-23T06:34:20.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.106+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=BM42W33F3WAT tag=ZIPHJJ280BL0 type=write size=2573958 2024-02-23T06:34:20.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.108+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~CP5IPUD4YFNS.0 size=1048576 2024-02-23T06:34:20.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.109+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~CP5IPUD4YFNS.1 size=1048576 2024-02-23T06:34:20.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.110+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~CP5IPUD4YFNS.2 size=722205 2024-02-23T06:34:20.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.110+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=CP5IPUD4YFNS tag=1YQQ7TQFO2YD type=write size=3867933 2024-02-23T06:34:20.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.111+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~Q5957P3W0V4V.0 size=101405 2024-02-23T06:34:20.113 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.113+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=Q5957P3W0V4V tag=OJ93AE7ZUPQQ type=write size=1149981 2024-02-23T06:34:20.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.115+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~UFE0LYX5PUWN.0 size=548183 2024-02-23T06:34:20.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.115+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=UFE0LYX5PUWN tag=AXKAVM2PWYCN type=write size=1596759 2024-02-23T06:34:20.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.117+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~H80D7R47Z8WF.0 size=168757 2024-02-23T06:34:20.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.119+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=H80D7R47Z8WF tag=HCYDMX9DNZVI type=write size=1217333 2024-02-23T06:34:20.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.122+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~Y6SIGUDV8YBC.0 size=1048576 2024-02-23T06:34:20.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.123+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~Y6SIGUDV8YBC.1 size=338683 2024-02-23T06:34:20.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.123+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=Y6SIGUDV8YBC tag=3DO2MJ22NLH1 type=write size=2435835 2024-02-23T06:34:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.124+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~0ZRKOEQ7DAW3.0 size=217133 2024-02-23T06:34:20.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.126+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=0ZRKOEQ7DAW3 tag=R69C8PRE3E2M type=write size=1265709 2024-02-23T06:34:20.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.127+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=VDDVMFYZDSSJ type=del size=3463814 2024-02-23T06:34:20.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.128+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=55GBE5VHOVS2 type=del 2024-02-23T06:34:20.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.130+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~YMZV5GZU3X1F.0 size=785914 2024-02-23T06:34:20.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.130+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=YMZV5GZU3X1F tag=XYRWHKO6OMC3 type=write size=1834490 2024-02-23T06:34:20.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.131+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=LY6DCS19WUTS type=del 2024-02-23T06:34:20.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.132+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=6KKW7EZU82VQ type=del size=527910 2024-02-23T06:34:20.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.135+0000 7f5e72834780 1 < suggested remove operation key=7N8OH7EETRN8 tag=PRU3T4WEVSH1 type=del 2024-02-23T06:34:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.136+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=5ACZ9N3VTKAM type=del size=3947359 2024-02-23T06:34:20.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.137+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=EMW7EAQPG806 type=write size=638093 2024-02-23T06:34:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.138+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=3E4H51TOUONF type=del size=2710934 2024-02-23T06:34:20.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.139+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=KZ0W818QV5U4 type=del 2024-02-23T06:34:20.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.140+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=ZNR6O40W3PG2 type=del size=1236531 2024-02-23T06:34:20.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.142+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~YDIA2QKKE4Q1.0 size=1048576 2024-02-23T06:34:20.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.142+0000 7f5e72834780 1 < canceled part key=_multipart_9ZCNDGBEPWMN.2~YDIA2QKKE4Q1.1 size=1048576 2024-02-23T06:34:20.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.142+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~YDIA2QKKE4Q1.2 size=695620 2024-02-23T06:34:20.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.144+0000 7f5e72834780 1 < canceled multipart upload key=9ZCNDGBEPWMN upload=YDIA2QKKE4Q1 tag=7AD3DSXRPRE3 type=write size=3841348 2024-02-23T06:34:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.145+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=F3LNLJCTMZOU type=del size=1288288 2024-02-23T06:34:20.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.147+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~97RER0CYNNFS.0 size=472673 2024-02-23T06:34:20.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.149+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=97RER0CYNNFS tag=Y66KZK8JZNGZ type=write size=1521249 2024-02-23T06:34:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.151+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~D7Z9TB2PNJSS.0 size=827950 2024-02-23T06:34:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.151+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=D7Z9TB2PNJSS tag=NDKXWRM3RR92 type=write size=1876526 2024-02-23T06:34:20.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.152+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=1QTXHJPL0UO7 type=del 2024-02-23T06:34:20.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.153+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=OM4FBBGUJR3D type=del size=408171 2024-02-23T06:34:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.154+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=ZDTHR11F2HNF type=del 2024-02-23T06:34:20.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.156+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~FPRHIAU16B3X.0 size=1048576 2024-02-23T06:34:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.157+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~FPRHIAU16B3X.1 size=1048576 2024-02-23T06:34:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.158+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~FPRHIAU16B3X.2 size=658342 2024-02-23T06:34:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.158+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=FPRHIAU16B3X tag=N5IGKVTGSSG8 type=write size=3804070 2024-02-23T06:34:20.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.159+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~N5AZM4QB1YCH.0 size=108622 2024-02-23T06:34:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.161+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=N5AZM4QB1YCH tag=2I2AFZU5C965 type=write size=1157198 2024-02-23T06:34:20.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.162+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=0P4VP2KSCQQO type=del size=3655017 2024-02-23T06:34:20.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.163+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=AHJN3UQHFGK9 type=del 2024-02-23T06:34:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.164+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=GUDNSZNWVFKS type=write size=747251 2024-02-23T06:34:20.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.165+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~98UN3A0W2LXA.0 size=1048576 2024-02-23T06:34:20.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.166+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~98UN3A0W2LXA.1 size=1048576 2024-02-23T06:34:20.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.167+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~98UN3A0W2LXA.2 size=676600 2024-02-23T06:34:20.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.169+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=98UN3A0W2LXA tag=Q4DGWU8LUUKW type=write size=3822328 2024-02-23T06:34:20.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.170+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=68WJS93J1EV8 type=del size=2250061 2024-02-23T06:34:20.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.171+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~CP5IPUD4YFNS.0 size=1048576 2024-02-23T06:34:20.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.172+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~CP5IPUD4YFNS.1 size=1048576 2024-02-23T06:34:20.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.173+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~CP5IPUD4YFNS.2 size=722205 2024-02-23T06:34:20.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.175+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=CP5IPUD4YFNS tag=1YQQ7TQFO2YD type=write size=3867933 2024-02-23T06:34:20.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.176+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=ZDF6X0UV4JTD type=del size=3183394 2024-02-23T06:34:20.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.177+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~UFE0LYX5PUWN.0 size=548183 2024-02-23T06:34:20.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.179+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=UFE0LYX5PUWN tag=AXKAVM2PWYCN type=write size=1596759 2024-02-23T06:34:20.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.182+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~4EX7AEO9TNWF.0 size=1048576 2024-02-23T06:34:20.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.183+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~4EX7AEO9TNWF.1 size=1048576 2024-02-23T06:34:20.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.184+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~4EX7AEO9TNWF.2 size=1005669 2024-02-23T06:34:20.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.184+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=4EX7AEO9TNWF tag=XEQ621P8FNN2 type=write size=4151397 2024-02-23T06:34:20.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.185+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~Y6SIGUDV8YBC.0 size=1048576 2024-02-23T06:34:20.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.187+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~Y6SIGUDV8YBC.1 size=338683 2024-02-23T06:34:20.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.189+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=Y6SIGUDV8YBC tag=3DO2MJ22NLH1 type=write size=2435835 2024-02-23T06:34:20.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.191+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~JOQRVWZCI1JC.0 size=1048576 2024-02-23T06:34:20.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.192+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~JOQRVWZCI1JC.1 size=1048576 2024-02-23T06:34:20.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.193+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~JOQRVWZCI1JC.2 size=905028 2024-02-23T06:34:20.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.193+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=JOQRVWZCI1JC tag=X07TNP20NCGN type=write size=4050756 2024-02-23T06:34:20.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.194+0000 7f5e72834780 1 < canceled operation key=GW6EKQ84FQ6L tag=VDDVMFYZDSSJ type=del size=3463814 2024-02-23T06:34:20.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.196+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~2DJ1TYA4WOFV.0 size=1048576 2024-02-23T06:34:20.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.197+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~2DJ1TYA4WOFV.1 size=1048576 2024-02-23T06:34:20.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.198+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~2DJ1TYA4WOFV.2 size=72893 2024-02-23T06:34:20.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.198+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=2DJ1TYA4WOFV tag=6R6RXA0AZYKK type=write size=3218621 2024-02-23T06:34:20.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.199+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~YMZV5GZU3X1F.0 size=785914 2024-02-23T06:34:20.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.201+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=YMZV5GZU3X1F tag=XYRWHKO6OMC3 type=write size=1834490 2024-02-23T06:34:20.202 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.202+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=87XKA2WE23S6 type=del size=2861310 2024-02-23T06:34:20.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.204+0000 7f5e72834780 1 < suggested update operation key=QGGULCYZ0ZSA tag=6KKW7EZU82VQ type=del size=527910 2024-02-23T06:34:20.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.206+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=X4PB23GZOAD6 type=write size=199863 2024-02-23T06:34:20.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.207+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=5ACZ9N3VTKAM type=del 2024-02-23T06:34:20.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.209+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~2CMKT38PW4RM.0 size=1048576 2024-02-23T06:34:20.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.210+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~2CMKT38PW4RM.1 size=381441 2024-02-23T06:34:20.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.210+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=2CMKT38PW4RM tag=Q8AV7W6U6D6L type=write size=2478593 2024-02-23T06:34:20.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.211+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=3E4H51TOUONF type=del 2024-02-23T06:34:20.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.212+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=QCQE974HBQDN type=write size=859053 2024-02-23T06:34:20.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.213+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=ZNR6O40W3PG2 type=del 2024-02-23T06:34:20.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.215+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=2MVZXEXDHYJ4 type=del size=231383 2024-02-23T06:34:20.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.216+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=F3LNLJCTMZOU type=del 2024-02-23T06:34:20.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.218+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~DAOYGJWNY0PA.0 size=814881 2024-02-23T06:34:20.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.218+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=DAOYGJWNY0PA tag=W2HTWVPZIZC6 type=write size=1863457 2024-02-23T06:34:20.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.219+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~D7Z9TB2PNJSS.0 size=827950 2024-02-23T06:34:20.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.221+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=D7Z9TB2PNJSS tag=NDKXWRM3RR92 type=write size=1876526 2024-02-23T06:34:20.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.223+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~QJ53LRI26Z47.0 size=1048576 2024-02-23T06:34:20.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.224+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~QJ53LRI26Z47.1 size=1048576 2024-02-23T06:34:20.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.225+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~QJ53LRI26Z47.2 size=691293 2024-02-23T06:34:20.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.225+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=QJ53LRI26Z47 tag=ZIZ689Q1R241 type=write size=3837021 2024-02-23T06:34:20.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.227+0000 7f5e72834780 1 < suggested remove operation key=TNH85ZWPALJN tag=OM4FBBGUJR3D type=del 2024-02-23T06:34:20.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.228+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=0DBDOEEMWLUJ type=del size=356235 2024-02-23T06:34:20.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.229+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~FPRHIAU16B3X.0 size=1048576 2024-02-23T06:34:20.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.230+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~FPRHIAU16B3X.1 size=1048576 2024-02-23T06:34:20.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.231+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~FPRHIAU16B3X.2 size=658342 2024-02-23T06:34:20.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.235+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=FPRHIAU16B3X tag=N5IGKVTGSSG8 type=write size=3804070 2024-02-23T06:34:20.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.237+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~NOVF42TVSTAQ.0 size=962249 2024-02-23T06:34:20.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.237+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=NOVF42TVSTAQ tag=0H4UI1N1NWFF type=write size=2010825 2024-02-23T06:34:20.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.238+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=0P4VP2KSCQQO type=del 2024-02-23T06:34:20.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.240+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~NHZ5473HHUGM.0 size=1048576 2024-02-23T06:34:20.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.241+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~NHZ5473HHUGM.1 size=18482 2024-02-23T06:34:20.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.241+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=NHZ5473HHUGM tag=O0ER2GROZIFV type=write size=2115634 2024-02-23T06:34:20.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.242+0000 7f5e72834780 1 < completed write operation key=ZM1YKZOUFSCY tag=GUDNSZNWVFKS type=write size=747251 2024-02-23T06:34:20.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.243+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=NONUJTAKQ5JN type=del size=2131244 2024-02-23T06:34:20.245 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.244+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=68WJS93J1EV8 type=del 2024-02-23T06:34:20.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.246+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=UG0IJISVDHMN type=del size=849709 2024-02-23T06:34:20.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.248+0000 7f5e72834780 1 < suggested remove operation key=TPADM4812N0Z tag=ZDF6X0UV4JTD type=del 2024-02-23T06:34:20.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.250+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~X9S1YTX2VMJ0.0 size=56801 2024-02-23T06:34:20.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.250+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=X9S1YTX2VMJ0 tag=F96V1E5VCT8Z type=write size=1105377 2024-02-23T06:34:20.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.251+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~4EX7AEO9TNWF.0 size=1048576 2024-02-23T06:34:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.252+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~4EX7AEO9TNWF.1 size=1048576 2024-02-23T06:34:20.256 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.255+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~4EX7AEO9TNWF.2 size=1005669 2024-02-23T06:34:20.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.257+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=4EX7AEO9TNWF tag=XEQ621P8FNN2 type=write size=4151397 2024-02-23T06:34:20.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.258+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=DCX6AOLLWWZ6 type=del size=1097572 2024-02-23T06:34:20.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.259+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~JOQRVWZCI1JC.0 size=1048576 2024-02-23T06:34:20.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.260+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~JOQRVWZCI1JC.1 size=1048576 2024-02-23T06:34:20.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.261+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~JOQRVWZCI1JC.2 size=905028 2024-02-23T06:34:20.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.263+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=JOQRVWZCI1JC tag=X07TNP20NCGN type=write size=4050756 2024-02-23T06:34:20.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.265+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~SUF4FYDCWJUU.0 size=249878 2024-02-23T06:34:20.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.265+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=SUF4FYDCWJUU tag=03K1Y8QOQOP8 type=write size=1298454 2024-02-23T06:34:20.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.266+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~2DJ1TYA4WOFV.0 size=1048576 2024-02-23T06:34:20.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.267+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~2DJ1TYA4WOFV.1 size=1048576 2024-02-23T06:34:20.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.268+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~2DJ1TYA4WOFV.2 size=72893 2024-02-23T06:34:20.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.270+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=2DJ1TYA4WOFV tag=6R6RXA0AZYKK type=write size=3218621 2024-02-23T06:34:20.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.273+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~1UHP3X1YJT0T.0 size=1048576 2024-02-23T06:34:20.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.274+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~1UHP3X1YJT0T.1 size=705922 2024-02-23T06:34:20.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.274+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=1UHP3X1YJT0T tag=0ZY7B7SKQQLL type=write size=2803074 2024-02-23T06:34:20.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.276+0000 7f5e72834780 1 < suggested remove operation key=7N8OH7EETRN8 tag=87XKA2WE23S6 type=del 2024-02-23T06:34:20.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.277+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=SI2MFH9DIP5G type=write size=438395 2024-02-23T06:34:20.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.280+0000 7f5e72834780 1 < suggested remove operation key=9ZCNDGBEPWMN tag=X4PB23GZOAD6 type=write 2024-02-23T06:34:20.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.281+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=BBNR988XW0BT type=write size=864103 2024-02-23T06:34:20.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.282+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~2CMKT38PW4RM.0 size=1048576 2024-02-23T06:34:20.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.283+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~2CMKT38PW4RM.1 size=381441 2024-02-23T06:34:20.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.285+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=2CMKT38PW4RM tag=Q8AV7W6U6D6L type=write size=2478593 2024-02-23T06:34:20.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.286+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=8QKJ2VVEK52V type=del size=1168188 2024-02-23T06:34:20.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.287+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=QCQE974HBQDN type=write size=859053 2024-02-23T06:34:20.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.288+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=SSR94FVRL7UE type=del size=2201756 2024-02-23T06:34:20.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.290+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=2MVZXEXDHYJ4 type=del 2024-02-23T06:34:20.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.291+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=WNR5BL35U8P9 type=write size=519163 2024-02-23T06:34:20.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.292+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~DAOYGJWNY0PA.0 size=814881 2024-02-23T06:34:20.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.294+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=DAOYGJWNY0PA tag=W2HTWVPZIZC6 type=write size=1863457 2024-02-23T06:34:20.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.295+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=GJBUI1MZWFT8 type=del size=823947 2024-02-23T06:34:20.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.296+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~QJ53LRI26Z47.0 size=1048576 2024-02-23T06:34:20.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.298+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~QJ53LRI26Z47.1 size=1048576 2024-02-23T06:34:20.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.299+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~QJ53LRI26Z47.2 size=691293 2024-02-23T06:34:20.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.303+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=QJ53LRI26Z47 tag=ZIZ689Q1R241 type=write size=3837021 2024-02-23T06:34:20.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.304+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=VNR7FT9ZR649 type=write size=939644 2024-02-23T06:34:20.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.305+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=0DBDOEEMWLUJ type=del 2024-02-23T06:34:20.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.306+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=48S8BLH38OBL type=del size=3121535 2024-02-23T06:34:20.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.307+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~NOVF42TVSTAQ.0 size=962249 2024-02-23T06:34:20.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.309+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=NOVF42TVSTAQ tag=0H4UI1N1NWFF type=write size=2010825 2024-02-23T06:34:20.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.311+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~D4EX2NZ7B0G3.0 size=1048576 2024-02-23T06:34:20.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.312+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~D4EX2NZ7B0G3.1 size=1037814 2024-02-23T06:34:20.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.312+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=D4EX2NZ7B0G3 tag=68KWWFQ935NY type=write size=3134966 2024-02-23T06:34:20.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.313+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~NHZ5473HHUGM.0 size=1048576 2024-02-23T06:34:20.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.314+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~NHZ5473HHUGM.1 size=18482 2024-02-23T06:34:20.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.316+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=NHZ5473HHUGM tag=O0ER2GROZIFV type=write size=2115634 2024-02-23T06:34:20.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.317+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=LVYX19O4SUXW type=write size=177494 2024-02-23T06:34:20.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.319+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=NONUJTAKQ5JN type=del 2024-02-23T06:34:20.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.320+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=95H62TN5WP14 type=del size=981540 2024-02-23T06:34:20.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.321+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=UG0IJISVDHMN type=del 2024-02-23T06:34:20.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.323+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~8U59ESO8Q55H.0 size=1048576 2024-02-23T06:34:20.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.324+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~8U59ESO8Q55H.1 size=1048576 2024-02-23T06:34:20.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.325+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~8U59ESO8Q55H.2 size=598643 2024-02-23T06:34:20.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.325+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=8U59ESO8Q55H tag=3ER72G19TPR9 type=write size=3744371 2024-02-23T06:34:20.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.326+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~X9S1YTX2VMJ0.0 size=56801 2024-02-23T06:34:20.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.328+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=X9S1YTX2VMJ0 tag=F96V1E5VCT8Z type=write size=1105377 2024-02-23T06:34:20.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.329+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=STBYK3N2BIME type=del size=3083716 2024-02-23T06:34:20.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.332+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=DCX6AOLLWWZ6 type=del 2024-02-23T06:34:20.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.334+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~F6TC0X5OA188.0 size=1048576 2024-02-23T06:34:20.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.335+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~F6TC0X5OA188.1 size=1048576 2024-02-23T06:34:20.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.335+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~F6TC0X5OA188.2 size=195092 2024-02-23T06:34:20.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.335+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=F6TC0X5OA188 tag=N8IYD0H287MB type=write size=3340820 2024-02-23T06:34:20.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.337+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~SUF4FYDCWJUU.0 size=249878 2024-02-23T06:34:20.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.338+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=SUF4FYDCWJUU tag=03K1Y8QOQOP8 type=write size=1298454 2024-02-23T06:34:20.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.340+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=78VIC2AJ1V7H type=del size=60582 2024-02-23T06:34:20.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.341+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~1UHP3X1YJT0T.0 size=1048576 2024-02-23T06:34:20.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.342+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~1UHP3X1YJT0T.1 size=705922 2024-02-23T06:34:20.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.343+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=1UHP3X1YJT0T tag=0ZY7B7SKQQLL type=write size=2803074 2024-02-23T06:34:20.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.345+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=3MWEWNNT86P3 type=del size=2416292 2024-02-23T06:34:20.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.346+0000 7f5e72834780 1 < completed write operation key=N8RXOY8X71MO tag=SI2MFH9DIP5G type=write size=438395 2024-02-23T06:34:20.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.347+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=612GQUEIBDX4 type=write size=650780 2024-02-23T06:34:20.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.348+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=BBNR988XW0BT type=write size=864103 2024-02-23T06:34:20.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.350+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~LGOVHN0LJ0DA.0 size=673399 2024-02-23T06:34:20.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.350+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=LGOVHN0LJ0DA tag=8OS0TNYV6MFR type=write size=1721975 2024-02-23T06:34:20.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.351+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=8QKJ2VVEK52V type=del 2024-02-23T06:34:20.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.352+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=URZE7E9C1ERV type=write size=67108 2024-02-23T06:34:20.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.354+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=SSR94FVRL7UE type=del 2024-02-23T06:34:20.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.355+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=R751Z6GJC2LM type=write size=384503 2024-02-23T06:34:20.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.356+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=WNR5BL35U8P9 type=write size=519163 2024-02-23T06:34:20.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.357+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=1RU4HKT0BIKP type=del size=3439969 2024-02-23T06:34:20.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.358+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=GJBUI1MZWFT8 type=del 2024-02-23T06:34:20.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.359+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=4GDA16D3OXW4 type=del size=1520536 2024-02-23T06:34:20.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.361+0000 7f5e72834780 1 < canceled operation key=9AQCXLBZW3EV tag=VNR7FT9ZR649 type=write size=939644 2024-02-23T06:34:20.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.362+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=6IURSVUBO69H type=write size=352110 2024-02-23T06:34:20.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.364+0000 7f5e72834780 1 < suggested update operation key=R3STDBS79MV0 tag=48S8BLH38OBL type=del size=3121535 2024-02-23T06:34:20.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.366+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~RCT9XUZF0L8E.0 size=1048576 2024-02-23T06:34:20.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.367+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~RCT9XUZF0L8E.1 size=39762 2024-02-23T06:34:20.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.367+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=RCT9XUZF0L8E tag=C2VEDP3WM626 type=write size=2136914 2024-02-23T06:34:20.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.368+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~D4EX2NZ7B0G3.0 size=1048576 2024-02-23T06:34:20.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.369+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~D4EX2NZ7B0G3.1 size=1037814 2024-02-23T06:34:20.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.371+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=D4EX2NZ7B0G3 tag=68KWWFQ935NY type=write size=3134966 2024-02-23T06:34:20.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.372+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=3ST2LU2RDNDH type=write size=1019229 2024-02-23T06:34:20.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.375+0000 7f5e72834780 1 < suggested update operation key=TPADM4812N0Z tag=LVYX19O4SUXW type=write size=177494 2024-02-23T06:34:20.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.377+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~BE2GZB34WH0I.0 size=1048576 2024-02-23T06:34:20.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.378+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~BE2GZB34WH0I.1 size=1000157 2024-02-23T06:34:20.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.378+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=BE2GZB34WH0I tag=0QN0MPPFT4P1 type=write size=3097309 2024-02-23T06:34:20.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.379+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=95H62TN5WP14 type=del 2024-02-23T06:34:20.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.380+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=IDQFRSH4QEKB type=del size=577600 2024-02-23T06:34:20.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.382+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~8U59ESO8Q55H.0 size=1048576 2024-02-23T06:34:20.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.383+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~8U59ESO8Q55H.1 size=1048576 2024-02-23T06:34:20.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.384+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~8U59ESO8Q55H.2 size=598643 2024-02-23T06:34:20.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.387+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=8U59ESO8Q55H tag=3ER72G19TPR9 type=write size=3744371 2024-02-23T06:34:20.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.388+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=6USX0FZ6HGH3 type=del size=1465520 2024-02-23T06:34:20.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.390+0000 7f5e72834780 1 < canceled operation key=WETP4ONTU3HL tag=STBYK3N2BIME type=del size=3083716 2024-02-23T06:34:20.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.392+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~BJAIFV57ZX7M.0 size=1048576 2024-02-23T06:34:20.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.393+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~BJAIFV57ZX7M.1 size=428099 2024-02-23T06:34:20.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.393+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=BJAIFV57ZX7M tag=ES6421JBN8VI type=write size=2525251 2024-02-23T06:34:20.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.394+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~F6TC0X5OA188.0 size=1048576 2024-02-23T06:34:20.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.395+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~F6TC0X5OA188.1 size=1048576 2024-02-23T06:34:20.397 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.396+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~F6TC0X5OA188.2 size=195092 2024-02-23T06:34:20.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.398+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=F6TC0X5OA188 tag=N8IYD0H287MB type=write size=3340820 2024-02-23T06:34:20.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.400+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=WZFU6Y9KZ346 type=write size=744018 2024-02-23T06:34:20.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.401+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=78VIC2AJ1V7H type=del 2024-02-23T06:34:20.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.403+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~MNA5L8CQKZHC.0 size=395130 2024-02-23T06:34:20.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.403+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=MNA5L8CQKZHC tag=6AGA7C4UJS0K type=write size=1443706 2024-02-23T06:34:20.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.405+0000 7f5e72834780 -1 < failed to complete operation key=TPADM4812N0Z tag=3MWEWNNT86P3 type=del size=2416292: (22) Invalid argument 2024-02-23T06:34:20.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.406+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=P5JAXZTGA80O type=write size=323619 2024-02-23T06:34:20.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.408+0000 7f5e72834780 1 < suggested remove operation key=GACVVXC2Z1YO tag=612GQUEIBDX4 type=write 2024-02-23T06:34:20.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.409+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=Q7WG7I7EMWBW type=write size=52623 2024-02-23T06:34:20.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.410+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~LGOVHN0LJ0DA.0 size=673399 2024-02-23T06:34:20.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.413+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=LGOVHN0LJ0DA tag=8OS0TNYV6MFR type=write size=1721975 2024-02-23T06:34:20.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.415+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~S9ME7ITQVSSS.0 size=1048576 2024-02-23T06:34:20.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.416+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~S9ME7ITQVSSS.1 size=1048576 2024-02-23T06:34:20.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.417+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~S9ME7ITQVSSS.2 size=247352 2024-02-23T06:34:20.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.417+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=S9ME7ITQVSSS tag=QR4961LGX500 type=write size=3393080 2024-02-23T06:34:20.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.418+0000 7f5e72834780 1 < completed write operation key=03P6IEKSHB17 tag=URZE7E9C1ERV type=write size=67108 2024-02-23T06:34:20.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.420+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~S5WAF3OSYM4J.0 size=1048576 2024-02-23T06:34:20.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.422+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~S5WAF3OSYM4J.1 size=1048576 2024-02-23T06:34:20.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.423+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~S5WAF3OSYM4J.2 size=600971 2024-02-23T06:34:20.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.423+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=S5WAF3OSYM4J tag=8FTO55TC14T8 type=write size=3746699 2024-02-23T06:34:20.424 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.424+0000 7f5e72834780 1 < canceled operation key=4M7BT05YB0C3 tag=R751Z6GJC2LM type=write size=384503 2024-02-23T06:34:20.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.426+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~O86T5NT6S0HT.0 size=1048576 2024-02-23T06:34:20.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.427+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~O86T5NT6S0HT.1 size=1048576 2024-02-23T06:34:20.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.428+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~O86T5NT6S0HT.2 size=677617 2024-02-23T06:34:20.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.428+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=O86T5NT6S0HT tag=JOF1CQRXK5U6 type=write size=3823345 2024-02-23T06:34:20.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.429+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=1RU4HKT0BIKP type=del 2024-02-23T06:34:20.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.431+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~VYJOG931FROY.0 size=1048576 2024-02-23T06:34:20.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.432+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~VYJOG931FROY.1 size=171844 2024-02-23T06:34:20.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.432+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=VYJOG931FROY tag=96MSSQNDIRKK type=write size=2268996 2024-02-23T06:34:20.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.434+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=4GDA16D3OXW4 type=del 2024-02-23T06:34:20.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.436+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~R0M78XKXADI7.0 size=1048576 2024-02-23T06:34:20.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.437+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~R0M78XKXADI7.1 size=685579 2024-02-23T06:34:20.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.437+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=R0M78XKXADI7 tag=V8RDTGKTV6WN type=write size=2782731 2024-02-23T06:34:20.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.438+0000 7f5e72834780 -1 < failed to complete operation key=GACVVXC2Z1YO tag=6IURSVUBO69H type=write size=352110: (22) Invalid argument 2024-02-23T06:34:20.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.440+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=R8AOCVACW2JT type=del size=18407 2024-02-23T06:34:20.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.441+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~RCT9XUZF0L8E.0 size=1048576 2024-02-23T06:34:20.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.442+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~RCT9XUZF0L8E.1 size=39762 2024-02-23T06:34:20.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.444+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=RCT9XUZF0L8E tag=C2VEDP3WM626 type=write size=2136914 2024-02-23T06:34:20.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.446+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~2LQOWU06EPMI.0 size=1048576 2024-02-23T06:34:20.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.447+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~2LQOWU06EPMI.1 size=61335 2024-02-23T06:34:20.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.447+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=2LQOWU06EPMI tag=TJ3NKVN3ZPG1 type=write size=2158487 2024-02-23T06:34:20.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.448+0000 7f5e72834780 1 < completed write operation key=WK98HMHAZIUB tag=3ST2LU2RDNDH type=write size=1019229 2024-02-23T06:34:20.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.450+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=9GDO0FQIMFMI type=del size=3275722 2024-02-23T06:34:20.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.452+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~BE2GZB34WH0I.0 size=1048576 2024-02-23T06:34:20.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.453+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~BE2GZB34WH0I.1 size=1000157 2024-02-23T06:34:20.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.455+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=BE2GZB34WH0I tag=0QN0MPPFT4P1 type=write size=3097309 2024-02-23T06:34:20.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.457+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~5K63K3X06R73.0 size=53083 2024-02-23T06:34:20.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.457+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=5K63K3X06R73 tag=9PUKM0FWU9QE type=write size=1101659 2024-02-23T06:34:20.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.458+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=IDQFRSH4QEKB type=del 2024-02-23T06:34:20.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.459+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=HX8774DNRCTP type=del size=1479261 2024-02-23T06:34:20.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.461+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=6USX0FZ6HGH3 type=del 2024-02-23T06:34:20.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.462+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=0JWVCT574GV3 type=del size=1009815 2024-02-23T06:34:20.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.463+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~BJAIFV57ZX7M.0 size=1048576 2024-02-23T06:34:20.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.464+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~BJAIFV57ZX7M.1 size=428099 2024-02-23T06:34:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.466+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=BJAIFV57ZX7M tag=ES6421JBN8VI type=write size=2525251 2024-02-23T06:34:20.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.467+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=UALBT6DGDG88 type=del size=2167401 2024-02-23T06:34:20.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.468+0000 7f5e72834780 1 < canceled operation key=LUERFL6AN6HF tag=WZFU6Y9KZ346 type=write size=744018 2024-02-23T06:34:20.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.469+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=23KS0DIH2RU5 type=del size=3587841 2024-02-23T06:34:20.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.471+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~MNA5L8CQKZHC.0 size=395130 2024-02-23T06:34:20.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.473+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=MNA5L8CQKZHC tag=6AGA7C4UJS0K type=write size=1443706 2024-02-23T06:34:20.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.474+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=2JT52IXWWD8A type=del size=227452 2024-02-23T06:34:20.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.475+0000 7f5e72834780 1 < completed write operation key=LUERFL6AN6HF tag=P5JAXZTGA80O type=write size=323619 2024-02-23T06:34:20.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.476+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=3UUBP5MYLN3R type=del size=243492 2024-02-23T06:34:20.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.477+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=Q7WG7I7EMWBW type=write size=52623 2024-02-23T06:34:20.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.478+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=XXP1EOA3NFJ1 type=del size=759721 2024-02-23T06:34:20.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.480+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~S9ME7ITQVSSS.0 size=1048576 2024-02-23T06:34:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.481+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~S9ME7ITQVSSS.1 size=1048576 2024-02-23T06:34:20.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.482+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~S9ME7ITQVSSS.2 size=247352 2024-02-23T06:34:20.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.484+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=S9ME7ITQVSSS tag=QR4961LGX500 type=write size=3393080 2024-02-23T06:34:20.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.485+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=B2UZHEHI0QSO type=del size=3253082 2024-02-23T06:34:20.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.486+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~S5WAF3OSYM4J.0 size=1048576 2024-02-23T06:34:20.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.487+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~S5WAF3OSYM4J.1 size=1048576 2024-02-23T06:34:20.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.488+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~S5WAF3OSYM4J.2 size=600971 2024-02-23T06:34:20.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.490+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=S5WAF3OSYM4J tag=8FTO55TC14T8 type=write size=3746699 2024-02-23T06:34:20.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.492+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~FUCRSDEAORB9.0 size=1048576 2024-02-23T06:34:20.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.493+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~FUCRSDEAORB9.1 size=579785 2024-02-23T06:34:20.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.493+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=FUCRSDEAORB9 tag=KS3H2NONCW1T type=write size=2676937 2024-02-23T06:34:20.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.495+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~O86T5NT6S0HT.0 size=1048576 2024-02-23T06:34:20.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.496+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~O86T5NT6S0HT.1 size=1048576 2024-02-23T06:34:20.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.497+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~O86T5NT6S0HT.2 size=677617 2024-02-23T06:34:20.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.499+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=O86T5NT6S0HT tag=JOF1CQRXK5U6 type=write size=3823345 2024-02-23T06:34:20.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.501+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~2YE0NRR2CDFU.0 size=1048576 2024-02-23T06:34:20.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.502+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~2YE0NRR2CDFU.1 size=1048576 2024-02-23T06:34:20.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.503+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~2YE0NRR2CDFU.2 size=624737 2024-02-23T06:34:20.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.503+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=2YE0NRR2CDFU tag=1V1MYOFN1OAY type=write size=3770465 2024-02-23T06:34:20.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.505+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~VYJOG931FROY.0 size=1048576 2024-02-23T06:34:20.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.506+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~VYJOG931FROY.1 size=171844 2024-02-23T06:34:20.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.508+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=VYJOG931FROY tag=96MSSQNDIRKK type=write size=2268996 2024-02-23T06:34:20.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.510+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~CC8IGPRN7029.0 size=1048576 2024-02-23T06:34:20.511 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.511+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~CC8IGPRN7029.1 size=686676 2024-02-23T06:34:20.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.511+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=CC8IGPRN7029 tag=A05W2R7CON20 type=write size=2783828 2024-02-23T06:34:20.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.513+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~R0M78XKXADI7.0 size=1048576 2024-02-23T06:34:20.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.514+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~R0M78XKXADI7.1 size=685579 2024-02-23T06:34:20.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.516+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=R0M78XKXADI7 tag=V8RDTGKTV6WN type=write size=2782731 2024-02-23T06:34:20.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.517+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=F7X2HKNI3FIC type=del size=2461458 2024-02-23T06:34:20.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.518+0000 7f5e72834780 1 < canceled operation key=WK98HMHAZIUB tag=R8AOCVACW2JT type=del size=18407 2024-02-23T06:34:20.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.521+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~YPT2NYTU1DGK.0 size=419671 2024-02-23T06:34:20.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.521+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=YPT2NYTU1DGK tag=N8LR8QPZF2GQ type=write size=1468247 2024-02-23T06:34:20.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.522+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~2LQOWU06EPMI.0 size=1048576 2024-02-23T06:34:20.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.523+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~2LQOWU06EPMI.1 size=61335 2024-02-23T06:34:20.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.528+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=2LQOWU06EPMI tag=TJ3NKVN3ZPG1 type=write size=2158487 2024-02-23T06:34:20.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.530+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=ZQDC7HZ4MVLO type=write size=109830 2024-02-23T06:34:20.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.533+0000 7f5e72834780 1 < suggested remove operation key=QGGULCYZ0ZSA tag=9GDO0FQIMFMI type=del 2024-02-23T06:34:20.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.534+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=P1J9MFUPSCHU type=del size=3542729 2024-02-23T06:34:20.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.535+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~5K63K3X06R73.0 size=53083 2024-02-23T06:34:20.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.537+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=5K63K3X06R73 tag=9PUKM0FWU9QE type=write size=1101659 2024-02-23T06:34:20.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.538+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=YLZW7D7QHCSI type=del size=1490540 2024-02-23T06:34:20.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.539+0000 7f5e72834780 1 < canceled operation key=TPADM4812N0Z tag=HX8774DNRCTP type=del size=1479261 2024-02-23T06:34:20.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.541+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~A4V2FX16J8LG.0 size=770935 2024-02-23T06:34:20.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.541+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=A4V2FX16J8LG tag=432A3CBEGQ0P type=write size=1819511 2024-02-23T06:34:20.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.543+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=0JWVCT574GV3 type=del 2024-02-23T06:34:20.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.544+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=UV0H6MCPSW5Z type=del size=1392999 2024-02-23T06:34:20.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.545+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=UALBT6DGDG88 type=del 2024-02-23T06:34:20.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.546+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=2XLBZB9O2D8B type=del size=1596750 2024-02-23T06:34:20.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.547+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=23KS0DIH2RU5 type=del 2024-02-23T06:34:20.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.550+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~EA2M4P8BPNKE.0 size=1048576 2024-02-23T06:34:20.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.551+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~EA2M4P8BPNKE.1 size=617459 2024-02-23T06:34:20.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.551+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=EA2M4P8BPNKE tag=DYIECOOFFZK0 type=write size=2714611 2024-02-23T06:34:20.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.552+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=2JT52IXWWD8A type=del 2024-02-23T06:34:20.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.554+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~LAEA4TJE449K.0 size=427506 2024-02-23T06:34:20.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.554+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=LAEA4TJE449K tag=2T49C3JUDL8I type=write size=1476082 2024-02-23T06:34:20.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.557+0000 7f5e72834780 1 < suggested remove operation key=03P6IEKSHB17 tag=3UUBP5MYLN3R type=del 2024-02-23T06:34:20.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.559+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~A2TUHVQED67X.0 size=1048576 2024-02-23T06:34:20.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.560+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~A2TUHVQED67X.1 size=64946 2024-02-23T06:34:20.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.560+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=A2TUHVQED67X tag=DPGJF0ZPMYMT type=write size=2162098 2024-02-23T06:34:20.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.561+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=XXP1EOA3NFJ1 type=del 2024-02-23T06:34:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.563+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~RUKJ6MF12WDJ.0 size=261840 2024-02-23T06:34:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.563+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=RUKJ6MF12WDJ tag=SVM5Y6Z64AIC type=write size=1310416 2024-02-23T06:34:20.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.564+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=B2UZHEHI0QSO type=del 2024-02-23T06:34:20.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.566+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~QHGZP2AD6JLB.0 size=1048576 2024-02-23T06:34:20.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.567+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~QHGZP2AD6JLB.1 size=655432 2024-02-23T06:34:20.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.567+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=QHGZP2AD6JLB tag=SUFHR079NVRC type=write size=2752584 2024-02-23T06:34:20.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.569+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~FUCRSDEAORB9.0 size=1048576 2024-02-23T06:34:20.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.569+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~FUCRSDEAORB9.1 size=579785 2024-02-23T06:34:20.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.570+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=FUCRSDEAORB9 tag=KS3H2NONCW1T type=write size=2676937 2024-02-23T06:34:20.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.572+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=SK0DBTXI3235 type=del size=706843 2024-02-23T06:34:20.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.573+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~2YE0NRR2CDFU.0 size=1048576 2024-02-23T06:34:20.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.574+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~2YE0NRR2CDFU.1 size=1048576 2024-02-23T06:34:20.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.575+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~2YE0NRR2CDFU.2 size=624737 2024-02-23T06:34:20.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.577+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=2YE0NRR2CDFU tag=1V1MYOFN1OAY type=write size=3770465 2024-02-23T06:34:20.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.578+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=GYW7NAI5W1XB type=del size=3230633 2024-02-23T06:34:20.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.579+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~CC8IGPRN7029.0 size=1048576 2024-02-23T06:34:20.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.580+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~CC8IGPRN7029.1 size=686676 2024-02-23T06:34:20.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.582+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=CC8IGPRN7029 tag=A05W2R7CON20 type=write size=2783828 2024-02-23T06:34:20.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.584+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~FASZX9QVUTTN.0 size=1048576 2024-02-23T06:34:20.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.585+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~FASZX9QVUTTN.1 size=1048576 2024-02-23T06:34:20.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.586+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~FASZX9QVUTTN.2 size=48671 2024-02-23T06:34:20.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.586+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=FASZX9QVUTTN tag=HCICKVVHPDTN type=write size=3194399 2024-02-23T06:34:20.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.588+0000 7f5e72834780 1 < suggested remove operation key=QZLNM2RQ9SDC tag=F7X2HKNI3FIC type=del 2024-02-23T06:34:20.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.590+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~ZQU54954FIKF.0 size=1048576 2024-02-23T06:34:20.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.591+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~ZQU54954FIKF.1 size=549141 2024-02-23T06:34:20.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.591+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=ZQU54954FIKF tag=FN9MN55LNWV4 type=write size=2646293 2024-02-23T06:34:20.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.592+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~YPT2NYTU1DGK.0 size=419671 2024-02-23T06:34:20.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.594+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=YPT2NYTU1DGK tag=N8LR8QPZF2GQ type=write size=1468247 2024-02-23T06:34:20.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.595+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=CPTVSWW1FT1S type=del size=2954526 2024-02-23T06:34:20.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.596+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=ZQDC7HZ4MVLO type=write size=109830 2024-02-23T06:34:20.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.598+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=SKXR6LM1I2NL type=del size=254030 2024-02-23T06:34:20.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.599+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=P1J9MFUPSCHU type=del 2024-02-23T06:34:20.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.600+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=0K15TQ1FI4A1 type=del size=147966 2024-02-23T06:34:20.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.601+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=YLZW7D7QHCSI type=del 2024-02-23T06:34:20.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.602+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=RAVTJ1BTY4T2 type=write size=357121 2024-02-23T06:34:20.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.603+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~A4V2FX16J8LG.0 size=770935 2024-02-23T06:34:20.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.605+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=A4V2FX16J8LG tag=432A3CBEGQ0P type=write size=1819511 2024-02-23T06:34:20.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.606+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=BFN4GG421CZI type=del size=2048032 2024-02-23T06:34:20.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.608+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=UV0H6MCPSW5Z type=del 2024-02-23T06:34:20.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.609+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=4RYKHWBON5JH type=del size=2727244 2024-02-23T06:34:20.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.610+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=2XLBZB9O2D8B type=del 2024-02-23T06:34:20.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.611+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=7IPHUVN56CNK type=del size=4008100 2024-02-23T06:34:20.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.612+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~EA2M4P8BPNKE.0 size=1048576 2024-02-23T06:34:20.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.613+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~EA2M4P8BPNKE.1 size=617459 2024-02-23T06:34:20.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.615+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=EA2M4P8BPNKE tag=DYIECOOFFZK0 type=write size=2714611 2024-02-23T06:34:20.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.616+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=TLR2I0DBFDIR type=del size=3420315 2024-02-23T06:34:20.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.618+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~LAEA4TJE449K.0 size=427506 2024-02-23T06:34:20.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.620+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=LAEA4TJE449K tag=2T49C3JUDL8I type=write size=1476082 2024-02-23T06:34:20.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.621+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=TJ7SZJS3DTM2 type=write size=241355 2024-02-23T06:34:20.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.623+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~A2TUHVQED67X.0 size=1048576 2024-02-23T06:34:20.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.624+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~A2TUHVQED67X.1 size=64946 2024-02-23T06:34:20.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.626+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=A2TUHVQED67X tag=DPGJF0ZPMYMT type=write size=2162098 2024-02-23T06:34:20.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.628+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~MF8R73BQZKLC.0 size=1048576 2024-02-23T06:34:20.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.629+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~MF8R73BQZKLC.1 size=1048576 2024-02-23T06:34:20.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.630+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~MF8R73BQZKLC.2 size=469624 2024-02-23T06:34:20.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.630+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=MF8R73BQZKLC tag=NWVYZ6Z39N8E type=write size=3615352 2024-02-23T06:34:20.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.631+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~RUKJ6MF12WDJ.0 size=261840 2024-02-23T06:34:20.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.633+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=RUKJ6MF12WDJ tag=SVM5Y6Z64AIC type=write size=1310416 2024-02-23T06:34:20.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.635+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~FGO5K8FUI2K8.0 size=628591 2024-02-23T06:34:20.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.635+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=FGO5K8FUI2K8 tag=N92K40YRBE8H type=write size=1677167 2024-02-23T06:34:20.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.636+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~QHGZP2AD6JLB.0 size=1048576 2024-02-23T06:34:20.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.636+0000 7f5e72834780 1 < canceled part key=_multipart_721UW0AGSKVR.2~QHGZP2AD6JLB.1 size=655432 2024-02-23T06:34:20.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.639+0000 7f5e72834780 1 < canceled multipart upload key=721UW0AGSKVR upload=QHGZP2AD6JLB tag=SUFHR079NVRC type=write size=2752584 2024-02-23T06:34:20.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.641+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~KSEAYOM2OJIU.0 size=1048576 2024-02-23T06:34:20.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.642+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~KSEAYOM2OJIU.1 size=429565 2024-02-23T06:34:20.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.642+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=KSEAYOM2OJIU tag=G503TLSQT15C type=write size=2526717 2024-02-23T06:34:20.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.644+0000 7f5e72834780 1 < canceled operation key=JV6FJONY04AW tag=SK0DBTXI3235 type=del size=706843 2024-02-23T06:34:20.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.646+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~UH63IFAMSC6Z.0 size=583933 2024-02-23T06:34:20.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.646+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=UH63IFAMSC6Z tag=BLPSOGNXTGFW type=write size=1632509 2024-02-23T06:34:20.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.647+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=GYW7NAI5W1XB type=del 2024-02-23T06:34:20.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.648+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=9IHT17JFO42M type=del size=3549111 2024-02-23T06:34:20.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.650+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~FASZX9QVUTTN.0 size=1048576 2024-02-23T06:34:20.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.651+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~FASZX9QVUTTN.1 size=1048576 2024-02-23T06:34:20.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.652+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~FASZX9QVUTTN.2 size=48671 2024-02-23T06:34:20.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.654+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=FASZX9QVUTTN tag=HCICKVVHPDTN type=write size=3194399 2024-02-23T06:34:20.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.656+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~B2OY4M4FE647.0 size=1048576 2024-02-23T06:34:20.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.657+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~B2OY4M4FE647.1 size=743579 2024-02-23T06:34:20.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.657+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=B2OY4M4FE647 tag=30KZAR6QQ2A0 type=write size=2840731 2024-02-23T06:34:20.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.658+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~ZQU54954FIKF.0 size=1048576 2024-02-23T06:34:20.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.659+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~ZQU54954FIKF.1 size=549141 2024-02-23T06:34:20.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.661+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=ZQU54954FIKF tag=FN9MN55LNWV4 type=write size=2646293 2024-02-23T06:34:20.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.662+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=ZUV18MU13DWQ type=del size=885403 2024-02-23T06:34:20.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.663+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=CPTVSWW1FT1S type=del 2024-02-23T06:34:20.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.665+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~AKBBXM0HK32O.0 size=1048576 2024-02-23T06:34:20.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.666+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~AKBBXM0HK32O.1 size=615851 2024-02-23T06:34:20.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.666+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=AKBBXM0HK32O tag=KHP75RNO65G6 type=write size=2713003 2024-02-23T06:34:20.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.667+0000 7f5e72834780 1 < canceled operation key=4M7BT05YB0C3 tag=SKXR6LM1I2NL type=del size=254030 2024-02-23T06:34:20.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.669+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=8L3L0R1FL005 type=write size=232995 2024-02-23T06:34:20.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.670+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=0K15TQ1FI4A1 type=del 2024-02-23T06:34:20.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.671+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=JI9CSL1PGSH8 type=del size=1014855 2024-02-23T06:34:20.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.672+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=RAVTJ1BTY4T2 type=write size=357121 2024-02-23T06:34:20.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.674+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~W1ALIJ5RXR16.0 size=1048576 2024-02-23T06:34:20.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.675+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~W1ALIJ5RXR16.1 size=1048576 2024-02-23T06:34:20.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.676+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~W1ALIJ5RXR16.2 size=202577 2024-02-23T06:34:20.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.676+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=W1ALIJ5RXR16 tag=9M7RTIPTZ6ER type=write size=3348305 2024-02-23T06:34:20.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.678+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=BFN4GG421CZI type=del 2024-02-23T06:34:20.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.679+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=1Y9ORVZE8KRZ type=del size=1839677 2024-02-23T06:34:20.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.680+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=4RYKHWBON5JH type=del 2024-02-23T06:34:20.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.682+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~SH6CFTYS5N5A.0 size=1048576 2024-02-23T06:34:20.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.683+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~SH6CFTYS5N5A.1 size=744718 2024-02-23T06:34:20.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.683+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=SH6CFTYS5N5A tag=OQFR9IVFK8AD type=write size=2841870 2024-02-23T06:34:20.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.685+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=7IPHUVN56CNK type=del 2024-02-23T06:34:20.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.686+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=CGO2W664I8NT type=del size=3815626 2024-02-23T06:34:20.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.687+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=TLR2I0DBFDIR type=del 2024-02-23T06:34:20.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.689+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~QQIHHYJP2VTF.0 size=201629 2024-02-23T06:34:20.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.689+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=QQIHHYJP2VTF tag=8R60ZAJXRI1O type=write size=1250205 2024-02-23T06:34:20.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.690+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=TJ7SZJS3DTM2 type=write size=241355 2024-02-23T06:34:20.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.691+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=6P1SLW662Y1Z type=write size=1032858 2024-02-23T06:34:20.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.693+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~MF8R73BQZKLC.0 size=1048576 2024-02-23T06:34:20.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.694+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~MF8R73BQZKLC.1 size=1048576 2024-02-23T06:34:20.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.695+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~MF8R73BQZKLC.2 size=469624 2024-02-23T06:34:20.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.697+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=MF8R73BQZKLC tag=NWVYZ6Z39N8E type=write size=3615352 2024-02-23T06:34:20.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.698+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=FQ785COX0W2K type=del size=1853230 2024-02-23T06:34:20.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.699+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~FGO5K8FUI2K8.0 size=628591 2024-02-23T06:34:20.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.701+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=FGO5K8FUI2K8 tag=N92K40YRBE8H type=write size=1677167 2024-02-23T06:34:20.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.703+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~TDW81PWVKI8V.0 size=1048576 2024-02-23T06:34:20.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.704+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~TDW81PWVKI8V.1 size=1048576 2024-02-23T06:34:20.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.705+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~TDW81PWVKI8V.2 size=15836 2024-02-23T06:34:20.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.705+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=TDW81PWVKI8V tag=RIX2Y7P3FM9Y type=write size=3161564 2024-02-23T06:34:20.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.706+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~KSEAYOM2OJIU.0 size=1048576 2024-02-23T06:34:20.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.707+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~KSEAYOM2OJIU.1 size=429565 2024-02-23T06:34:20.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.709+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=KSEAYOM2OJIU tag=G503TLSQT15C type=write size=2526717 2024-02-23T06:34:20.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.710+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=0ZAM77YOK2N0 type=del size=2006682 2024-02-23T06:34:20.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.711+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~UH63IFAMSC6Z.0 size=583933 2024-02-23T06:34:20.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.713+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=UH63IFAMSC6Z tag=BLPSOGNXTGFW type=write size=1632509 2024-02-23T06:34:20.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.714+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=6FA5913OAA4A type=del size=3198566 2024-02-23T06:34:20.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.715+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=9IHT17JFO42M type=del 2024-02-23T06:34:20.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.717+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~S6N3ZZ2VV6LM.0 size=1048576 2024-02-23T06:34:20.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.718+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~S6N3ZZ2VV6LM.1 size=1048576 2024-02-23T06:34:20.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.719+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~S6N3ZZ2VV6LM.2 size=969287 2024-02-23T06:34:20.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.719+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=S6N3ZZ2VV6LM tag=WELEXTQE40F4 type=write size=4115015 2024-02-23T06:34:20.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.719+0000 7f5e72834780 1 < canceled part key=_multipart_RS03NUABC1U2.2~B2OY4M4FE647.0 size=1048576 2024-02-23T06:34:20.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.720+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~B2OY4M4FE647.1 size=743579 2024-02-23T06:34:20.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.722+0000 7f5e72834780 1 < canceled multipart upload key=RS03NUABC1U2 upload=B2OY4M4FE647 tag=30KZAR6QQ2A0 type=write size=2840731 2024-02-23T06:34:20.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.724+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~2L48JDXTB26Y.0 size=673205 2024-02-23T06:34:20.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.724+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=2L48JDXTB26Y tag=IYTWSLCZNP68 type=write size=1721781 2024-02-23T06:34:20.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.725+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=ZUV18MU13DWQ type=del 2024-02-23T06:34:20.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.726+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=H6N7Z6YEPADF type=del size=1823130 2024-02-23T06:34:20.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.727+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~AKBBXM0HK32O.0 size=1048576 2024-02-23T06:34:20.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.728+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~AKBBXM0HK32O.1 size=615851 2024-02-23T06:34:20.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.730+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=AKBBXM0HK32O tag=KHP75RNO65G6 type=write size=2713003 2024-02-23T06:34:20.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.731+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=4KPOTO7KUNVC type=del size=2679527 2024-02-23T06:34:20.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.733+0000 7f5e72834780 1 < suggested update operation key=IDTA5RV6IUF6 tag=8L3L0R1FL005 type=write size=232995 2024-02-23T06:34:20.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.734+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=BZ8DZLN2YRU5 type=write size=47926 2024-02-23T06:34:20.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.735+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=JI9CSL1PGSH8 type=del 2024-02-23T06:34:20.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.738+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=GD3KCSJKGS1Y type=del size=3862169 2024-02-23T06:34:20.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.739+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~W1ALIJ5RXR16.0 size=1048576 2024-02-23T06:34:20.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.740+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~W1ALIJ5RXR16.1 size=1048576 2024-02-23T06:34:20.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.741+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~W1ALIJ5RXR16.2 size=202577 2024-02-23T06:34:20.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.743+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=W1ALIJ5RXR16 tag=9M7RTIPTZ6ER type=write size=3348305 2024-02-23T06:34:20.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.745+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~00A4AYL5STIT.0 size=1048576 2024-02-23T06:34:20.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.747+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~00A4AYL5STIT.1 size=343280 2024-02-23T06:34:20.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.747+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=00A4AYL5STIT tag=34HSDVO85ZWI type=write size=2440432 2024-02-23T06:34:20.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.748+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=1Y9ORVZE8KRZ type=del 2024-02-23T06:34:20.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.751+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=U4AC1KQ3AB48 type=del size=1419277 2024-02-23T06:34:20.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.751+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~SH6CFTYS5N5A.0 size=1048576 2024-02-23T06:34:20.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.752+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~SH6CFTYS5N5A.1 size=744718 2024-02-23T06:34:20.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.754+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=SH6CFTYS5N5A tag=OQFR9IVFK8AD type=write size=2841870 2024-02-23T06:34:20.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.756+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~NUEL78CY2HO7.0 size=461184 2024-02-23T06:34:20.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.756+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=NUEL78CY2HO7 tag=1NPYY4QV76G2 type=write size=1509760 2024-02-23T06:34:20.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.758+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=CGO2W664I8NT type=del 2024-02-23T06:34:20.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.759+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=E0L8NI0WQ9YY type=write size=142783 2024-02-23T06:34:20.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.759+0000 7f5e72834780 1 < canceled part key=_multipart_0WLEPDK2O30W.2~QQIHHYJP2VTF.0 size=201629 2024-02-23T06:34:20.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.761+0000 7f5e72834780 1 < canceled multipart upload key=0WLEPDK2O30W upload=QQIHHYJP2VTF tag=8R60ZAJXRI1O type=write size=1250205 2024-02-23T06:34:20.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.762+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=X6M79XOMPH7U type=del size=1799790 2024-02-23T06:34:20.763 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.763+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=6P1SLW662Y1Z type=write size=1032858 2024-02-23T06:34:20.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.764+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=UPMC0ELAJN37 type=write size=170237 2024-02-23T06:34:20.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.765+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=FQ785COX0W2K type=del 2024-02-23T06:34:20.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.767+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~EZOXX7FXOWYT.0 size=662114 2024-02-23T06:34:20.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.767+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=EZOXX7FXOWYT tag=IHQMQZG6TZEL type=write size=1710690 2024-02-23T06:34:20.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.769+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~TDW81PWVKI8V.0 size=1048576 2024-02-23T06:34:20.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.770+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~TDW81PWVKI8V.1 size=1048576 2024-02-23T06:34:20.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.770+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~TDW81PWVKI8V.2 size=15836 2024-02-23T06:34:20.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.772+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=TDW81PWVKI8V tag=RIX2Y7P3FM9Y type=write size=3161564 2024-02-23T06:34:20.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.774+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=AW1Y2T7PZNDW type=del size=449663 2024-02-23T06:34:20.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.775+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=0ZAM77YOK2N0 type=del 2024-02-23T06:34:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.776+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=5LD3K2Z7R771 type=del size=836206 2024-02-23T06:34:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.778+0000 7f5e72834780 1 < suggested remove operation key=QGGULCYZ0ZSA tag=6FA5913OAA4A type=del 2024-02-23T06:34:20.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.779+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=KQPGGCCZW7EH type=del size=2648981 2024-02-23T06:34:20.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.779+0000 7f5e72834780 1 < canceled part key=_multipart_8Q6WC7B9BY5Q.2~S6N3ZZ2VV6LM.0 size=1048576 2024-02-23T06:34:20.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.780+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~S6N3ZZ2VV6LM.1 size=1048576 2024-02-23T06:34:20.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.781+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~S6N3ZZ2VV6LM.2 size=969287 2024-02-23T06:34:20.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.784+0000 7f5e72834780 1 < canceled multipart upload key=8Q6WC7B9BY5Q upload=S6N3ZZ2VV6LM tag=WELEXTQE40F4 type=write size=4115015 2024-02-23T06:34:20.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.786+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~5HIN1SF36DD5.0 size=1048576 2024-02-23T06:34:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.787+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~5HIN1SF36DD5.1 size=1048576 2024-02-23T06:34:20.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.788+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~5HIN1SF36DD5.2 size=103777 2024-02-23T06:34:20.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.788+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=5HIN1SF36DD5 tag=3BCC3F0GK2LG type=write size=3249505 2024-02-23T06:34:20.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.789+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~2L48JDXTB26Y.0 size=673205 2024-02-23T06:34:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.791+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=2L48JDXTB26Y tag=IYTWSLCZNP68 type=write size=1721781 2024-02-23T06:34:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.792+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=CYQ4JON94TYQ type=write size=989305 2024-02-23T06:34:20.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.793+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=H6N7Z6YEPADF type=del 2024-02-23T06:34:20.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.795+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=EJMY5EF6X54F type=del size=1250083 2024-02-23T06:34:20.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.796+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=4KPOTO7KUNVC type=del 2024-02-23T06:34:20.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.797+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=UPL3D09QQXM9 type=del size=335003 2024-02-23T06:34:20.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.799+0000 7f5e72834780 1 < completed write operation key=WK98HMHAZIUB tag=BZ8DZLN2YRU5 type=write size=47926 2024-02-23T06:34:20.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.800+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=J3Y981UGHQZY type=del size=3359941 2024-02-23T06:34:20.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.801+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=GD3KCSJKGS1Y type=del 2024-02-23T06:34:20.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.803+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~I0PSP05KQ3Q1.0 size=1048576 2024-02-23T06:34:20.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.804+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~I0PSP05KQ3Q1.1 size=821086 2024-02-23T06:34:20.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.804+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=I0PSP05KQ3Q1 tag=REGZNZNSPB00 type=write size=2918238 2024-02-23T06:34:20.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.805+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~00A4AYL5STIT.0 size=1048576 2024-02-23T06:34:20.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.805+0000 7f5e72834780 1 < canceled part key=_multipart_721UW0AGSKVR.2~00A4AYL5STIT.1 size=343280 2024-02-23T06:34:20.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.807+0000 7f5e72834780 1 < canceled multipart upload key=721UW0AGSKVR upload=00A4AYL5STIT tag=34HSDVO85ZWI type=write size=2440432 2024-02-23T06:34:20.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.810+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~PFWS2UDMASZ0.0 size=1048576 2024-02-23T06:34:20.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.811+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~PFWS2UDMASZ0.1 size=945144 2024-02-23T06:34:20.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.811+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=PFWS2UDMASZ0 tag=XSK13NLISW4L type=write size=3042296 2024-02-23T06:34:20.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.812+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=U4AC1KQ3AB48 type=del 2024-02-23T06:34:20.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.813+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=E81JR8VDTRG6 type=write size=593182 2024-02-23T06:34:20.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.815+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~NUEL78CY2HO7.0 size=461184 2024-02-23T06:34:20.817 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.817+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=NUEL78CY2HO7 tag=1NPYY4QV76G2 type=write size=1509760 2024-02-23T06:34:20.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.818+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=XQAP8BJFIUV8 type=write size=714235 2024-02-23T06:34:20.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.820+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=E0L8NI0WQ9YY type=write size=142783 2024-02-23T06:34:20.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.822+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~IH31DIKF9KD4.0 size=941109 2024-02-23T06:34:20.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.822+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=IH31DIKF9KD4 tag=SUUW2067R15P type=write size=1989685 2024-02-23T06:34:20.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.824+0000 7f5e72834780 1 < suggested remove operation key=IDTA5RV6IUF6 tag=X6M79XOMPH7U type=del 2024-02-23T06:34:20.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.826+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=HNQ881DVSL0I type=del size=3924485 2024-02-23T06:34:20.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.827+0000 7f5e72834780 1 < canceled operation key=MB8BZ2BXZE9M tag=UPMC0ELAJN37 type=write size=170237 2024-02-23T06:34:20.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.829+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~7CHAB6JPBMUF.0 size=557940 2024-02-23T06:34:20.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.829+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=7CHAB6JPBMUF tag=2LBONR3QS91F type=write size=1606516 2024-02-23T06:34:20.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.830+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~EZOXX7FXOWYT.0 size=662114 2024-02-23T06:34:20.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.832+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=EZOXX7FXOWYT tag=IHQMQZG6TZEL type=write size=1710690 2024-02-23T06:34:20.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.834+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=O207EUZJV14P type=del size=2502877 2024-02-23T06:34:20.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.835+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=AW1Y2T7PZNDW type=del 2024-02-23T06:34:20.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.836+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=4HDN0YBCNEMD type=del size=2909766 2024-02-23T06:34:20.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.837+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=5LD3K2Z7R771 type=del 2024-02-23T06:34:20.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.838+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=DDTEO3OS89Y6 type=del size=3801979 2024-02-23T06:34:20.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.840+0000 7f5e72834780 1 < suggested update operation key=VER8U5YMTPS6 tag=KQPGGCCZW7EH type=del size=2648981 2024-02-23T06:34:20.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.842+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=A2112HPCCO6C type=del size=1551405 2024-02-23T06:34:20.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.843+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~5HIN1SF36DD5.0 size=1048576 2024-02-23T06:34:20.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.843+0000 7f5e72834780 1 < canceled part key=_multipart_R4YA9DUAJABL.2~5HIN1SF36DD5.1 size=1048576 2024-02-23T06:34:20.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.844+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~5HIN1SF36DD5.2 size=103777 2024-02-23T06:34:20.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.846+0000 7f5e72834780 1 < canceled multipart upload key=R4YA9DUAJABL upload=5HIN1SF36DD5 tag=3BCC3F0GK2LG type=write size=3249505 2024-02-23T06:34:20.847 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.847+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=JYISMQ661ST4 type=del size=1726921 2024-02-23T06:34:20.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.848+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=CYQ4JON94TYQ type=write size=989305 2024-02-23T06:34:20.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.849+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=J32UZ4E9JUUJ type=write size=407734 2024-02-23T06:34:20.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.851+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=EJMY5EF6X54F type=del 2024-02-23T06:34:20.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.853+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~T1I7CL3QON7M.0 size=1048576 2024-02-23T06:34:20.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.854+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~T1I7CL3QON7M.1 size=1048576 2024-02-23T06:34:20.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.855+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~T1I7CL3QON7M.2 size=395322 2024-02-23T06:34:20.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.855+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=T1I7CL3QON7M tag=RU5Y4KVC33YT type=write size=3541050 2024-02-23T06:34:20.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.856+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=UPL3D09QQXM9 type=del 2024-02-23T06:34:20.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.857+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=USDM26QQ6TQ4 type=del size=447914 2024-02-23T06:34:20.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.858+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=J3Y981UGHQZY type=del 2024-02-23T06:34:20.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.859+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=75VKLXT4J222 type=del size=1190549 2024-02-23T06:34:20.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.860+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~I0PSP05KQ3Q1.0 size=1048576 2024-02-23T06:34:20.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.862+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~I0PSP05KQ3Q1.1 size=821086 2024-02-23T06:34:20.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.864+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=I0PSP05KQ3Q1 tag=REGZNZNSPB00 type=write size=2918238 2024-02-23T06:34:20.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.867+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~SXWYKF9UDU0Q.0 size=1048576 2024-02-23T06:34:20.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.868+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~SXWYKF9UDU0Q.1 size=1048576 2024-02-23T06:34:20.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.869+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~SXWYKF9UDU0Q.2 size=16304 2024-02-23T06:34:20.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.869+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=SXWYKF9UDU0Q tag=6CSVANHF1TIO type=write size=3162032 2024-02-23T06:34:20.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.870+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~PFWS2UDMASZ0.0 size=1048576 2024-02-23T06:34:20.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.871+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~PFWS2UDMASZ0.1 size=945144 2024-02-23T06:34:20.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.873+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=PFWS2UDMASZ0 tag=XSK13NLISW4L type=write size=3042296 2024-02-23T06:34:20.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.875+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=ZHLC7LJS464U type=del size=434039 2024-02-23T06:34:20.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.876+0000 7f5e72834780 1 < completed write operation key=GW6EKQ84FQ6L tag=E81JR8VDTRG6 type=write size=593182 2024-02-23T06:34:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.878+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~AG5MC3ZRL4YH.0 size=429695 2024-02-23T06:34:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.878+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=AG5MC3ZRL4YH tag=V8OPD6IQLWMS type=write size=1478271 2024-02-23T06:34:20.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.879+0000 7f5e72834780 1 < canceled operation key=03P6IEKSHB17 tag=XQAP8BJFIUV8 type=write size=714235 2024-02-23T06:34:20.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.881+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~8CC332V1FIQU.0 size=764100 2024-02-23T06:34:20.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.881+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=8CC332V1FIQU tag=DHRQ4H1CER3R type=write size=1812676 2024-02-23T06:34:20.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.883+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~IH31DIKF9KD4.0 size=941109 2024-02-23T06:34:20.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.885+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=IH31DIKF9KD4 tag=SUUW2067R15P type=write size=1989685 2024-02-23T06:34:20.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.886+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=6OAZ5OK8AXQW type=del size=1168591 2024-02-23T06:34:20.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.887+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=HNQ881DVSL0I type=del 2024-02-23T06:34:20.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.890+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~YDQMO1UCZ4AP.0 size=1048576 2024-02-23T06:34:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.890+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~YDQMO1UCZ4AP.1 size=78273 2024-02-23T06:34:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.891+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=YDQMO1UCZ4AP tag=MR8ZPAJ07WV0 type=write size=2175425 2024-02-23T06:34:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.892+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~7CHAB6JPBMUF.0 size=557940 2024-02-23T06:34:20.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.894+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=7CHAB6JPBMUF tag=2LBONR3QS91F type=write size=1606516 2024-02-23T06:34:20.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.895+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=LM3FYS45M7Z5 type=del size=3084478 2024-02-23T06:34:20.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.896+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=O207EUZJV14P type=del 2024-02-23T06:34:20.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.898+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~EB9F623UOX5I.0 size=1048576 2024-02-23T06:34:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.899+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~EB9F623UOX5I.1 size=1048576 2024-02-23T06:34:20.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.900+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~EB9F623UOX5I.2 size=355524 2024-02-23T06:34:20.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.900+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=EB9F623UOX5I tag=DOZXUPRMM9QH type=write size=3501252 2024-02-23T06:34:20.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.902+0000 7f5e72834780 -1 < failed to complete operation key=VER8U5YMTPS6 tag=4HDN0YBCNEMD type=del size=2909766: (22) Invalid argument 2024-02-23T06:34:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.903+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=8YXXQU4E34QJ type=del size=2768763 2024-02-23T06:34:20.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.904+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=DDTEO3OS89Y6 type=del size=3801979 2024-02-23T06:34:20.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.907+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~8PZX4MRRW721.0 size=417708 2024-02-23T06:34:20.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.907+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=8PZX4MRRW721 tag=KUOITNCT3F8R type=write size=1466284 2024-02-23T06:34:20.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.908+0000 7f5e72834780 1 < canceled operation key=N8RXOY8X71MO tag=A2112HPCCO6C type=del size=1551405 2024-02-23T06:34:20.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.910+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=XWK74T4DJ0HS type=del size=1754619 2024-02-23T06:34:20.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.912+0000 7f5e72834780 1 < suggested remove operation key=QGGULCYZ0ZSA tag=JYISMQ661ST4 type=del 2024-02-23T06:34:20.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.914+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~LDUG706MIN1T.0 size=1048576 2024-02-23T06:34:20.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.915+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~LDUG706MIN1T.1 size=1048576 2024-02-23T06:34:20.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.916+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~LDUG706MIN1T.2 size=118566 2024-02-23T06:34:20.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.916+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=LDUG706MIN1T tag=MLHS8YT4S06J type=write size=3264294 2024-02-23T06:34:20.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.917+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=J32UZ4E9JUUJ type=write size=407734 2024-02-23T06:34:20.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.920+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~MZ06W39JJ304.0 size=1048576 2024-02-23T06:34:20.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.921+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~MZ06W39JJ304.1 size=1048576 2024-02-23T06:34:20.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.922+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~MZ06W39JJ304.2 size=163993 2024-02-23T06:34:20.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.922+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=MZ06W39JJ304 tag=2ZI0P1VH38ZQ type=write size=3309721 2024-02-23T06:34:20.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.923+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~T1I7CL3QON7M.0 size=1048576 2024-02-23T06:34:20.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.924+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~T1I7CL3QON7M.1 size=1048576 2024-02-23T06:34:20.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.925+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~T1I7CL3QON7M.2 size=395322 2024-02-23T06:34:20.927 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.927+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=T1I7CL3QON7M tag=RU5Y4KVC33YT type=write size=3541050 2024-02-23T06:34:20.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.928+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=BVXDZLNOOAFW type=del size=3313207 2024-02-23T06:34:20.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.930+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=USDM26QQ6TQ4 type=del 2024-02-23T06:34:20.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.932+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~URCG4T5HRJOW.0 size=1048576 2024-02-23T06:34:20.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.933+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~URCG4T5HRJOW.1 size=331393 2024-02-23T06:34:20.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.933+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=URCG4T5HRJOW tag=E6OXQZRB23Q6 type=write size=2428545 2024-02-23T06:34:20.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.934+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=75VKLXT4J222 type=del 2024-02-23T06:34:20.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.938+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~7LCWJ3LF3VB6.0 size=1001284 2024-02-23T06:34:20.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.938+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=7LCWJ3LF3VB6 tag=09Z597F7R7WL type=write size=2049860 2024-02-23T06:34:20.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.939+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~SXWYKF9UDU0Q.0 size=1048576 2024-02-23T06:34:20.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.940+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~SXWYKF9UDU0Q.1 size=1048576 2024-02-23T06:34:20.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.941+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~SXWYKF9UDU0Q.2 size=16304 2024-02-23T06:34:20.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.943+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=SXWYKF9UDU0Q tag=6CSVANHF1TIO type=write size=3162032 2024-02-23T06:34:20.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.944+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=8CADQOTVLA1X type=del size=268722 2024-02-23T06:34:20.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.945+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=ZHLC7LJS464U type=del 2024-02-23T06:34:20.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.947+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~SDZI42I26UO6.0 size=808825 2024-02-23T06:34:20.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.947+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=SDZI42I26UO6 tag=U6V4V22ZME0N type=write size=1857401 2024-02-23T06:34:20.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.949+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~AG5MC3ZRL4YH.0 size=429695 2024-02-23T06:34:20.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.951+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=AG5MC3ZRL4YH tag=V8OPD6IQLWMS type=write size=1478271 2024-02-23T06:34:20.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.952+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=ELHF2L48EGL1 type=del size=1126283 2024-02-23T06:34:20.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.953+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~8CC332V1FIQU.0 size=764100 2024-02-23T06:34:20.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.955+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=8CC332V1FIQU tag=DHRQ4H1CER3R type=write size=1812676 2024-02-23T06:34:20.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.957+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~EGR1XR19HXM7.0 size=553501 2024-02-23T06:34:20.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.957+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=EGR1XR19HXM7 tag=N9MIPIXRMWNQ type=write size=1602077 2024-02-23T06:34:20.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.959+0000 7f5e72834780 1 < suggested update operation key=4M7BT05YB0C3 tag=6OAZ5OK8AXQW type=del size=1168591 2024-02-23T06:34:20.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.960+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=82AICSDVAQ0G type=del size=1347826 2024-02-23T06:34:20.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.961+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~YDQMO1UCZ4AP.0 size=1048576 2024-02-23T06:34:20.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.962+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~YDQMO1UCZ4AP.1 size=78273 2024-02-23T06:34:20.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.964+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=YDQMO1UCZ4AP tag=MR8ZPAJ07WV0 type=write size=2175425 2024-02-23T06:34:20.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.965+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=TAW3NEPXX6XX type=del size=108518 2024-02-23T06:34:20.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.966+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=LM3FYS45M7Z5 type=del 2024-02-23T06:34:20.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.967+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=U58OCELCLVI0 type=del size=3774697 2024-02-23T06:34:20.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.967+0000 7f5e72834780 1 < canceled part key=_multipart_883VBT1ADE6K.2~EB9F623UOX5I.0 size=1048576 2024-02-23T06:34:20.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.968+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~EB9F623UOX5I.1 size=1048576 2024-02-23T06:34:20.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.969+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~EB9F623UOX5I.2 size=355524 2024-02-23T06:34:20.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.971+0000 7f5e72834780 1 < canceled multipart upload key=883VBT1ADE6K upload=EB9F623UOX5I tag=DOZXUPRMM9QH type=write size=3501252 2024-02-23T06:34:20.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.972+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=8U8F820J2PYA type=del size=498172 2024-02-23T06:34:20.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.973+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=8YXXQU4E34QJ type=del 2024-02-23T06:34:20.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.974+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=ARFIFRTFPSQJ type=del size=3351146 2024-02-23T06:34:20.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.976+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~8PZX4MRRW721.0 size=417708 2024-02-23T06:34:20.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.977+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=8PZX4MRRW721 tag=KUOITNCT3F8R type=write size=1466284 2024-02-23T06:34:20.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.979+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~P16HZIXVXRU3.0 size=1048576 2024-02-23T06:34:20.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.980+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~P16HZIXVXRU3.1 size=554021 2024-02-23T06:34:20.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.980+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=P16HZIXVXRU3 tag=07ESMG2OKJHR type=write size=2651173 2024-02-23T06:34:20.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.981+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=XWK74T4DJ0HS type=del 2024-02-23T06:34:20.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.983+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~7TUQUSTP0OYW.0 size=1048576 2024-02-23T06:34:20.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.984+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~7TUQUSTP0OYW.1 size=1048576 2024-02-23T06:34:20.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.985+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~7TUQUSTP0OYW.2 size=373463 2024-02-23T06:34:20.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.985+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=7TUQUSTP0OYW tag=02F0MH4XW1R1 type=write size=3519191 2024-02-23T06:34:20.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.986+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~LDUG706MIN1T.0 size=1048576 2024-02-23T06:34:20.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.987+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~LDUG706MIN1T.1 size=1048576 2024-02-23T06:34:20.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.988+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~LDUG706MIN1T.2 size=118566 2024-02-23T06:34:20.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.990+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=LDUG706MIN1T tag=MLHS8YT4S06J type=write size=3264294 2024-02-23T06:34:20.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.991+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=R3J8NP4U88IT type=del size=4069512 2024-02-23T06:34:20.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.991+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~MZ06W39JJ304.0 size=1048576 2024-02-23T06:34:20.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.992+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~MZ06W39JJ304.1 size=1048576 2024-02-23T06:34:20.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.993+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~MZ06W39JJ304.2 size=163993 2024-02-23T06:34:20.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.995+0000 7f5e72834780 1 < canceled multipart upload key=ZC75CQ2789VE upload=MZ06W39JJ304 tag=2ZI0P1VH38ZQ type=write size=3309721 2024-02-23T06:34:20.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.997+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~YNL4Z2PQ0HHR.0 size=499116 2024-02-23T06:34:20.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.997+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=YNL4Z2PQ0HHR tag=Q1K0KIWC3E7M type=write size=1547692 2024-02-23T06:34:20.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:20.999+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=BVXDZLNOOAFW type=del 2024-02-23T06:34:21.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.000+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=NYERV6MH2MKM type=del size=98517 2024-02-23T06:34:21.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.001+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~URCG4T5HRJOW.0 size=1048576 2024-02-23T06:34:21.002 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.002+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~URCG4T5HRJOW.1 size=331393 2024-02-23T06:34:21.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.004+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=URCG4T5HRJOW tag=E6OXQZRB23Q6 type=write size=2428545 2024-02-23T06:34:21.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.006+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~3I5ULD0Z73NU.0 size=502156 2024-02-23T06:34:21.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.006+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=3I5ULD0Z73NU tag=J3Q7JTBOARR5 type=write size=1550732 2024-02-23T06:34:21.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.009+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~7LCWJ3LF3VB6.0 size=1001284 2024-02-23T06:34:21.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.011+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=7LCWJ3LF3VB6 tag=09Z597F7R7WL type=write size=2049860 2024-02-23T06:34:21.012 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.012+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=B7CK1TLJ27GE type=del size=3455777 2024-02-23T06:34:21.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.013+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=8CADQOTVLA1X type=del 2024-02-23T06:34:21.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.014+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=G72YOVQ3P4V4 type=del size=2307444 2024-02-23T06:34:21.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.015+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~SDZI42I26UO6.0 size=808825 2024-02-23T06:34:21.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.017+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=SDZI42I26UO6 tag=U6V4V22ZME0N type=write size=1857401 2024-02-23T06:34:21.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.018+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=Y9H5AW4YQ7HJ type=del size=251148 2024-02-23T06:34:21.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.019+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=ELHF2L48EGL1 type=del 2024-02-23T06:34:21.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.021+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~FD8VAFK210HN.0 size=280496 2024-02-23T06:34:21.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.021+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=FD8VAFK210HN tag=M4OFEAUC7465 type=write size=1329072 2024-02-23T06:34:21.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.023+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~EGR1XR19HXM7.0 size=553501 2024-02-23T06:34:21.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.025+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=EGR1XR19HXM7 tag=N9MIPIXRMWNQ type=write size=1602077 2024-02-23T06:34:21.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.029+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~R78MAA4SWZAH.0 size=197557 2024-02-23T06:34:21.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.029+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=R78MAA4SWZAH tag=C5ZLEWRAR1Q3 type=write size=1246133 2024-02-23T06:34:21.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.030+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=82AICSDVAQ0G type=del 2024-02-23T06:34:21.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.032+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~1SUALTHNLCF3.0 size=1048576 2024-02-23T06:34:21.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.033+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~1SUALTHNLCF3.1 size=1048576 2024-02-23T06:34:21.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.034+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~1SUALTHNLCF3.2 size=41803 2024-02-23T06:34:21.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.034+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=1SUALTHNLCF3 tag=FVBYJ007V3IG type=write size=3187531 2024-02-23T06:34:21.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.035+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=TAW3NEPXX6XX type=del 2024-02-23T06:34:21.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.037+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~SQUBZHESAK81.0 size=995962 2024-02-23T06:34:21.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.037+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=SQUBZHESAK81 tag=8I5B3TVU8PKF type=write size=2044538 2024-02-23T06:34:21.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.038+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=U58OCELCLVI0 type=del 2024-02-23T06:34:21.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.039+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=KR6VU9T10KZL type=del size=4058744 2024-02-23T06:34:21.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.040+0000 7f5e72834780 1 < canceled operation key=ZM1YKZOUFSCY tag=8U8F820J2PYA type=del size=498172 2024-02-23T06:34:21.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.042+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=YAS8MXDBOKCG type=del size=3456758 2024-02-23T06:34:21.043 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.043+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=ARFIFRTFPSQJ type=del 2024-02-23T06:34:21.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.045+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~C8MG4IM0W0UF.0 size=1048576 2024-02-23T06:34:21.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.046+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~C8MG4IM0W0UF.1 size=3767 2024-02-23T06:34:21.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.046+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=C8MG4IM0W0UF tag=UJQQNOQ3BQYM type=write size=2100919 2024-02-23T06:34:21.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.047+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~P16HZIXVXRU3.0 size=1048576 2024-02-23T06:34:21.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.048+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~P16HZIXVXRU3.1 size=554021 2024-02-23T06:34:21.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.050+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=P16HZIXVXRU3 tag=07ESMG2OKJHR type=write size=2651173 2024-02-23T06:34:21.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.051+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=F0CXFBYK7K9A type=del size=2562010 2024-02-23T06:34:21.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.053+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~7TUQUSTP0OYW.0 size=1048576 2024-02-23T06:34:21.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.053+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~7TUQUSTP0OYW.1 size=1048576 2024-02-23T06:34:21.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.055+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~7TUQUSTP0OYW.2 size=373463 2024-02-23T06:34:21.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.056+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=7TUQUSTP0OYW tag=02F0MH4XW1R1 type=write size=3519191 2024-02-23T06:34:21.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.059+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~EIN3ZBWMENGN.0 size=1048576 2024-02-23T06:34:21.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.059+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~EIN3ZBWMENGN.1 size=1048576 2024-02-23T06:34:21.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.061+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~EIN3ZBWMENGN.2 size=872074 2024-02-23T06:34:21.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.061+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=EIN3ZBWMENGN tag=Y3SEUJOQJY9F type=write size=4017802 2024-02-23T06:34:21.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.062+0000 7f5e72834780 1 < suggested remove operation key=TPADM4812N0Z tag=R3J8NP4U88IT type=del 2024-02-23T06:34:21.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.063+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=NA91CJBX31D4 type=del size=3084227 2024-02-23T06:34:21.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.065+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~YNL4Z2PQ0HHR.0 size=499116 2024-02-23T06:34:21.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.067+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=YNL4Z2PQ0HHR tag=Q1K0KIWC3E7M type=write size=1547692 2024-02-23T06:34:21.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.069+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~S0M2FP8HG06F.0 size=1048576 2024-02-23T06:34:21.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.070+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~S0M2FP8HG06F.1 size=1048576 2024-02-23T06:34:21.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.071+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~S0M2FP8HG06F.2 size=546672 2024-02-23T06:34:21.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.071+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=S0M2FP8HG06F tag=ZS98ARTZYMAV type=write size=3692400 2024-02-23T06:34:21.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.072+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=NYERV6MH2MKM type=del 2024-02-23T06:34:21.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.074+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~9N2XAOT6ZE10.0 size=1048576 2024-02-23T06:34:21.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.075+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~9N2XAOT6ZE10.1 size=1048576 2024-02-23T06:34:21.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.076+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~9N2XAOT6ZE10.2 size=675950 2024-02-23T06:34:21.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.076+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=9N2XAOT6ZE10 tag=0T40UJHWK45P type=write size=3821678 2024-02-23T06:34:21.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.077+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~3I5ULD0Z73NU.0 size=502156 2024-02-23T06:34:21.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.079+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=3I5ULD0Z73NU tag=J3Q7JTBOARR5 type=write size=1550732 2024-02-23T06:34:21.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.081+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~2TTMAKTWADDS.0 size=1048576 2024-02-23T06:34:21.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.083+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~2TTMAKTWADDS.1 size=861478 2024-02-23T06:34:21.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.083+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=2TTMAKTWADDS tag=I61HV4LMN0Z7 type=write size=2958630 2024-02-23T06:34:21.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.084+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=B7CK1TLJ27GE type=del 2024-02-23T06:34:21.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.087+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=MH1DOMCOVZ8S type=del size=588043 2024-02-23T06:34:21.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.088+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=G72YOVQ3P4V4 type=del 2024-02-23T06:34:21.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.090+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~PL10D6YA12XV.0 size=1048576 2024-02-23T06:34:21.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.091+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~PL10D6YA12XV.1 size=1048576 2024-02-23T06:34:21.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.092+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~PL10D6YA12XV.2 size=1047054 2024-02-23T06:34:21.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.092+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=PL10D6YA12XV tag=ZV6XONEGK2WM type=write size=4192782 2024-02-23T06:34:21.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.093+0000 7f5e72834780 1 < canceled operation key=JV6FJONY04AW tag=Y9H5AW4YQ7HJ type=del size=251148 2024-02-23T06:34:21.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.094+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=L8PWXT1GWLDV type=del size=2094775 2024-02-23T06:34:21.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.095+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~FD8VAFK210HN.0 size=280496 2024-02-23T06:34:21.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.097+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=FD8VAFK210HN tag=M4OFEAUC7465 type=write size=1329072 2024-02-23T06:34:21.100 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.099+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~XFLB4OTY2LHK.0 size=1048576 2024-02-23T06:34:21.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.100+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~XFLB4OTY2LHK.1 size=1048576 2024-02-23T06:34:21.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.101+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~XFLB4OTY2LHK.2 size=515549 2024-02-23T06:34:21.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.101+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=XFLB4OTY2LHK tag=7T7SWY230229 type=write size=3661277 2024-02-23T06:34:21.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.102+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~R78MAA4SWZAH.0 size=197557 2024-02-23T06:34:21.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.104+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=R78MAA4SWZAH tag=C5ZLEWRAR1Q3 type=write size=1246133 2024-02-23T06:34:21.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.105+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=7EJTSP3DMB2S type=write size=8912 2024-02-23T06:34:21.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.106+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~1SUALTHNLCF3.0 size=1048576 2024-02-23T06:34:21.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.107+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~1SUALTHNLCF3.1 size=1048576 2024-02-23T06:34:21.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.107+0000 7f5e72834780 1 < canceled part key=_multipart_GACVVXC2Z1YO.2~1SUALTHNLCF3.2 size=41803 2024-02-23T06:34:21.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.109+0000 7f5e72834780 1 < canceled multipart upload key=GACVVXC2Z1YO upload=1SUALTHNLCF3 tag=FVBYJ007V3IG type=write size=3187531 2024-02-23T06:34:21.112 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.111+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=932I448PV1TF type=del size=2141682 2024-02-23T06:34:21.113 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.112+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~SQUBZHESAK81.0 size=995962 2024-02-23T06:34:21.115 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.114+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=SQUBZHESAK81 tag=8I5B3TVU8PKF type=write size=2044538 2024-02-23T06:34:21.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.115+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=YDYGJCLNS27A type=del size=751717 2024-02-23T06:34:21.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.116+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=KR6VU9T10KZL type=del 2024-02-23T06:34:21.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.117+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=KSUSV9FTKUYT type=write size=1009014 2024-02-23T06:34:21.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.118+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=YAS8MXDBOKCG type=del 2024-02-23T06:34:21.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.120+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~I32G1UKAC89A.0 size=602910 2024-02-23T06:34:21.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.120+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=I32G1UKAC89A tag=NDJZMIH6366H type=write size=1651486 2024-02-23T06:34:21.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.122+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~C8MG4IM0W0UF.0 size=1048576 2024-02-23T06:34:21.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.122+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~C8MG4IM0W0UF.1 size=3767 2024-02-23T06:34:21.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.124+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=C8MG4IM0W0UF tag=UJQQNOQ3BQYM type=write size=2100919 2024-02-23T06:34:21.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.125+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=XTROB5BK271U type=del size=3673207 2024-02-23T06:34:21.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.128+0000 7f5e72834780 1 < suggested update operation key=MB8BZ2BXZE9M tag=F0CXFBYK7K9A type=del size=2562010 2024-02-23T06:34:21.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.130+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~6GTS185J9KKR.0 size=673367 2024-02-23T06:34:21.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.130+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=6GTS185J9KKR tag=IOUVOC60D5HM type=write size=1721943 2024-02-23T06:34:21.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.131+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~EIN3ZBWMENGN.0 size=1048576 2024-02-23T06:34:21.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.131+0000 7f5e72834780 1 < canceled part key=_multipart_WK98HMHAZIUB.2~EIN3ZBWMENGN.1 size=1048576 2024-02-23T06:34:21.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.132+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~EIN3ZBWMENGN.2 size=872074 2024-02-23T06:34:21.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.134+0000 7f5e72834780 1 < canceled multipart upload key=WK98HMHAZIUB upload=EIN3ZBWMENGN tag=Y3SEUJOQJY9F type=write size=4017802 2024-02-23T06:34:21.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.136+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~DGD80EJPH427.0 size=1048576 2024-02-23T06:34:21.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.137+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~DGD80EJPH427.1 size=1048576 2024-02-23T06:34:21.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.138+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~DGD80EJPH427.2 size=332484 2024-02-23T06:34:21.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.138+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=DGD80EJPH427 tag=M4OWVME8Y2UT type=write size=3478212 2024-02-23T06:34:21.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.139+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=NA91CJBX31D4 type=del 2024-02-23T06:34:21.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.140+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=3I3P2NMYODSL type=del size=3257003 2024-02-23T06:34:21.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.141+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~S0M2FP8HG06F.0 size=1048576 2024-02-23T06:34:21.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.142+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~S0M2FP8HG06F.1 size=1048576 2024-02-23T06:34:21.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.143+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~S0M2FP8HG06F.2 size=546672 2024-02-23T06:34:21.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.145+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=S0M2FP8HG06F tag=ZS98ARTZYMAV type=write size=3692400 2024-02-23T06:34:21.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.146+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=773F50JLX600 type=del size=3314657 2024-02-23T06:34:21.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.147+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~9N2XAOT6ZE10.0 size=1048576 2024-02-23T06:34:21.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.148+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~9N2XAOT6ZE10.1 size=1048576 2024-02-23T06:34:21.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.149+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~9N2XAOT6ZE10.2 size=675950 2024-02-23T06:34:21.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.151+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=9N2XAOT6ZE10 tag=0T40UJHWK45P type=write size=3821678 2024-02-23T06:34:21.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.153+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~YRGQWJUQBC8X.0 size=1048576 2024-02-23T06:34:21.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.154+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~YRGQWJUQBC8X.1 size=234650 2024-02-23T06:34:21.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.154+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=YRGQWJUQBC8X tag=NECSCNE2FH0O type=write size=2331802 2024-02-23T06:34:21.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.155+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~2TTMAKTWADDS.0 size=1048576 2024-02-23T06:34:21.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.155+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~2TTMAKTWADDS.1 size=861478 2024-02-23T06:34:21.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.157+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=2TTMAKTWADDS tag=I61HV4LMN0Z7 type=write size=2958630 2024-02-23T06:34:21.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.159+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~VZ4MJQ685V20.0 size=1048576 2024-02-23T06:34:21.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.160+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~VZ4MJQ685V20.1 size=1048576 2024-02-23T06:34:21.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.161+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~VZ4MJQ685V20.2 size=172671 2024-02-23T06:34:21.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.161+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=VZ4MJQ685V20 tag=VTHRCZ2KGW46 type=write size=3318399 2024-02-23T06:34:21.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.163+0000 7f5e72834780 1 < suggested update operation key=ZC75CQ2789VE tag=MH1DOMCOVZ8S type=del size=588043 2024-02-23T06:34:21.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.164+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=MHYWH4W86KXM type=del size=4110802 2024-02-23T06:34:21.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.165+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~PL10D6YA12XV.0 size=1048576 2024-02-23T06:34:21.168 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.166+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~PL10D6YA12XV.1 size=1048576 2024-02-23T06:34:21.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.167+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~PL10D6YA12XV.2 size=1047054 2024-02-23T06:34:21.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.169+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=PL10D6YA12XV tag=ZV6XONEGK2WM type=write size=4192782 2024-02-23T06:34:21.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.171+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=4H5JQ7T1YYBM type=del size=2009407 2024-02-23T06:34:21.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.173+0000 7f5e72834780 1 < suggested update operation key=WK98HMHAZIUB tag=L8PWXT1GWLDV type=del size=2094775 2024-02-23T06:34:21.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.174+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=IXLPC9DJL98G type=write size=353359 2024-02-23T06:34:21.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.175+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~XFLB4OTY2LHK.0 size=1048576 2024-02-23T06:34:21.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.176+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~XFLB4OTY2LHK.1 size=1048576 2024-02-23T06:34:21.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.177+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~XFLB4OTY2LHK.2 size=515549 2024-02-23T06:34:21.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.179+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=XFLB4OTY2LHK tag=7T7SWY230229 type=write size=3661277 2024-02-23T06:34:21.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.182+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~RK1H4H9NO5PZ.0 size=934959 2024-02-23T06:34:21.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.182+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=RK1H4H9NO5PZ tag=N5GQ6PI0BSP1 type=write size=1983535 2024-02-23T06:34:21.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.183+0000 7f5e72834780 1 < completed write operation key=VEJ6D2J3LZI8 tag=7EJTSP3DMB2S type=write size=8912 2024-02-23T06:34:21.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.184+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=HPDFS5O6214Z type=del size=2035556 2024-02-23T06:34:21.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.185+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=932I448PV1TF type=del 2024-02-23T06:34:21.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.186+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=DXX0I09Q7J4Q type=write size=619078 2024-02-23T06:34:21.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.188+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=YDYGJCLNS27A type=del 2024-02-23T06:34:21.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.189+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=LYTO29QRX5T7 type=del size=3112854 2024-02-23T06:34:21.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.192+0000 7f5e72834780 1 < suggested update operation key=JV6FJONY04AW tag=KSUSV9FTKUYT type=write size=1009014 2024-02-23T06:34:21.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.194+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~VWRH0O9HDMEV.0 size=1048576 2024-02-23T06:34:21.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.195+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~VWRH0O9HDMEV.1 size=972149 2024-02-23T06:34:21.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.195+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=VWRH0O9HDMEV tag=P4K1R6U0TDX9 type=write size=3069301 2024-02-23T06:34:21.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.196+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~I32G1UKAC89A.0 size=602910 2024-02-23T06:34:21.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.198+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=I32G1UKAC89A tag=NDJZMIH6366H type=write size=1651486 2024-02-23T06:34:21.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.200+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=7YXP2QDY5JHM type=del size=751880 2024-02-23T06:34:21.202 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.201+0000 7f5e72834780 -1 < failed to complete operation key=ZC75CQ2789VE tag=XTROB5BK271U type=del size=3673207: (22) Invalid argument 2024-02-23T06:34:21.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.203+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~2ZEXA1KBJU8V.0 size=1048576 2024-02-23T06:34:21.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.203+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~2ZEXA1KBJU8V.1 size=968701 2024-02-23T06:34:21.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.204+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=2ZEXA1KBJU8V tag=XVWZ0F81WNHE type=write size=3065853 2024-02-23T06:34:21.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.205+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~6GTS185J9KKR.0 size=673367 2024-02-23T06:34:21.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.207+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=6GTS185J9KKR tag=IOUVOC60D5HM type=write size=1721943 2024-02-23T06:34:21.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.208+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=2N7HLGNPHD3A type=del size=1450462 2024-02-23T06:34:21.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.209+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~DGD80EJPH427.0 size=1048576 2024-02-23T06:34:21.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.210+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~DGD80EJPH427.1 size=1048576 2024-02-23T06:34:21.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.211+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~DGD80EJPH427.2 size=332484 2024-02-23T06:34:21.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.213+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=DGD80EJPH427 tag=M4OWVME8Y2UT type=write size=3478212 2024-02-23T06:34:21.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.214+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=39C3PS2UVLE4 type=del size=3965267 2024-02-23T06:34:21.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.216+0000 7f5e72834780 1 < suggested update operation key=QZLNM2RQ9SDC tag=3I3P2NMYODSL type=del size=3257003 2024-02-23T06:34:21.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.217+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=2Y87FTRLJFPS type=write size=890605 2024-02-23T06:34:21.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.220+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=773F50JLX600 type=del 2024-02-23T06:34:21.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.221+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=HVZAY0KCTEO1 type=del size=2069050 2024-02-23T06:34:21.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.222+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~YRGQWJUQBC8X.0 size=1048576 2024-02-23T06:34:21.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.223+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~YRGQWJUQBC8X.1 size=234650 2024-02-23T06:34:21.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.225+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=YRGQWJUQBC8X tag=NECSCNE2FH0O type=write size=2331802 2024-02-23T06:34:21.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.227+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~1T43QHG5U7LX.0 size=1048576 2024-02-23T06:34:21.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.228+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~1T43QHG5U7LX.1 size=51672 2024-02-23T06:34:21.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.228+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=1T43QHG5U7LX tag=IL2G63MLBYZ9 type=write size=2148824 2024-02-23T06:34:21.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.229+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~VZ4MJQ685V20.0 size=1048576 2024-02-23T06:34:21.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.230+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~VZ4MJQ685V20.1 size=1048576 2024-02-23T06:34:21.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.231+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~VZ4MJQ685V20.2 size=172671 2024-02-23T06:34:21.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.233+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=VZ4MJQ685V20 tag=VTHRCZ2KGW46 type=write size=3318399 2024-02-23T06:34:21.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.235+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=M0O8F45R1NAQ type=del size=244799 2024-02-23T06:34:21.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.236+0000 7f5e72834780 1 < canceled operation key=R3STDBS79MV0 tag=MHYWH4W86KXM type=del size=4110802 2024-02-23T06:34:21.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.237+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=QPFRA18OBX2O type=write size=416691 2024-02-23T06:34:21.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.238+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=4H5JQ7T1YYBM type=del 2024-02-23T06:34:21.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.240+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=AVOYNYL00ZVP type=del size=1740616 2024-02-23T06:34:21.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.242+0000 7f5e72834780 1 < suggested remove operation key=QZLNM2RQ9SDC tag=IXLPC9DJL98G type=write 2024-02-23T06:34:21.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.244+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~U2P31803VVTX.0 size=1048576 2024-02-23T06:34:21.247 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.245+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~U2P31803VVTX.1 size=266448 2024-02-23T06:34:21.247 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.245+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=U2P31803VVTX tag=0B52ZV2LGJ75 type=write size=2363600 2024-02-23T06:34:21.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.247+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~RK1H4H9NO5PZ.0 size=934959 2024-02-23T06:34:21.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.248+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=RK1H4H9NO5PZ tag=N5GQ6PI0BSP1 type=write size=1983535 2024-02-23T06:34:21.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.250+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=H3T1ZM07L7NI type=del size=586082 2024-02-23T06:34:21.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.251+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=HPDFS5O6214Z type=del 2024-02-23T06:34:21.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.253+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~Z5DYZLHJD8IK.0 size=724768 2024-02-23T06:34:21.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.253+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=Z5DYZLHJD8IK tag=CR16CKFS0UBG type=write size=1773344 2024-02-23T06:34:21.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.254+0000 7f5e72834780 1 < canceled operation key=0WLEPDK2O30W tag=DXX0I09Q7J4Q type=write size=619078 2024-02-23T06:34:21.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.255+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=9OB1UOT2A8FG type=del size=285180 2024-02-23T06:34:21.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.257+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=LYTO29QRX5T7 type=del 2024-02-23T06:34:21.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.259+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~H3K346NDLAIV.0 size=1048576 2024-02-23T06:34:21.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.259+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~H3K346NDLAIV.1 size=1048576 2024-02-23T06:34:21.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.260+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~H3K346NDLAIV.2 size=961340 2024-02-23T06:34:21.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.260+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=H3K346NDLAIV tag=OOBGBYGE1Y32 type=write size=4107068 2024-02-23T06:34:21.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.262+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~VWRH0O9HDMEV.0 size=1048576 2024-02-23T06:34:21.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.263+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~VWRH0O9HDMEV.1 size=972149 2024-02-23T06:34:21.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.265+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=VWRH0O9HDMEV tag=P4K1R6U0TDX9 type=write size=3069301 2024-02-23T06:34:21.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.266+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=YOIW6R2LTHII type=del size=1844446 2024-02-23T06:34:21.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.267+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=7YXP2QDY5JHM type=del 2024-02-23T06:34:21.269 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.268+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=Q9B946QJDX7T type=del size=1462957 2024-02-23T06:34:21.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.269+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~2ZEXA1KBJU8V.0 size=1048576 2024-02-23T06:34:21.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.270+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~2ZEXA1KBJU8V.1 size=968701 2024-02-23T06:34:21.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.272+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=2ZEXA1KBJU8V tag=XVWZ0F81WNHE type=write size=3065853 2024-02-23T06:34:21.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.273+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=Y4ACHTFS008I type=del size=1795582 2024-02-23T06:34:21.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.275+0000 7f5e72834780 -1 < failed to complete operation key=QZLNM2RQ9SDC tag=2N7HLGNPHD3A type=del size=1450462: (22) Invalid argument 2024-02-23T06:34:21.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.276+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=SKJ47UPNC0PD type=del size=160751 2024-02-23T06:34:21.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.277+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=39C3PS2UVLE4 type=del 2024-02-23T06:34:21.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.279+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=G0YF81M2F06Y type=del size=3916671 2024-02-23T06:34:21.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.280+0000 7f5e72834780 1 < completed write operation key=MB8BZ2BXZE9M tag=2Y87FTRLJFPS type=write size=890605 2024-02-23T06:34:21.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.281+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=TF6R0L7GKD57 type=del size=2429220 2024-02-23T06:34:21.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.284+0000 7f5e72834780 1 < suggested update operation key=GW6EKQ84FQ6L tag=HVZAY0KCTEO1 type=del size=2069050 2024-02-23T06:34:21.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.285+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=ZFRKVRHUA4VM type=write size=291649 2024-02-23T06:34:21.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.286+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~1T43QHG5U7LX.0 size=1048576 2024-02-23T06:34:21.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.287+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~1T43QHG5U7LX.1 size=51672 2024-02-23T06:34:21.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.290+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=1T43QHG5U7LX tag=IL2G63MLBYZ9 type=write size=2148824 2024-02-23T06:34:21.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.292+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~AU0ARI2OV8VN.0 size=742166 2024-02-23T06:34:21.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.292+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=AU0ARI2OV8VN tag=Y41MWNPUJVVX type=write size=1790742 2024-02-23T06:34:21.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.293+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=M0O8F45R1NAQ type=del 2024-02-23T06:34:21.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.295+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~R2LTAAWDVNE7.0 size=1048576 2024-02-23T06:34:21.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.296+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~R2LTAAWDVNE7.1 size=1048576 2024-02-23T06:34:21.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.297+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~R2LTAAWDVNE7.2 size=320341 2024-02-23T06:34:21.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.297+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=R2LTAAWDVNE7 tag=FTAD7SZROTUL type=write size=3466069 2024-02-23T06:34:21.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.298+0000 7f5e72834780 1 < completed write operation key=M5LH10WTDP0P tag=QPFRA18OBX2O type=write size=416691 2024-02-23T06:34:21.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.300+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=3164OV18QXL4 type=del size=3444130 2024-02-23T06:34:21.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.301+0000 7f5e72834780 1 < canceled operation key=883VBT1ADE6K tag=AVOYNYL00ZVP type=del size=1740616 2024-02-23T06:34:21.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.304+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~7L32Z5PO4E82.0 size=1048576 2024-02-23T06:34:21.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.307+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~7L32Z5PO4E82.1 size=93811 2024-02-23T06:34:21.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.307+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=7L32Z5PO4E82 tag=VB912IPFLQL6 type=write size=2190963 2024-02-23T06:34:21.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.309+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~U2P31803VVTX.0 size=1048576 2024-02-23T06:34:21.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.310+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~U2P31803VVTX.1 size=266448 2024-02-23T06:34:21.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.312+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=U2P31803VVTX tag=0B52ZV2LGJ75 type=write size=2363600 2024-02-23T06:34:21.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.313+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=ZD1VGRFCYB7I type=del size=3441299 2024-02-23T06:34:21.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.315+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=H3T1ZM07L7NI type=del 2024-02-23T06:34:21.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.316+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=HIMM7P6X1H2D type=del size=2840388 2024-02-23T06:34:21.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.317+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~Z5DYZLHJD8IK.0 size=724768 2024-02-23T06:34:21.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.319+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=Z5DYZLHJD8IK tag=CR16CKFS0UBG type=write size=1773344 2024-02-23T06:34:21.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.320+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=MDACT056QPP7 type=del size=2360944 2024-02-23T06:34:21.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.321+0000 7f5e72834780 1 < canceled operation key=N8RXOY8X71MO tag=9OB1UOT2A8FG type=del size=285180 2024-02-23T06:34:21.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.322+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=TZJR6GBWA9VF type=del size=4043906 2024-02-23T06:34:21.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.323+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~H3K346NDLAIV.0 size=1048576 2024-02-23T06:34:21.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.324+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~H3K346NDLAIV.1 size=1048576 2024-02-23T06:34:21.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.325+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~H3K346NDLAIV.2 size=961340 2024-02-23T06:34:21.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.327+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=H3K346NDLAIV tag=OOBGBYGE1Y32 type=write size=4107068 2024-02-23T06:34:21.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.328+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=OGGA4VLFPFID type=del size=1240220 2024-02-23T06:34:21.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.330+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=YOIW6R2LTHII type=del 2024-02-23T06:34:21.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.331+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=CCF3U8DFPP38 type=del size=764554 2024-02-23T06:34:21.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.332+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=Q9B946QJDX7T type=del 2024-02-23T06:34:21.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.333+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=Q02923C7XHJB type=del size=1198499 2024-02-23T06:34:21.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.336+0000 7f5e72834780 1 < suggested update operation key=9ZCNDGBEPWMN tag=Y4ACHTFS008I type=del size=1795582 2024-02-23T06:34:21.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.337+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=0G3EIVELU51L type=del size=956765 2024-02-23T06:34:21.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.338+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=SKJ47UPNC0PD type=del 2024-02-23T06:34:21.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.340+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~PHPE7FHQT9A7.0 size=1048576 2024-02-23T06:34:21.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.341+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~PHPE7FHQT9A7.1 size=816394 2024-02-23T06:34:21.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.341+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=PHPE7FHQT9A7 tag=NUC26AYRRXB0 type=write size=2913546 2024-02-23T06:34:21.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.342+0000 7f5e72834780 1 < canceled operation key=QGGULCYZ0ZSA tag=G0YF81M2F06Y type=del size=3916671 2024-02-23T06:34:21.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.344+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~KA6XDF0DF46P.0 size=1048576 2024-02-23T06:34:21.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.345+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~KA6XDF0DF46P.1 size=1048576 2024-02-23T06:34:21.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.346+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~KA6XDF0DF46P.2 size=281738 2024-02-23T06:34:21.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.346+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=KA6XDF0DF46P tag=0RZZGR7AWNAF type=write size=3427466 2024-02-23T06:34:21.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.347+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=TF6R0L7GKD57 type=del 2024-02-23T06:34:21.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.348+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=RLC3RW20Y7Q2 type=del size=3062990 2024-02-23T06:34:21.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.349+0000 7f5e72834780 1 < completed write operation key=TPADM4812N0Z tag=ZFRKVRHUA4VM type=write size=291649 2024-02-23T06:34:21.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.350+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=GSKHSKBSF9RC type=del size=721676 2024-02-23T06:34:21.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.351+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~AU0ARI2OV8VN.0 size=742166 2024-02-23T06:34:21.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.354+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=AU0ARI2OV8VN tag=Y41MWNPUJVVX type=write size=1790742 2024-02-23T06:34:21.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.356+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~LH8WDRGWHMNA.0 size=1048576 2024-02-23T06:34:21.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.357+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~LH8WDRGWHMNA.1 size=1048576 2024-02-23T06:34:21.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.358+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~LH8WDRGWHMNA.2 size=512690 2024-02-23T06:34:21.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.358+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=LH8WDRGWHMNA tag=BILFOJKOU9U6 type=write size=3658418 2024-02-23T06:34:21.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.358+0000 7f5e72834780 1 < canceled part key=_multipart_0WLEPDK2O30W.2~R2LTAAWDVNE7.0 size=1048576 2024-02-23T06:34:21.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.359+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~R2LTAAWDVNE7.1 size=1048576 2024-02-23T06:34:21.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.360+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~R2LTAAWDVNE7.2 size=320341 2024-02-23T06:34:21.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.362+0000 7f5e72834780 1 < canceled multipart upload key=0WLEPDK2O30W upload=R2LTAAWDVNE7 tag=FTAD7SZROTUL type=write size=3466069 2024-02-23T06:34:21.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.364+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~FWTX7N6SXP67.0 size=1048576 2024-02-23T06:34:21.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.365+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~FWTX7N6SXP67.1 size=1048576 2024-02-23T06:34:21.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.366+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~FWTX7N6SXP67.2 size=616771 2024-02-23T06:34:21.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.366+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=FWTX7N6SXP67 tag=NN6I51G2MVJK type=write size=3762499 2024-02-23T06:34:21.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.368+0000 7f5e72834780 1 < suggested remove operation key=9ZCNDGBEPWMN tag=3164OV18QXL4 type=del 2024-02-23T06:34:21.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.369+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=3CUEHB2KFGDW type=del size=1289683 2024-02-23T06:34:21.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.370+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~7L32Z5PO4E82.0 size=1048576 2024-02-23T06:34:21.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.370+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~7L32Z5PO4E82.1 size=93811 2024-02-23T06:34:21.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.372+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=7L32Z5PO4E82 tag=VB912IPFLQL6 type=write size=2190963 2024-02-23T06:34:21.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.374+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=UYQB7Q031TTM type=write size=592814 2024-02-23T06:34:21.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.375+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=ZD1VGRFCYB7I type=del 2024-02-23T06:34:21.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.376+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=2WIJDC5QKMV2 type=write size=836236 2024-02-23T06:34:21.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.377+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=HIMM7P6X1H2D type=del 2024-02-23T06:34:21.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.378+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=ISEY4G22A22O type=del size=4077343 2024-02-23T06:34:21.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.379+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=MDACT056QPP7 type=del 2024-02-23T06:34:21.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.381+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~232WC8BGVG82.0 size=1048576 2024-02-23T06:34:21.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.382+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~232WC8BGVG82.1 size=743236 2024-02-23T06:34:21.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.382+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=232WC8BGVG82 tag=JTZLQSIQKF2P type=write size=2840388 2024-02-23T06:34:21.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.383+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=TZJR6GBWA9VF type=del 2024-02-23T06:34:21.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.386+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~ZJ6N3AOGJOH6.0 size=968751 2024-02-23T06:34:21.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.386+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=ZJ6N3AOGJOH6 tag=P2JHXBI4OYAC type=write size=2017327 2024-02-23T06:34:21.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.387+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=OGGA4VLFPFID type=del 2024-02-23T06:34:21.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.389+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~0FVDOEWSNG88.0 size=1048576 2024-02-23T06:34:21.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.390+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~0FVDOEWSNG88.1 size=1048576 2024-02-23T06:34:21.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.391+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~0FVDOEWSNG88.2 size=628142 2024-02-23T06:34:21.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.391+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=0FVDOEWSNG88 tag=OXM5PFYPOQ3W type=write size=3773870 2024-02-23T06:34:21.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.392+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=CCF3U8DFPP38 type=del 2024-02-23T06:34:21.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.394+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~ST68HEOA16P0.0 size=577881 2024-02-23T06:34:21.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.394+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=ST68HEOA16P0 tag=FGMFD9JV8QS1 type=write size=1626457 2024-02-23T06:34:21.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.395+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=Q02923C7XHJB type=del 2024-02-23T06:34:21.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.397+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=KPCMADMZ8X39 type=write size=106883 2024-02-23T06:34:21.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.399+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=0G3EIVELU51L type=del 2024-02-23T06:34:21.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.401+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~P1REVMG7GNJ5.0 size=497562 2024-02-23T06:34:21.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.401+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=P1REVMG7GNJ5 tag=K7W0JSY4E4KW type=write size=1546138 2024-02-23T06:34:21.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.402+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~PHPE7FHQT9A7.0 size=1048576 2024-02-23T06:34:21.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.403+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~PHPE7FHQT9A7.1 size=816394 2024-02-23T06:34:21.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.405+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=PHPE7FHQT9A7 tag=NUC26AYRRXB0 type=write size=2913546 2024-02-23T06:34:21.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.406+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=CJ2FMUJ0BLNM type=del size=1281844 2024-02-23T06:34:21.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.408+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~KA6XDF0DF46P.0 size=1048576 2024-02-23T06:34:21.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.408+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~KA6XDF0DF46P.1 size=1048576 2024-02-23T06:34:21.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.409+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~KA6XDF0DF46P.2 size=281738 2024-02-23T06:34:21.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.411+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=KA6XDF0DF46P tag=0RZZGR7AWNAF type=write size=3427466 2024-02-23T06:34:21.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.412+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=3X7UZV8U2M3C type=del size=152228 2024-02-23T06:34:21.414 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.413+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=RLC3RW20Y7Q2 type=del 2024-02-23T06:34:21.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.414+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=4KY1TW5GPPNF type=del size=2706711 2024-02-23T06:34:21.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.415+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=GSKHSKBSF9RC type=del 2024-02-23T06:34:21.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.418+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~O1WN7TNLO2AN.0 size=350115 2024-02-23T06:34:21.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.418+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=O1WN7TNLO2AN tag=XWY17FJ2SUC8 type=write size=1398691 2024-02-23T06:34:21.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.420+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~LH8WDRGWHMNA.0 size=1048576 2024-02-23T06:34:21.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.420+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~LH8WDRGWHMNA.1 size=1048576 2024-02-23T06:34:21.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.420+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~LH8WDRGWHMNA.2 size=512690 2024-02-23T06:34:21.424 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.422+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=LH8WDRGWHMNA tag=BILFOJKOU9U6 type=write size=3658418 2024-02-23T06:34:21.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.425+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~R1B0U1T8GTX7.0 size=1048576 2024-02-23T06:34:21.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.426+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~R1B0U1T8GTX7.1 size=630931 2024-02-23T06:34:21.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.426+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=R1B0U1T8GTX7 tag=68XOFYV0FFFH type=write size=2728083 2024-02-23T06:34:21.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.427+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~FWTX7N6SXP67.0 size=1048576 2024-02-23T06:34:21.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.428+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~FWTX7N6SXP67.1 size=1048576 2024-02-23T06:34:21.430 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.429+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~FWTX7N6SXP67.2 size=616771 2024-02-23T06:34:21.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.432+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=FWTX7N6SXP67 tag=NN6I51G2MVJK type=write size=3762499 2024-02-23T06:34:21.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.434+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~0F7KXXF71E03.0 size=1048576 2024-02-23T06:34:21.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.435+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~0F7KXXF71E03.1 size=353775 2024-02-23T06:34:21.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.435+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=0F7KXXF71E03 tag=OABLC3XVJQ0L type=write size=2450927 2024-02-23T06:34:21.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.436+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=3CUEHB2KFGDW type=del 2024-02-23T06:34:21.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.437+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=14UFSATYXLL1 type=write size=988662 2024-02-23T06:34:21.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.438+0000 7f5e72834780 1 < completed write operation key=GACVVXC2Z1YO tag=UYQB7Q031TTM type=write size=592814 2024-02-23T06:34:21.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.439+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=7JBSMNFNH6ON type=del size=3889020 2024-02-23T06:34:21.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.441+0000 7f5e72834780 1 < suggested remove operation key=TPADM4812N0Z tag=2WIJDC5QKMV2 type=write 2024-02-23T06:34:21.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.444+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~P6I2DMMPEQWG.0 size=1048576 2024-02-23T06:34:21.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.444+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~P6I2DMMPEQWG.1 size=1048576 2024-02-23T06:34:21.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.445+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~P6I2DMMPEQWG.2 size=68290 2024-02-23T06:34:21.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.445+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=P6I2DMMPEQWG tag=JS35338IV3J3 type=write size=3214018 2024-02-23T06:34:21.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.447+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=ISEY4G22A22O type=del 2024-02-23T06:34:21.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.448+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=QE25FZN34U36 type=del size=1638842 2024-02-23T06:34:21.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.449+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~232WC8BGVG82.0 size=1048576 2024-02-23T06:34:21.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.450+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~232WC8BGVG82.1 size=743236 2024-02-23T06:34:21.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.452+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=232WC8BGVG82 tag=JTZLQSIQKF2P type=write size=2840388 2024-02-23T06:34:21.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.454+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~0RS3D0Y3GD6V.0 size=91615 2024-02-23T06:34:21.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.454+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=0RS3D0Y3GD6V tag=7QY47L1NMLJL type=write size=1140191 2024-02-23T06:34:21.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.455+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~ZJ6N3AOGJOH6.0 size=968751 2024-02-23T06:34:21.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.457+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=ZJ6N3AOGJOH6 tag=P2JHXBI4OYAC type=write size=2017327 2024-02-23T06:34:21.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.459+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~MOLOGWAVCLWJ.0 size=1048576 2024-02-23T06:34:21.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.460+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~MOLOGWAVCLWJ.1 size=69907 2024-02-23T06:34:21.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.460+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=MOLOGWAVCLWJ tag=2B4P77R8KILT type=write size=2167059 2024-02-23T06:34:21.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.461+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~0FVDOEWSNG88.0 size=1048576 2024-02-23T06:34:21.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.462+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~0FVDOEWSNG88.1 size=1048576 2024-02-23T06:34:21.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.462+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~0FVDOEWSNG88.2 size=628142 2024-02-23T06:34:21.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.464+0000 7f5e72834780 1 < canceled multipart upload key=26EE3EHDK8EM upload=0FVDOEWSNG88 tag=OXM5PFYPOQ3W type=write size=3773870 2024-02-23T06:34:21.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.465+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=NW6BFR3SGNIP type=del size=1423051 2024-02-23T06:34:21.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.466+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~ST68HEOA16P0.0 size=577881 2024-02-23T06:34:21.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.468+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=ST68HEOA16P0 tag=FGMFD9JV8QS1 type=write size=1626457 2024-02-23T06:34:21.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.470+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~IELY4TVGVAME.0 size=483920 2024-02-23T06:34:21.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.470+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=IELY4TVGVAME tag=VUF5XZV72IEE type=write size=1532496 2024-02-23T06:34:21.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.471+0000 7f5e72834780 1 < completed write operation key=MB8BZ2BXZE9M tag=KPCMADMZ8X39 type=write size=106883 2024-02-23T06:34:21.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.472+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=L7JTBW4Q1HHM type=del size=2478885 2024-02-23T06:34:21.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.474+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~P1REVMG7GNJ5.0 size=497562 2024-02-23T06:34:21.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.476+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=P1REVMG7GNJ5 tag=K7W0JSY4E4KW type=write size=1546138 2024-02-23T06:34:21.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.478+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~6ONV0ZG55Z91.0 size=1048576 2024-02-23T06:34:21.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.478+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~6ONV0ZG55Z91.1 size=1048576 2024-02-23T06:34:21.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.479+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~6ONV0ZG55Z91.2 size=994463 2024-02-23T06:34:21.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.479+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=6ONV0ZG55Z91 tag=GC4NRR7ACPVN type=write size=4140191 2024-02-23T06:34:21.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.481+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=CJ2FMUJ0BLNM type=del 2024-02-23T06:34:21.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.483+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~3MCA12XBV7ZJ.0 size=1048576 2024-02-23T06:34:21.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.484+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~3MCA12XBV7ZJ.1 size=1048576 2024-02-23T06:34:21.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.485+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~3MCA12XBV7ZJ.2 size=341810 2024-02-23T06:34:21.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.485+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=3MCA12XBV7ZJ tag=58NE4BPKO4HV type=write size=3487538 2024-02-23T06:34:21.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.486+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=3X7UZV8U2M3C type=del 2024-02-23T06:34:21.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.487+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=12D16LNUS5FT type=del size=1272628 2024-02-23T06:34:21.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.489+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=4KY1TW5GPPNF type=del 2024-02-23T06:34:21.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.490+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=GL3EY9F82DBA type=del size=3945361 2024-02-23T06:34:21.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.491+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~O1WN7TNLO2AN.0 size=350115 2024-02-23T06:34:21.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.493+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=O1WN7TNLO2AN tag=XWY17FJ2SUC8 type=write size=1398691 2024-02-23T06:34:21.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.495+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~6HXQZ55QOUIS.0 size=1048576 2024-02-23T06:34:21.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.496+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~6HXQZ55QOUIS.1 size=1048576 2024-02-23T06:34:21.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.497+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~6HXQZ55QOUIS.2 size=122486 2024-02-23T06:34:21.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.497+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=6HXQZ55QOUIS tag=WY9DCNJ37E33 type=write size=3268214 2024-02-23T06:34:21.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.498+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~R1B0U1T8GTX7.0 size=1048576 2024-02-23T06:34:21.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.499+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~R1B0U1T8GTX7.1 size=630931 2024-02-23T06:34:21.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.500+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=R1B0U1T8GTX7 tag=68XOFYV0FFFH type=write size=2728083 2024-02-23T06:34:21.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.502+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=JRVPKB66UUEX type=del size=4012608 2024-02-23T06:34:21.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.503+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~0F7KXXF71E03.0 size=1048576 2024-02-23T06:34:21.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.504+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~0F7KXXF71E03.1 size=353775 2024-02-23T06:34:21.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.506+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=0F7KXXF71E03 tag=OABLC3XVJQ0L type=write size=2450927 2024-02-23T06:34:21.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.507+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=FNEJSZJLI5Y9 type=del size=1054190 2024-02-23T06:34:21.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.509+0000 7f5e72834780 1 < completed write operation key=R3STDBS79MV0 tag=14UFSATYXLL1 type=write size=988662 2024-02-23T06:34:21.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.511+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~QV9K2A9PP4OZ.0 size=1048576 2024-02-23T06:34:21.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.511+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~QV9K2A9PP4OZ.1 size=482349 2024-02-23T06:34:21.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.511+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=QV9K2A9PP4OZ tag=NQMKMEMQCPCE type=write size=2579501 2024-02-23T06:34:21.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.514+0000 7f5e72834780 1 < suggested update operation key=WK98HMHAZIUB tag=7JBSMNFNH6ON type=del size=3889020 2024-02-23T06:34:21.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.516+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~R7W2IH6UL9LF.0 size=1048576 2024-02-23T06:34:21.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.516+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~R7W2IH6UL9LF.1 size=135856 2024-02-23T06:34:21.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.516+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=R7W2IH6UL9LF tag=8118Q2T2WVZ4 type=write size=2233008 2024-02-23T06:34:21.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.518+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~P6I2DMMPEQWG.0 size=1048576 2024-02-23T06:34:21.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.519+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~P6I2DMMPEQWG.1 size=1048576 2024-02-23T06:34:21.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.519+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~P6I2DMMPEQWG.2 size=68290 2024-02-23T06:34:21.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.521+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=P6I2DMMPEQWG tag=JS35338IV3J3 type=write size=3214018 2024-02-23T06:34:21.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.523+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=T6U7KO2VPBTH type=del size=793753 2024-02-23T06:34:21.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.524+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=QE25FZN34U36 type=del 2024-02-23T06:34:21.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.525+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=1PDIWOF7L59J type=del size=663643 2024-02-23T06:34:21.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.526+0000 7f5e72834780 1 < canceled part key=_multipart_WK98HMHAZIUB.2~0RS3D0Y3GD6V.0 size=91615 2024-02-23T06:34:21.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.528+0000 7f5e72834780 1 < canceled multipart upload key=WK98HMHAZIUB upload=0RS3D0Y3GD6V tag=7QY47L1NMLJL type=write size=1140191 2024-02-23T06:34:21.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.529+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=9F20CLSKMKG5 type=write size=86572 2024-02-23T06:34:21.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.530+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~MOLOGWAVCLWJ.0 size=1048576 2024-02-23T06:34:21.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.530+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~MOLOGWAVCLWJ.1 size=69907 2024-02-23T06:34:21.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.532+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=MOLOGWAVCLWJ tag=2B4P77R8KILT type=write size=2167059 2024-02-23T06:34:21.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.534+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~YJ7AQFUMM26R.0 size=639936 2024-02-23T06:34:21.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.534+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=YJ7AQFUMM26R tag=AOCN1OFBODCB type=write size=1688512 2024-02-23T06:34:21.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.535+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=NW6BFR3SGNIP type=del 2024-02-23T06:34:21.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.536+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=IHL5Z786XE9X type=del size=2630882 2024-02-23T06:34:21.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.537+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~IELY4TVGVAME.0 size=483920 2024-02-23T06:34:21.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.539+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=IELY4TVGVAME tag=VUF5XZV72IEE type=write size=1532496 2024-02-23T06:34:21.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.542+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~7O3UXLFGJHEH.0 size=1048576 2024-02-23T06:34:21.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.543+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~7O3UXLFGJHEH.1 size=1048576 2024-02-23T06:34:21.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.544+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~7O3UXLFGJHEH.2 size=626160 2024-02-23T06:34:21.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.544+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=7O3UXLFGJHEH tag=CPP0W0JTVU3I type=write size=3771888 2024-02-23T06:34:21.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.545+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=L7JTBW4Q1HHM type=del 2024-02-23T06:34:21.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.546+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=UH4KHSFU7I4Q type=del size=4045257 2024-02-23T06:34:21.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.546+0000 7f5e72834780 1 < canceled part key=_multipart_QGGULCYZ0ZSA.2~6ONV0ZG55Z91.0 size=1048576 2024-02-23T06:34:21.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.547+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~6ONV0ZG55Z91.1 size=1048576 2024-02-23T06:34:21.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.548+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~6ONV0ZG55Z91.2 size=994463 2024-02-23T06:34:21.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.550+0000 7f5e72834780 1 < canceled multipart upload key=QGGULCYZ0ZSA upload=6ONV0ZG55Z91 tag=GC4NRR7ACPVN type=write size=4140191 2024-02-23T06:34:21.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.551+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=EQ99SI24RU7C type=write size=472858 2024-02-23T06:34:21.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.551+0000 7f5e72834780 1 < canceled part key=_multipart_IDTA5RV6IUF6.2~3MCA12XBV7ZJ.0 size=1048576 2024-02-23T06:34:21.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.552+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~3MCA12XBV7ZJ.1 size=1048576 2024-02-23T06:34:21.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.553+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~3MCA12XBV7ZJ.2 size=341810 2024-02-23T06:34:21.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.555+0000 7f5e72834780 1 < canceled multipart upload key=IDTA5RV6IUF6 upload=3MCA12XBV7ZJ tag=58NE4BPKO4HV type=write size=3487538 2024-02-23T06:34:21.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.557+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~JQ5NNLN80M5K.0 size=1048576 2024-02-23T06:34:21.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.558+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~JQ5NNLN80M5K.1 size=1048576 2024-02-23T06:34:21.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.559+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~JQ5NNLN80M5K.2 size=1008020 2024-02-23T06:34:21.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.559+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=JQ5NNLN80M5K tag=JL3HRJRXOEZS type=write size=4153748 2024-02-23T06:34:21.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.560+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=12D16LNUS5FT type=del 2024-02-23T06:34:21.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.563+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~YF5NA6P1RJSZ.0 size=413314 2024-02-23T06:34:21.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.563+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=YF5NA6P1RJSZ tag=WRVOGW3NA41V type=write size=1461890 2024-02-23T06:34:21.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.564+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=GL3EY9F82DBA type=del 2024-02-23T06:34:21.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.566+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NF237SWS19NW.0 size=1048576 2024-02-23T06:34:21.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.566+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NF237SWS19NW.1 size=1048576 2024-02-23T06:34:21.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.567+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NF237SWS19NW.2 size=316551 2024-02-23T06:34:21.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.567+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=NF237SWS19NW tag=OH8HTWC3V3SR type=write size=3462279 2024-02-23T06:34:21.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.568+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~6HXQZ55QOUIS.0 size=1048576 2024-02-23T06:34:21.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.569+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~6HXQZ55QOUIS.1 size=1048576 2024-02-23T06:34:21.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.570+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~6HXQZ55QOUIS.2 size=122486 2024-02-23T06:34:21.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.572+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=6HXQZ55QOUIS tag=WY9DCNJ37E33 type=write size=3268214 2024-02-23T06:34:21.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.574+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~0EG7GCFESWXZ.0 size=1048576 2024-02-23T06:34:21.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.575+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~0EG7GCFESWXZ.1 size=73007 2024-02-23T06:34:21.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.575+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=0EG7GCFESWXZ tag=6MSP8ZREJBN9 type=write size=2170159 2024-02-23T06:34:21.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.577+0000 7f5e72834780 1 < canceled operation key=8Q6WC7B9BY5Q tag=JRVPKB66UUEX type=del size=4012608 2024-02-23T06:34:21.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.578+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=8KPSZ3R92XFO type=del size=2320419 2024-02-23T06:34:21.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.579+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=FNEJSZJLI5Y9 type=del 2024-02-23T06:34:21.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.580+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=104Z00EFGP38 type=write size=657145 2024-02-23T06:34:21.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.580+0000 7f5e72834780 1 < canceled part key=_multipart_QGGULCYZ0ZSA.2~QV9K2A9PP4OZ.0 size=1048576 2024-02-23T06:34:21.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.580+0000 7f5e72834780 1 < canceled part key=_multipart_QGGULCYZ0ZSA.2~QV9K2A9PP4OZ.1 size=482349 2024-02-23T06:34:21.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.582+0000 7f5e72834780 1 < canceled multipart upload key=QGGULCYZ0ZSA upload=QV9K2A9PP4OZ tag=NQMKMEMQCPCE type=write size=2579501 2024-02-23T06:34:21.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.583+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=0S798TDMIE4J type=del size=2959528 2024-02-23T06:34:21.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.585+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~R7W2IH6UL9LF.0 size=1048576 2024-02-23T06:34:21.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.585+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~R7W2IH6UL9LF.1 size=135856 2024-02-23T06:34:21.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.587+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=R7W2IH6UL9LF tag=8118Q2T2WVZ4 type=write size=2233008 2024-02-23T06:34:21.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.588+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=G8Z93I483BS0 type=del size=3512927 2024-02-23T06:34:21.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.591+0000 7f5e72834780 1 < suggested update operation key=GWTK3YV0RY21 tag=T6U7KO2VPBTH type=del size=793753 2024-02-23T06:34:21.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.592+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=A13I5SMO45AH type=write size=920243 2024-02-23T06:34:21.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.593+0000 7f5e72834780 -1 < failed to complete operation key=GWTK3YV0RY21 tag=1PDIWOF7L59J type=del size=663643: (22) Invalid argument 2024-02-23T06:34:21.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.594+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=9UQAQCRUILJF type=del size=3017300 2024-02-23T06:34:21.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.595+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=9F20CLSKMKG5 type=write size=86572 2024-02-23T06:34:21.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.596+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=EW6QN0EWRCRZ type=del size=4132253 2024-02-23T06:34:21.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.596+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~YJ7AQFUMM26R.0 size=639936 2024-02-23T06:34:21.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.598+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=YJ7AQFUMM26R tag=AOCN1OFBODCB type=write size=1688512 2024-02-23T06:34:21.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.600+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~NJGCEH1UG1AW.0 size=57255 2024-02-23T06:34:21.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.600+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=NJGCEH1UG1AW tag=0BU3NYM2YVEA type=write size=1105831 2024-02-23T06:34:21.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.601+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=IHL5Z786XE9X type=del 2024-02-23T06:34:21.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.602+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=NDHYXHLSNGWQ type=del size=3173100 2024-02-23T06:34:21.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.603+0000 7f5e72834780 1 < canceled part key=_multipart_N8RXOY8X71MO.2~7O3UXLFGJHEH.0 size=1048576 2024-02-23T06:34:21.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.604+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~7O3UXLFGJHEH.1 size=1048576 2024-02-23T06:34:21.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.604+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~7O3UXLFGJHEH.2 size=626160 2024-02-23T06:34:21.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.606+0000 7f5e72834780 1 < canceled multipart upload key=N8RXOY8X71MO upload=7O3UXLFGJHEH tag=CPP0W0JTVU3I type=write size=3771888 2024-02-23T06:34:21.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.607+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=LO9V81OCAPSZ type=del size=1244626 2024-02-23T06:34:21.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.609+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=UH4KHSFU7I4Q type=del 2024-02-23T06:34:21.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.610+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~9VLS41ZTJGVG.0 size=1048576 2024-02-23T06:34:21.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.611+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~9VLS41ZTJGVG.1 size=1048576 2024-02-23T06:34:21.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.612+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~9VLS41ZTJGVG.2 size=511796 2024-02-23T06:34:21.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.612+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=9VLS41ZTJGVG tag=TU0Q4W80XK1L type=write size=3657524 2024-02-23T06:34:21.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.613+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=EQ99SI24RU7C type=write size=472858 2024-02-23T06:34:21.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.615+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~3I3OX5VFCLKN.0 size=1048576 2024-02-23T06:34:21.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.616+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~3I3OX5VFCLKN.1 size=1048576 2024-02-23T06:34:21.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.617+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~3I3OX5VFCLKN.2 size=951427 2024-02-23T06:34:21.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.617+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=3I3OX5VFCLKN tag=R783M1RUDVZU type=write size=4097155 2024-02-23T06:34:21.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.618+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~JQ5NNLN80M5K.0 size=1048576 2024-02-23T06:34:21.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.619+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~JQ5NNLN80M5K.1 size=1048576 2024-02-23T06:34:21.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.620+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~JQ5NNLN80M5K.2 size=1008020 2024-02-23T06:34:21.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.621+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=JQ5NNLN80M5K tag=JL3HRJRXOEZS type=write size=4153748 2024-02-23T06:34:21.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.623+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~0HLU2BJTWJVO.0 size=907822 2024-02-23T06:34:21.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.623+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=0HLU2BJTWJVO tag=DD73GH5VSN77 type=write size=1956398 2024-02-23T06:34:21.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.625+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~YF5NA6P1RJSZ.0 size=413314 2024-02-23T06:34:21.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.627+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=YF5NA6P1RJSZ tag=WRVOGW3NA41V type=write size=1461890 2024-02-23T06:34:21.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.628+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=IN22YKQUSXOD type=del size=4059365 2024-02-23T06:34:21.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.630+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NF237SWS19NW.0 size=1048576 2024-02-23T06:34:21.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.631+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NF237SWS19NW.1 size=1048576 2024-02-23T06:34:21.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.632+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NF237SWS19NW.2 size=316551 2024-02-23T06:34:21.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.634+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=NF237SWS19NW tag=OH8HTWC3V3SR type=write size=3462279 2024-02-23T06:34:21.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.636+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~LC5OPYJ0TJQ8.0 size=1048576 2024-02-23T06:34:21.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.637+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~LC5OPYJ0TJQ8.1 size=1048576 2024-02-23T06:34:21.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.638+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~LC5OPYJ0TJQ8.2 size=474704 2024-02-23T06:34:21.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.638+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=LC5OPYJ0TJQ8 tag=2X8PTEP78APD type=write size=3620432 2024-02-23T06:34:21.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.639+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~0EG7GCFESWXZ.0 size=1048576 2024-02-23T06:34:21.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.640+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~0EG7GCFESWXZ.1 size=73007 2024-02-23T06:34:21.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.642+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=0EG7GCFESWXZ tag=6MSP8ZREJBN9 type=write size=2170159 2024-02-23T06:34:21.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.644+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~BHJ8UFXK0A38.0 size=1048576 2024-02-23T06:34:21.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.645+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~BHJ8UFXK0A38.1 size=1048576 2024-02-23T06:34:21.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.645+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~BHJ8UFXK0A38.2 size=665981 2024-02-23T06:34:21.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.645+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=BHJ8UFXK0A38 tag=WCZ7VGE5EASY type=write size=3811709 2024-02-23T06:34:21.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.647+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=8KPSZ3R92XFO type=del size=2320419 2024-02-23T06:34:21.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.648+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=SVQLSLDPRKSO type=del size=2714325 2024-02-23T06:34:21.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.649+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=104Z00EFGP38 type=write size=657145 2024-02-23T06:34:21.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.651+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~W0YWJEVQ6MP9.0 size=1048576 2024-02-23T06:34:21.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.652+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~W0YWJEVQ6MP9.1 size=1048576 2024-02-23T06:34:21.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.653+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~W0YWJEVQ6MP9.2 size=559297 2024-02-23T06:34:21.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.653+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=W0YWJEVQ6MP9 tag=J7MZ2MQ75V28 type=write size=3705025 2024-02-23T06:34:21.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.654+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=0S798TDMIE4J type=del 2024-02-23T06:34:21.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.655+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=10W01RPWJ4DU type=del size=3298569 2024-02-23T06:34:21.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.656+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=G8Z93I483BS0 type=del 2024-02-23T06:34:21.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.658+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=B0CR8MYA7FUB type=del size=1377526 2024-02-23T06:34:21.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.660+0000 7f5e72834780 1 < suggested update operation key=ZM1YKZOUFSCY tag=A13I5SMO45AH type=write size=920243 2024-02-23T06:34:21.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.662+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~CRT5ETEBO1CJ.0 size=1048576 2024-02-23T06:34:21.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.663+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~CRT5ETEBO1CJ.1 size=1048576 2024-02-23T06:34:21.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.664+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~CRT5ETEBO1CJ.2 size=608279 2024-02-23T06:34:21.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.664+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=CRT5ETEBO1CJ tag=TYR7N9ODPQZ4 type=write size=3754007 2024-02-23T06:34:21.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.665+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=9UQAQCRUILJF type=del 2024-02-23T06:34:21.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.667+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~X321QAF6TCSA.0 size=751010 2024-02-23T06:34:21.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.667+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=X321QAF6TCSA tag=YO25U30KQSXQ type=write size=1799586 2024-02-23T06:34:21.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.668+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=EW6QN0EWRCRZ type=del size=4132253 2024-02-23T06:34:21.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.671+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~CINQKISSAWLZ.0 size=1048576 2024-02-23T06:34:21.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.671+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~CINQKISSAWLZ.1 size=513439 2024-02-23T06:34:21.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.671+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=CINQKISSAWLZ tag=IBTYHD3BVYLR type=write size=2610591 2024-02-23T06:34:21.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.673+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~NJGCEH1UG1AW.0 size=57255 2024-02-23T06:34:21.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.675+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=NJGCEH1UG1AW tag=0BU3NYM2YVEA type=write size=1105831 2024-02-23T06:34:21.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.676+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=83P8RLAFXJR2 type=write size=273337 2024-02-23T06:34:21.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.678+0000 7f5e72834780 1 < suggested update operation key=GACVVXC2Z1YO tag=NDHYXHLSNGWQ type=del size=3173100 2024-02-23T06:34:21.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.679+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=6V1JV2T0AEHE type=write size=835249 2024-02-23T06:34:21.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.680+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=LO9V81OCAPSZ type=del 2024-02-23T06:34:21.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.682+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=VZN42QMVZGUB type=del size=3857212 2024-02-23T06:34:21.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.682+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~9VLS41ZTJGVG.0 size=1048576 2024-02-23T06:34:21.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.683+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~9VLS41ZTJGVG.1 size=1048576 2024-02-23T06:34:21.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.684+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~9VLS41ZTJGVG.2 size=511796 2024-02-23T06:34:21.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.686+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=9VLS41ZTJGVG tag=TU0Q4W80XK1L type=write size=3657524 2024-02-23T06:34:21.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.688+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~52EE3FE70L2J.0 size=754405 2024-02-23T06:34:21.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.688+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=52EE3FE70L2J tag=GXCA2Y1LXVVF type=write size=1802981 2024-02-23T06:34:21.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.689+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~3I3OX5VFCLKN.0 size=1048576 2024-02-23T06:34:21.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.690+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~3I3OX5VFCLKN.1 size=1048576 2024-02-23T06:34:21.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.691+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~3I3OX5VFCLKN.2 size=951427 2024-02-23T06:34:21.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.693+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=3I3OX5VFCLKN tag=R783M1RUDVZU type=write size=4097155 2024-02-23T06:34:21.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.694+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=MET7GS6XXG2N type=del size=1882846 2024-02-23T06:34:21.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.694+0000 7f5e72834780 1 < canceled part key=_multipart_721UW0AGSKVR.2~0HLU2BJTWJVO.0 size=907822 2024-02-23T06:34:21.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.696+0000 7f5e72834780 1 < canceled multipart upload key=721UW0AGSKVR upload=0HLU2BJTWJVO tag=DD73GH5VSN77 type=write size=1956398 2024-02-23T06:34:21.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.697+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=J79LQR7VK3DB type=del size=2708446 2024-02-23T06:34:21.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.698+0000 7f5e72834780 -1 < failed to complete operation key=ZM1YKZOUFSCY tag=IN22YKQUSXOD type=del size=4059365: (22) Invalid argument 2024-02-23T06:34:21.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.699+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=779PSMA2H7JS type=del size=714578 2024-02-23T06:34:21.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.701+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~LC5OPYJ0TJQ8.0 size=1048576 2024-02-23T06:34:21.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.702+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~LC5OPYJ0TJQ8.1 size=1048576 2024-02-23T06:34:21.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.703+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~LC5OPYJ0TJQ8.2 size=474704 2024-02-23T06:34:21.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.705+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=LC5OPYJ0TJQ8 tag=2X8PTEP78APD type=write size=3620432 2024-02-23T06:34:21.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.706+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=0YUKV7XX5USW type=del size=238626 2024-02-23T06:34:21.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.707+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~BHJ8UFXK0A38.0 size=1048576 2024-02-23T06:34:21.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.708+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~BHJ8UFXK0A38.1 size=1048576 2024-02-23T06:34:21.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.709+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~BHJ8UFXK0A38.2 size=665981 2024-02-23T06:34:21.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.711+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=BHJ8UFXK0A38 tag=WCZ7VGE5EASY type=write size=3811709 2024-02-23T06:34:21.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.713+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~WMS5O0KO6ROR.0 size=1048576 2024-02-23T06:34:21.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.714+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~WMS5O0KO6ROR.1 size=205585 2024-02-23T06:34:21.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.714+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=WMS5O0KO6ROR tag=55BO0VNRSOKM type=write size=2302737 2024-02-23T06:34:21.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.717+0000 7f5e72834780 1 < suggested remove operation key=721UW0AGSKVR tag=SVQLSLDPRKSO type=del 2024-02-23T06:34:21.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.719+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~07MCX1AEIFXE.0 size=198197 2024-02-23T06:34:21.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.719+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=07MCX1AEIFXE tag=ZIF8T2FU2Q86 type=write size=1246773 2024-02-23T06:34:21.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.720+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~W0YWJEVQ6MP9.0 size=1048576 2024-02-23T06:34:21.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.721+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~W0YWJEVQ6MP9.1 size=1048576 2024-02-23T06:34:21.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.722+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~W0YWJEVQ6MP9.2 size=559297 2024-02-23T06:34:21.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.724+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=W0YWJEVQ6MP9 tag=J7MZ2MQ75V28 type=write size=3705025 2024-02-23T06:34:21.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.725+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=80P3GODAMGQV type=del size=1946689 2024-02-23T06:34:21.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.726+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=10W01RPWJ4DU type=del 2024-02-23T06:34:21.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.728+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=9A9BA1I77VM4 type=del size=630632 2024-02-23T06:34:21.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.729+0000 7f5e72834780 1 < canceled operation key=RS03NUABC1U2 tag=B0CR8MYA7FUB type=del size=1377526 2024-02-23T06:34:21.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.730+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=JY5AWNTWHRIK type=del size=282836 2024-02-23T06:34:21.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.731+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~CRT5ETEBO1CJ.0 size=1048576 2024-02-23T06:34:21.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.732+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~CRT5ETEBO1CJ.1 size=1048576 2024-02-23T06:34:21.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.733+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~CRT5ETEBO1CJ.2 size=608279 2024-02-23T06:34:21.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.736+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=CRT5ETEBO1CJ tag=TYR7N9ODPQZ4 type=write size=3754007 2024-02-23T06:34:21.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.737+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=2DVQH0PWIPJD type=del size=2503907 2024-02-23T06:34:21.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.738+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~X321QAF6TCSA.0 size=751010 2024-02-23T06:34:21.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.740+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=X321QAF6TCSA tag=YO25U30KQSXQ type=write size=1799586 2024-02-23T06:34:21.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.741+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=Q48BQIGIK8FM type=del size=2343625 2024-02-23T06:34:21.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.742+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~CINQKISSAWLZ.0 size=1048576 2024-02-23T06:34:21.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.743+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~CINQKISSAWLZ.1 size=513439 2024-02-23T06:34:21.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.745+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=CINQKISSAWLZ tag=IBTYHD3BVYLR type=write size=2610591 2024-02-23T06:34:21.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.747+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~69UO50R0N3J0.0 size=1048576 2024-02-23T06:34:21.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.748+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~69UO50R0N3J0.1 size=227887 2024-02-23T06:34:21.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.748+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=69UO50R0N3J0 tag=TDSGQVPGEKSH type=write size=2325039 2024-02-23T06:34:21.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.749+0000 7f5e72834780 1 < completed write operation key=GWTK3YV0RY21 tag=83P8RLAFXJR2 type=write size=273337 2024-02-23T06:34:21.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.751+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~XW3VJ1MSVHK3.0 size=1048576 2024-02-23T06:34:21.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.752+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~XW3VJ1MSVHK3.1 size=639187 2024-02-23T06:34:21.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.752+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=XW3VJ1MSVHK3 tag=6WN7JNUHYPE0 type=write size=2736339 2024-02-23T06:34:21.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.754+0000 7f5e72834780 1 < completed write operation key=MB8BZ2BXZE9M tag=6V1JV2T0AEHE type=write size=835249 2024-02-23T06:34:21.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.756+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~F1TI0JQG7B4V.0 size=1048576 2024-02-23T06:34:21.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.757+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~F1TI0JQG7B4V.1 size=1048576 2024-02-23T06:34:21.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.758+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~F1TI0JQG7B4V.2 size=704518 2024-02-23T06:34:21.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.758+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=F1TI0JQG7B4V tag=IAGSV583FXHG type=write size=3850246 2024-02-23T06:34:21.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.760+0000 7f5e72834780 1 < suggested update operation key=R3STDBS79MV0 tag=VZN42QMVZGUB type=del size=3857212 2024-02-23T06:34:21.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.761+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=RDFA3TJHF5EL type=write size=692999 2024-02-23T06:34:21.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.763+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~52EE3FE70L2J.0 size=754405 2024-02-23T06:34:21.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.764+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=52EE3FE70L2J tag=GXCA2Y1LXVVF type=write size=1802981 2024-02-23T06:34:21.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.766+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=QKVA33IW7D47 type=del size=1181900 2024-02-23T06:34:21.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.767+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=MET7GS6XXG2N type=del 2024-02-23T06:34:21.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.769+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~O71YNAHQUWL9.0 size=452459 2024-02-23T06:34:21.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.769+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=O71YNAHQUWL9 tag=J92UEML5F139 type=write size=1501035 2024-02-23T06:34:21.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.770+0000 7f5e72834780 1 < canceled operation key=IDTA5RV6IUF6 tag=J79LQR7VK3DB type=del size=2708446 2024-02-23T06:34:21.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.772+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=FRQFRHL9KXGR type=del size=2057932 2024-02-23T06:34:21.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.774+0000 7f5e72834780 1 < suggested remove operation key=LUERFL6AN6HF tag=779PSMA2H7JS type=del 2024-02-23T06:34:21.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.775+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=S2T4Q3KWPU6X type=del size=49985 2024-02-23T06:34:21.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.776+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=0YUKV7XX5USW type=del 2024-02-23T06:34:21.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.779+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~Z0XZJ8BR1PIF.0 size=724704 2024-02-23T06:34:21.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.779+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=Z0XZJ8BR1PIF tag=ECP815E0L0PJ type=write size=1773280 2024-02-23T06:34:21.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.780+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~WMS5O0KO6ROR.0 size=1048576 2024-02-23T06:34:21.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.781+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~WMS5O0KO6ROR.1 size=205585 2024-02-23T06:34:21.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.783+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=WMS5O0KO6ROR tag=55BO0VNRSOKM type=write size=2302737 2024-02-23T06:34:21.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.784+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=HRNOB6Y5166K type=del size=924886 2024-02-23T06:34:21.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.785+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~07MCX1AEIFXE.0 size=198197 2024-02-23T06:34:21.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.787+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=07MCX1AEIFXE tag=ZIF8T2FU2Q86 type=write size=1246773 2024-02-23T06:34:21.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.789+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~1OAH5V02WO2H.0 size=525623 2024-02-23T06:34:21.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.789+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=1OAH5V02WO2H tag=NJR9J8IT2GED type=write size=1574199 2024-02-23T06:34:21.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.790+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=80P3GODAMGQV type=del 2024-02-23T06:34:21.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.791+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=7DWIHPID1B95 type=del size=3605190 2024-02-23T06:34:21.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.793+0000 7f5e72834780 1 < suggested update operation key=883VBT1ADE6K tag=9A9BA1I77VM4 type=del size=630632 2024-02-23T06:34:21.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.795+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=4PXFHKDF0KP8 type=del size=3320623 2024-02-23T06:34:21.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.796+0000 7f5e72834780 1 < canceled operation key=R4YA9DUAJABL tag=JY5AWNTWHRIK type=del size=282836 2024-02-23T06:34:21.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.798+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~V8HVYMFTT5X5.0 size=357450 2024-02-23T06:34:21.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.798+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=V8HVYMFTT5X5 tag=MRBE6YFA0E1G type=write size=1406026 2024-02-23T06:34:21.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.799+0000 7f5e72834780 1 < canceled operation key=MB8BZ2BXZE9M tag=2DVQH0PWIPJD type=del size=2503907 2024-02-23T06:34:21.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.801+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~CMOEXF9RBHDM.0 size=618134 2024-02-23T06:34:21.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.801+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=CMOEXF9RBHDM tag=FXENDPYCMQLE type=write size=1666710 2024-02-23T06:34:21.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.802+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=Q48BQIGIK8FM type=del 2024-02-23T06:34:21.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.804+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~UXV0U0INQAUR.0 size=1048576 2024-02-23T06:34:21.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.805+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~UXV0U0INQAUR.1 size=1048576 2024-02-23T06:34:21.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.806+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~UXV0U0INQAUR.2 size=405968 2024-02-23T06:34:21.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.806+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=UXV0U0INQAUR tag=340R2NZKLJD1 type=write size=3551696 2024-02-23T06:34:21.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.807+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~69UO50R0N3J0.0 size=1048576 2024-02-23T06:34:21.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.808+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~69UO50R0N3J0.1 size=227887 2024-02-23T06:34:21.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.810+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=69UO50R0N3J0 tag=TDSGQVPGEKSH type=write size=2325039 2024-02-23T06:34:21.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.812+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~ADNG9FXFOV9B.0 size=1048576 2024-02-23T06:34:21.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.813+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~ADNG9FXFOV9B.1 size=1048576 2024-02-23T06:34:21.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.814+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~ADNG9FXFOV9B.2 size=103776 2024-02-23T06:34:21.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.814+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=ADNG9FXFOV9B tag=5J69XA4E9FGR type=write size=3249504 2024-02-23T06:34:21.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.815+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~XW3VJ1MSVHK3.0 size=1048576 2024-02-23T06:34:21.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.817+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~XW3VJ1MSVHK3.1 size=639187 2024-02-23T06:34:21.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.819+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=XW3VJ1MSVHK3 tag=6WN7JNUHYPE0 type=write size=2736339 2024-02-23T06:34:21.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.820+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=PN363B61ZZBJ type=del size=1707924 2024-02-23T06:34:21.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.821+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~F1TI0JQG7B4V.0 size=1048576 2024-02-23T06:34:21.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.822+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~F1TI0JQG7B4V.1 size=1048576 2024-02-23T06:34:21.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.823+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~F1TI0JQG7B4V.2 size=704518 2024-02-23T06:34:21.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.826+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=F1TI0JQG7B4V tag=IAGSV583FXHG type=write size=3850246 2024-02-23T06:34:21.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.828+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~O8U45MEWLJC2.0 size=1048576 2024-02-23T06:34:21.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.829+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~O8U45MEWLJC2.1 size=1048576 2024-02-23T06:34:21.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.830+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~O8U45MEWLJC2.2 size=543137 2024-02-23T06:34:21.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.830+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=O8U45MEWLJC2 tag=XOA0JBTY15O7 type=write size=3688865 2024-02-23T06:34:21.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.832+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=RDFA3TJHF5EL type=write size=692999 2024-02-23T06:34:21.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.834+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~WR8B4Z54QC3D.0 size=1048576 2024-02-23T06:34:21.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.835+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~WR8B4Z54QC3D.1 size=574265 2024-02-23T06:34:21.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.835+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=WR8B4Z54QC3D tag=EB1GXASN12RB type=write size=2671417 2024-02-23T06:34:21.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.836+0000 7f5e72834780 -1 < failed to complete operation key=883VBT1ADE6K tag=QKVA33IW7D47 type=del size=1181900: (22) Invalid argument 2024-02-23T06:34:21.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.838+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~YJTH21LM3ZG2.0 size=1048576 2024-02-23T06:34:21.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.839+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~YJTH21LM3ZG2.1 size=520234 2024-02-23T06:34:21.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.839+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=YJTH21LM3ZG2 tag=EKBD0IB8XP2H type=write size=2617386 2024-02-23T06:34:21.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.840+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~O71YNAHQUWL9.0 size=452459 2024-02-23T06:34:21.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.842+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=O71YNAHQUWL9 tag=J92UEML5F139 type=write size=1501035 2024-02-23T06:34:21.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.844+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=KX001ORH8CHT type=write size=131251 2024-02-23T06:34:21.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.845+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=FRQFRHL9KXGR type=del 2024-02-23T06:34:21.847 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.846+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=AEEZRVQSQHV5 type=del size=4069776 2024-02-23T06:34:21.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.848+0000 7f5e72834780 1 < suggested update operation key=GW6EKQ84FQ6L tag=S2T4Q3KWPU6X type=del size=49985 2024-02-23T06:34:21.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.849+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=NKEMFE67Q5VU type=write size=889694 2024-02-23T06:34:21.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.851+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~Z0XZJ8BR1PIF.0 size=724704 2024-02-23T06:34:21.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.852+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=Z0XZJ8BR1PIF tag=ECP815E0L0PJ type=write size=1773280 2024-02-23T06:34:21.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.855+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~U4JT0ZNEY9G3.0 size=1048576 2024-02-23T06:34:21.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.856+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~U4JT0ZNEY9G3.1 size=1048576 2024-02-23T06:34:21.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.857+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~U4JT0ZNEY9G3.2 size=457207 2024-02-23T06:34:21.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.857+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=U4JT0ZNEY9G3 tag=04FZ4TCY0QXR type=write size=3602935 2024-02-23T06:34:21.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.859+0000 7f5e72834780 1 < suggested update operation key=883VBT1ADE6K tag=HRNOB6Y5166K type=del size=924886 2024-02-23T06:34:21.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.860+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=4JR87JF0YJHQ type=del size=3264861 2024-02-23T06:34:21.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.861+0000 7f5e72834780 1 < canceled part key=_multipart_8Q6WC7B9BY5Q.2~1OAH5V02WO2H.0 size=525623 2024-02-23T06:34:21.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.863+0000 7f5e72834780 1 < canceled multipart upload key=8Q6WC7B9BY5Q upload=1OAH5V02WO2H tag=NJR9J8IT2GED type=write size=1574199 2024-02-23T06:34:21.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.864+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=07K86WX817VX type=del size=2310132 2024-02-23T06:34:21.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.865+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=7DWIHPID1B95 type=del 2024-02-23T06:34:21.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.866+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=H96LR83NO5F1 type=del size=3890077 2024-02-23T06:34:21.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.867+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=4PXFHKDF0KP8 type=del 2024-02-23T06:34:21.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.869+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=7LF1TAAYSZML type=write size=293552 2024-02-23T06:34:21.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.870+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~V8HVYMFTT5X5.0 size=357450 2024-02-23T06:34:21.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.872+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=V8HVYMFTT5X5 tag=MRBE6YFA0E1G type=write size=1406026 2024-02-23T06:34:21.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.873+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=5T3F5GVWR8OG type=del size=1077508 2024-02-23T06:34:21.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.874+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~CMOEXF9RBHDM.0 size=618134 2024-02-23T06:34:21.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.876+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=CMOEXF9RBHDM tag=FXENDPYCMQLE type=write size=1666710 2024-02-23T06:34:21.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.877+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=8SI5IRLPUSHG type=del size=1347426 2024-02-23T06:34:21.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.878+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~UXV0U0INQAUR.0 size=1048576 2024-02-23T06:34:21.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.879+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~UXV0U0INQAUR.1 size=1048576 2024-02-23T06:34:21.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.879+0000 7f5e72834780 1 < canceled part key=_multipart_WK98HMHAZIUB.2~UXV0U0INQAUR.2 size=405968 2024-02-23T06:34:21.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.881+0000 7f5e72834780 1 < canceled multipart upload key=WK98HMHAZIUB upload=UXV0U0INQAUR tag=340R2NZKLJD1 type=write size=3551696 2024-02-23T06:34:21.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.883+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~AFO3D3ZJCRJV.0 size=276165 2024-02-23T06:34:21.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.883+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=AFO3D3ZJCRJV tag=O5LLHCS7V906 type=write size=1324741 2024-02-23T06:34:21.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.883+0000 7f5e72834780 1 < canceled part key=_multipart_QZLNM2RQ9SDC.2~ADNG9FXFOV9B.0 size=1048576 2024-02-23T06:34:21.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.883+0000 7f5e72834780 1 < canceled part key=_multipart_QZLNM2RQ9SDC.2~ADNG9FXFOV9B.1 size=1048576 2024-02-23T06:34:21.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.884+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~ADNG9FXFOV9B.2 size=103776 2024-02-23T06:34:21.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.886+0000 7f5e72834780 1 < canceled multipart upload key=QZLNM2RQ9SDC upload=ADNG9FXFOV9B tag=5J69XA4E9FGR type=write size=3249504 2024-02-23T06:34:21.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.887+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=K4YITVBR007J type=del size=550723 2024-02-23T06:34:21.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.889+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=PN363B61ZZBJ type=del 2024-02-23T06:34:21.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.890+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=JXGC6EB4Y87Z type=del size=3105954 2024-02-23T06:34:21.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.891+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~O8U45MEWLJC2.0 size=1048576 2024-02-23T06:34:21.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.892+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~O8U45MEWLJC2.1 size=1048576 2024-02-23T06:34:21.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.893+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~O8U45MEWLJC2.2 size=543137 2024-02-23T06:34:21.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.895+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=O8U45MEWLJC2 tag=XOA0JBTY15O7 type=write size=3688865 2024-02-23T06:34:21.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.896+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=7IZPTOM22WE3 type=del size=1428323 2024-02-23T06:34:21.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.897+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~WR8B4Z54QC3D.0 size=1048576 2024-02-23T06:34:21.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.898+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~WR8B4Z54QC3D.1 size=574265 2024-02-23T06:34:21.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.900+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=WR8B4Z54QC3D tag=EB1GXASN12RB type=write size=2671417 2024-02-23T06:34:21.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.902+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=4E5JDL7TRZ3M type=write size=495829 2024-02-23T06:34:21.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.903+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~YJTH21LM3ZG2.0 size=1048576 2024-02-23T06:34:21.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.904+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~YJTH21LM3ZG2.1 size=520234 2024-02-23T06:34:21.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.906+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=YJTH21LM3ZG2 tag=EKBD0IB8XP2H type=write size=2617386 2024-02-23T06:34:21.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.908+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~BRZV7EH0G7ZT.0 size=832511 2024-02-23T06:34:21.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.908+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=BRZV7EH0G7ZT tag=42UALQHUR24O type=write size=1881087 2024-02-23T06:34:21.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.909+0000 7f5e72834780 1 < completed write operation key=IDTA5RV6IUF6 tag=KX001ORH8CHT type=write size=131251 2024-02-23T06:34:21.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.910+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=EE9M9LQZJ676 type=del size=4152678 2024-02-23T06:34:21.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.911+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=AEEZRVQSQHV5 type=del 2024-02-23T06:34:21.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.913+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~OMX26X7ZF93K.0 size=1048576 2024-02-23T06:34:21.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.914+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~OMX26X7ZF93K.1 size=1048576 2024-02-23T06:34:21.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.915+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~OMX26X7ZF93K.2 size=702840 2024-02-23T06:34:21.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.915+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=OMX26X7ZF93K tag=FRFNNW7VHMDL type=write size=3848568 2024-02-23T06:34:21.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.916+0000 7f5e72834780 1 < completed write operation key=R3STDBS79MV0 tag=NKEMFE67Q5VU type=write size=889694 2024-02-23T06:34:21.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.917+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=WB3BKRYTQLN7 type=write size=599121 2024-02-23T06:34:21.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.917+0000 7f5e72834780 1 < canceled part key=_multipart_VER8U5YMTPS6.2~U4JT0ZNEY9G3.0 size=1048576 2024-02-23T06:34:21.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.918+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~U4JT0ZNEY9G3.1 size=1048576 2024-02-23T06:34:21.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.919+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~U4JT0ZNEY9G3.2 size=457207 2024-02-23T06:34:21.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.921+0000 7f5e72834780 1 < canceled multipart upload key=VER8U5YMTPS6 upload=U4JT0ZNEY9G3 tag=04FZ4TCY0QXR type=write size=3602935 2024-02-23T06:34:21.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.922+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=4RSM0Z1SYAWO type=del size=1324646 2024-02-23T06:34:21.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.923+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=4JR87JF0YJHQ type=del 2024-02-23T06:34:21.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.925+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=JHFWPEN4H0MV type=del size=1106120 2024-02-23T06:34:21.927 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.926+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=07K86WX817VX type=del 2024-02-23T06:34:21.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.928+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~EZI0V3MBWMMT.0 size=1048576 2024-02-23T06:34:21.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.929+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~EZI0V3MBWMMT.1 size=198830 2024-02-23T06:34:21.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.929+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=EZI0V3MBWMMT tag=24I2CCTKHSWR type=write size=2295982 2024-02-23T06:34:21.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.932+0000 7f5e72834780 1 < suggested remove operation key=R4YA9DUAJABL tag=H96LR83NO5F1 type=del 2024-02-23T06:34:21.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.933+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=4JCDKM0NGUHN type=del size=2925803 2024-02-23T06:34:21.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.934+0000 7f5e72834780 1 < canceled operation key=RS03NUABC1U2 tag=7LF1TAAYSZML type=write size=293552 2024-02-23T06:34:21.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.936+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~QU8LXT2DGI40.0 size=1048576 2024-02-23T06:34:21.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.937+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~QU8LXT2DGI40.1 size=581659 2024-02-23T06:34:21.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.937+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=QU8LXT2DGI40 tag=22KM3LGZMXXL type=write size=2678811 2024-02-23T06:34:21.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.938+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=5T3F5GVWR8OG type=del 2024-02-23T06:34:21.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.940+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=X593SMVIE5E2 type=del size=870394 2024-02-23T06:34:21.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.941+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=8SI5IRLPUSHG type=del 2024-02-23T06:34:21.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.942+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=8UBU48Z6BN25 type=del size=2966739 2024-02-23T06:34:21.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.943+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~AFO3D3ZJCRJV.0 size=276165 2024-02-23T06:34:21.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.945+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=AFO3D3ZJCRJV tag=O5LLHCS7V906 type=write size=1324741 2024-02-23T06:34:21.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.946+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=09IWUOCBPG7M type=del size=1925664 2024-02-23T06:34:21.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.949+0000 7f5e72834780 1 < suggested remove operation key=9ZCNDGBEPWMN tag=K4YITVBR007J type=del 2024-02-23T06:34:21.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.950+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=624H4XEY3GAS type=write size=397807 2024-02-23T06:34:21.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.951+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=JXGC6EB4Y87Z type=del 2024-02-23T06:34:21.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.952+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=MQGQGG2CQ869 type=del size=359325 2024-02-23T06:34:21.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.954+0000 7f5e72834780 1 < canceled operation key=GACVVXC2Z1YO tag=7IZPTOM22WE3 type=del size=1428323 2024-02-23T06:34:21.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.957+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~6A5HZEVVSRUE.0 size=1048576 2024-02-23T06:34:21.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.958+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~6A5HZEVVSRUE.1 size=911928 2024-02-23T06:34:21.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.958+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=6A5HZEVVSRUE tag=MBILKFRX1OMJ type=write size=3009080 2024-02-23T06:34:21.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.961+0000 7f5e72834780 1 < suggested update operation key=0WLEPDK2O30W tag=4E5JDL7TRZ3M type=write size=495829 2024-02-23T06:34:21.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.962+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=KM056VWPQ6C0 type=del size=3787260 2024-02-23T06:34:21.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.963+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~BRZV7EH0G7ZT.0 size=832511 2024-02-23T06:34:21.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.965+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=BRZV7EH0G7ZT tag=42UALQHUR24O type=write size=1881087 2024-02-23T06:34:21.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.967+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~51FQH38C60W0.0 size=1048576 2024-02-23T06:34:21.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.968+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~51FQH38C60W0.1 size=258904 2024-02-23T06:34:21.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.968+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=51FQH38C60W0 tag=MHR202D525UQ type=write size=2356056 2024-02-23T06:34:21.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.969+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=EE9M9LQZJ676 type=del 2024-02-23T06:34:21.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.970+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=17AYCHONUYK5 type=del size=480160 2024-02-23T06:34:21.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.971+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~OMX26X7ZF93K.0 size=1048576 2024-02-23T06:34:21.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.972+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~OMX26X7ZF93K.1 size=1048576 2024-02-23T06:34:21.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.973+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~OMX26X7ZF93K.2 size=702840 2024-02-23T06:34:21.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.975+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=OMX26X7ZF93K tag=FRFNNW7VHMDL type=write size=3848568 2024-02-23T06:34:21.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.976+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=V5L9D5N2JC4N type=write size=823068 2024-02-23T06:34:21.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.977+0000 7f5e72834780 1 < completed write operation key=8Q6WC7B9BY5Q tag=WB3BKRYTQLN7 type=write size=599121 2024-02-23T06:34:21.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.979+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=V2NMIVD3AKDN type=del size=3224102 2024-02-23T06:34:21.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.980+0000 7f5e72834780 1 < canceled operation key=N8RXOY8X71MO tag=4RSM0Z1SYAWO type=del size=1324646 2024-02-23T06:34:21.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.982+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~4PZIK40W3B34.0 size=1048576 2024-02-23T06:34:21.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.983+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~4PZIK40W3B34.1 size=434729 2024-02-23T06:34:21.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.983+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=4PZIK40W3B34 tag=R3RQ7FU7Z1HW type=write size=2531881 2024-02-23T06:34:21.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.984+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=JHFWPEN4H0MV type=del 2024-02-23T06:34:21.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.985+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=E1OOHVS98GQC type=del size=3747503 2024-02-23T06:34:21.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.987+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~EZI0V3MBWMMT.0 size=1048576 2024-02-23T06:34:21.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.988+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~EZI0V3MBWMMT.1 size=198830 2024-02-23T06:34:21.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.990+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=EZI0V3MBWMMT tag=24I2CCTKHSWR type=write size=2295982 2024-02-23T06:34:21.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.991+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=SAWP4NP0HUW3 type=del size=1186135 2024-02-23T06:34:21.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.992+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=4JCDKM0NGUHN type=del 2024-02-23T06:34:21.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.993+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=Y3DCX4Q1AMIT type=write size=584229 2024-02-23T06:34:21.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.995+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~QU8LXT2DGI40.0 size=1048576 2024-02-23T06:34:21.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.996+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~QU8LXT2DGI40.1 size=581659 2024-02-23T06:34:21.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:21.998+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=QU8LXT2DGI40 tag=22KM3LGZMXXL type=write size=2678811 2024-02-23T06:34:22.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.000+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~31RCLPZ2ZCKS.0 size=1012755 2024-02-23T06:34:22.002 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.000+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=31RCLPZ2ZCKS tag=NJ1W0CGS1H0M type=write size=2061331 2024-02-23T06:34:22.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.001+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=X593SMVIE5E2 type=del 2024-02-23T06:34:22.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.003+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~0TTK0WSOB07E.0 size=1048576 2024-02-23T06:34:22.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.004+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~0TTK0WSOB07E.1 size=1048576 2024-02-23T06:34:22.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.005+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~0TTK0WSOB07E.2 size=288517 2024-02-23T06:34:22.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.005+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=0TTK0WSOB07E tag=K5K0G7S7WHKH type=write size=3434245 2024-02-23T06:34:22.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.007+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=8UBU48Z6BN25 type=del 2024-02-23T06:34:22.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.008+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=FRR5WBKKO6X5 type=write size=717732 2024-02-23T06:34:22.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.009+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=09IWUOCBPG7M type=del 2024-02-23T06:34:22.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.011+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~I6CNQ3LLPN1M.0 size=1048576 2024-02-23T06:34:22.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.012+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~I6CNQ3LLPN1M.1 size=1043495 2024-02-23T06:34:22.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.012+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=I6CNQ3LLPN1M tag=V2QZJVDOJWA4 type=write size=3140647 2024-02-23T06:34:22.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.014+0000 7f5e72834780 1 < completed write operation key=8Q6WC7B9BY5Q tag=624H4XEY3GAS type=write size=397807 2024-02-23T06:34:22.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.015+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=BUDS2Z0P62HP type=del size=1911089 2024-02-23T06:34:22.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.016+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=MQGQGG2CQ869 type=del 2024-02-23T06:34:22.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.017+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=UDAP9TLKOFNL type=del size=2764386 2024-02-23T06:34:22.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.019+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~6A5HZEVVSRUE.0 size=1048576 2024-02-23T06:34:22.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.020+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~6A5HZEVVSRUE.1 size=911928 2024-02-23T06:34:22.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.022+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=6A5HZEVVSRUE tag=MBILKFRX1OMJ type=write size=3009080 2024-02-23T06:34:22.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.023+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=BPTJKQO3AMR0 type=write size=911053 2024-02-23T06:34:22.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.024+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=KM056VWPQ6C0 type=del 2024-02-23T06:34:22.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.026+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~5OY3ON2MJWAM.0 size=1048576 2024-02-23T06:34:22.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.027+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~5OY3ON2MJWAM.1 size=1048576 2024-02-23T06:34:22.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.028+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~5OY3ON2MJWAM.2 size=356854 2024-02-23T06:34:22.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.028+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=5OY3ON2MJWAM tag=27YPDGD0P0IT type=write size=3502582 2024-02-23T06:34:22.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.030+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~51FQH38C60W0.0 size=1048576 2024-02-23T06:34:22.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.031+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~51FQH38C60W0.1 size=258904 2024-02-23T06:34:22.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.033+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=51FQH38C60W0 tag=MHR202D525UQ type=write size=2356056 2024-02-23T06:34:22.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.034+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=NIC6DZE3OFBU type=write size=686463 2024-02-23T06:34:22.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.035+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=17AYCHONUYK5 type=del 2024-02-23T06:34:22.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.036+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=JN73TLJ89VZ9 type=write size=658417 2024-02-23T06:34:22.040 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.039+0000 7f5e72834780 1 < suggested update operation key=GW6EKQ84FQ6L tag=V5L9D5N2JC4N type=write size=823068 2024-02-23T06:34:22.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.040+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=B5SAC759RA06 type=del size=1997953 2024-02-23T06:34:22.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.041+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=V2NMIVD3AKDN type=del 2024-02-23T06:34:22.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.044+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~P8W262BNCZSL.0 size=1048576 2024-02-23T06:34:22.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.044+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~P8W262BNCZSL.1 size=1048576 2024-02-23T06:34:22.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.045+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~P8W262BNCZSL.2 size=224874 2024-02-23T06:34:22.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.045+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=P8W262BNCZSL tag=FM3NKNOBJGSL type=write size=3370602 2024-02-23T06:34:22.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.047+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~4PZIK40W3B34.0 size=1048576 2024-02-23T06:34:22.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.048+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~4PZIK40W3B34.1 size=434729 2024-02-23T06:34:22.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.050+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=4PZIK40W3B34 tag=R3RQ7FU7Z1HW type=write size=2531881 2024-02-23T06:34:22.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.052+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~EMY5RWE9MA8H.0 size=1048576 2024-02-23T06:34:22.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.053+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~EMY5RWE9MA8H.1 size=583614 2024-02-23T06:34:22.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.053+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=EMY5RWE9MA8H tag=CC938ACBJ4BK type=write size=2680766 2024-02-23T06:34:22.056 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.055+0000 7f5e72834780 1 < suggested update operation key=QZLNM2RQ9SDC tag=E1OOHVS98GQC type=del size=3747503 2024-02-23T06:34:22.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.057+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~XR8Z9Z73OKOE.0 size=1048576 2024-02-23T06:34:22.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.058+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~XR8Z9Z73OKOE.1 size=1048576 2024-02-23T06:34:22.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.059+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~XR8Z9Z73OKOE.2 size=318649 2024-02-23T06:34:22.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.059+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=XR8Z9Z73OKOE tag=XBM4E1VBV5QX type=write size=3464377 2024-02-23T06:34:22.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.060+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=SAWP4NP0HUW3 type=del 2024-02-23T06:34:22.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.061+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=HC1165N540BG type=del size=4037064 2024-02-23T06:34:22.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.062+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=Y3DCX4Q1AMIT type=write size=584229 2024-02-23T06:34:22.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.065+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~ZKTO05X2B1J3.0 size=1048576 2024-02-23T06:34:22.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.066+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~ZKTO05X2B1J3.1 size=233786 2024-02-23T06:34:22.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.066+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=ZKTO05X2B1J3 tag=T717L2IE61VR type=write size=2330938 2024-02-23T06:34:22.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.067+0000 7f5e72834780 1 < canceled part key=_multipart_721UW0AGSKVR.2~31RCLPZ2ZCKS.0 size=1012755 2024-02-23T06:34:22.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.069+0000 7f5e72834780 1 < canceled multipart upload key=721UW0AGSKVR upload=31RCLPZ2ZCKS tag=NJ1W0CGS1H0M type=write size=2061331 2024-02-23T06:34:22.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.070+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=VYKALBWLUY6J type=write size=285383 2024-02-23T06:34:22.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.071+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~0TTK0WSOB07E.0 size=1048576 2024-02-23T06:34:22.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.071+0000 7f5e72834780 1 < canceled part key=_multipart_GACVVXC2Z1YO.2~0TTK0WSOB07E.1 size=1048576 2024-02-23T06:34:22.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.072+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~0TTK0WSOB07E.2 size=288517 2024-02-23T06:34:22.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.074+0000 7f5e72834780 1 < canceled multipart upload key=GACVVXC2Z1YO upload=0TTK0WSOB07E tag=K5K0G7S7WHKH type=write size=3434245 2024-02-23T06:34:22.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.076+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~NI8U5ICEHYBN.0 size=1048576 2024-02-23T06:34:22.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.077+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~NI8U5ICEHYBN.1 size=936211 2024-02-23T06:34:22.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.077+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=NI8U5ICEHYBN tag=TTZ9U4S3XZM1 type=write size=3033363 2024-02-23T06:34:22.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.079+0000 7f5e72834780 1 < suggested remove operation key=LUERFL6AN6HF tag=FRR5WBKKO6X5 type=write 2024-02-23T06:34:22.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.081+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=ZFOR93RV6EOJ type=del size=3904596 2024-02-23T06:34:22.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.082+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~I6CNQ3LLPN1M.0 size=1048576 2024-02-23T06:34:22.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.083+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~I6CNQ3LLPN1M.1 size=1043495 2024-02-23T06:34:22.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.085+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=I6CNQ3LLPN1M tag=V2QZJVDOJWA4 type=write size=3140647 2024-02-23T06:34:22.087 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.086+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=SE0JNBTQRH7O type=del size=2471837 2024-02-23T06:34:22.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.087+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=BUDS2Z0P62HP type=del 2024-02-23T06:34:22.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.090+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~F90K7OCBMW7A.0 size=1048576 2024-02-23T06:34:22.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.091+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~F90K7OCBMW7A.1 size=1048576 2024-02-23T06:34:22.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.092+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~F90K7OCBMW7A.2 size=714707 2024-02-23T06:34:22.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.092+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=F90K7OCBMW7A tag=UPTJR4JR9NMS type=write size=3860435 2024-02-23T06:34:22.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.093+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=UDAP9TLKOFNL type=del 2024-02-23T06:34:22.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.095+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~Y3G95E9939KD.0 size=1048576 2024-02-23T06:34:22.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.096+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~Y3G95E9939KD.1 size=1048576 2024-02-23T06:34:22.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.097+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~Y3G95E9939KD.2 size=558433 2024-02-23T06:34:22.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.097+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=Y3G95E9939KD tag=UXLJODE86UBG type=write size=3704161 2024-02-23T06:34:22.099 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.098+0000 7f5e72834780 1 < completed write operation key=4M7BT05YB0C3 tag=BPTJKQO3AMR0 type=write size=911053 2024-02-23T06:34:22.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.100+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~WIQE88XR5Z1Z.0 size=56957 2024-02-23T06:34:22.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.100+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=WIQE88XR5Z1Z tag=NB0FM64S5VEI type=write size=1105533 2024-02-23T06:34:22.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.101+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~5OY3ON2MJWAM.0 size=1048576 2024-02-23T06:34:22.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.102+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~5OY3ON2MJWAM.1 size=1048576 2024-02-23T06:34:22.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.103+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~5OY3ON2MJWAM.2 size=356854 2024-02-23T06:34:22.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.105+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=5OY3ON2MJWAM tag=27YPDGD0P0IT type=write size=3502582 2024-02-23T06:34:22.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.108+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~4ACSBSKLVEYI.0 size=1048576 2024-02-23T06:34:22.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.109+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~4ACSBSKLVEYI.1 size=813876 2024-02-23T06:34:22.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.109+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=4ACSBSKLVEYI tag=FXN0PXCBKNQ6 type=write size=2911028 2024-02-23T06:34:22.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.110+0000 7f5e72834780 1 < completed write operation key=GWTK3YV0RY21 tag=NIC6DZE3OFBU type=write size=686463 2024-02-23T06:34:22.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.113+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~1VCICACEZ4Q3.0 size=1029776 2024-02-23T06:34:22.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.113+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=1VCICACEZ4Q3 tag=OINBB5N4YS5Y type=write size=2078352 2024-02-23T06:34:22.115 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.114+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=JN73TLJ89VZ9 type=write size=658417 2024-02-23T06:34:22.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.115+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=0VU2YPR41ZZD type=del size=3164876 2024-02-23T06:34:22.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.117+0000 7f5e72834780 1 < suggested remove operation key=9ZCNDGBEPWMN tag=B5SAC759RA06 type=del 2024-02-23T06:34:22.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.120+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~FO1S19FTFHRY.0 size=31896 2024-02-23T06:34:22.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.120+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=FO1S19FTFHRY tag=0RMAV4TXHOF0 type=write size=1080472 2024-02-23T06:34:22.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.121+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~P8W262BNCZSL.0 size=1048576 2024-02-23T06:34:22.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.122+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~P8W262BNCZSL.1 size=1048576 2024-02-23T06:34:22.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.123+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~P8W262BNCZSL.2 size=224874 2024-02-23T06:34:22.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.125+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=P8W262BNCZSL tag=FM3NKNOBJGSL type=write size=3370602 2024-02-23T06:34:22.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.127+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~UEBULLIIRXNN.0 size=1048576 2024-02-23T06:34:22.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.128+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~UEBULLIIRXNN.1 size=79655 2024-02-23T06:34:22.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.128+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=UEBULLIIRXNN tag=3JEVIQ0CXBFF type=write size=2176807 2024-02-23T06:34:22.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.129+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~EMY5RWE9MA8H.0 size=1048576 2024-02-23T06:34:22.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.130+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~EMY5RWE9MA8H.1 size=583614 2024-02-23T06:34:22.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.132+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=EMY5RWE9MA8H tag=CC938ACBJ4BK type=write size=2680766 2024-02-23T06:34:22.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.133+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=LZ4GKL6XEZTL type=del size=2100219 2024-02-23T06:34:22.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.134+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~XR8Z9Z73OKOE.0 size=1048576 2024-02-23T06:34:22.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.135+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~XR8Z9Z73OKOE.1 size=1048576 2024-02-23T06:34:22.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.136+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~XR8Z9Z73OKOE.2 size=318649 2024-02-23T06:34:22.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.138+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=XR8Z9Z73OKOE tag=XBM4E1VBV5QX type=write size=3464377 2024-02-23T06:34:22.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.140+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~BYRKMHB757FP.0 size=150472 2024-02-23T06:34:22.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.140+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=BYRKMHB757FP tag=QEMPBIPX6EGT type=write size=1199048 2024-02-23T06:34:22.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.142+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=HC1165N540BG type=del 2024-02-23T06:34:22.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.143+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=B85WQIBN0SUC type=write size=334803 2024-02-23T06:34:22.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.144+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~ZKTO05X2B1J3.0 size=1048576 2024-02-23T06:34:22.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.144+0000 7f5e72834780 1 < canceled part key=_multipart_IDTA5RV6IUF6.2~ZKTO05X2B1J3.1 size=233786 2024-02-23T06:34:22.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.146+0000 7f5e72834780 1 < canceled multipart upload key=IDTA5RV6IUF6 upload=ZKTO05X2B1J3 tag=T717L2IE61VR type=write size=2330938 2024-02-23T06:34:22.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.147+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=TDS4UOIAWC1N type=del size=1246772 2024-02-23T06:34:22.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.149+0000 7f5e72834780 1 < suggested update operation key=R4YA9DUAJABL tag=VYKALBWLUY6J type=write size=285383 2024-02-23T06:34:22.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.150+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=CWLTM5GLH9BY type=del size=3337341 2024-02-23T06:34:22.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.152+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~NI8U5ICEHYBN.0 size=1048576 2024-02-23T06:34:22.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.152+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~NI8U5ICEHYBN.1 size=936211 2024-02-23T06:34:22.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.153+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=NI8U5ICEHYBN tag=TTZ9U4S3XZM1 type=write size=3033363 2024-02-23T06:34:22.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.155+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=O9UV29SVCGEI type=del size=4078270 2024-02-23T06:34:22.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.157+0000 7f5e72834780 1 < suggested update operation key=N8RXOY8X71MO tag=ZFOR93RV6EOJ type=del size=3904596 2024-02-23T06:34:22.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.158+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=E37A2RZ9JB9R type=del size=2546660 2024-02-23T06:34:22.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.159+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=SE0JNBTQRH7O type=del 2024-02-23T06:34:22.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.160+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=1WJ7VG9TS12J type=del size=1275574 2024-02-23T06:34:22.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.161+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~F90K7OCBMW7A.0 size=1048576 2024-02-23T06:34:22.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.162+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~F90K7OCBMW7A.1 size=1048576 2024-02-23T06:34:22.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.163+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~F90K7OCBMW7A.2 size=714707 2024-02-23T06:34:22.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.165+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=F90K7OCBMW7A tag=UPTJR4JR9NMS type=write size=3860435 2024-02-23T06:34:22.168 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.167+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=PYCSZQ3BH24A type=del size=2371002 2024-02-23T06:34:22.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.168+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~Y3G95E9939KD.0 size=1048576 2024-02-23T06:34:22.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.169+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~Y3G95E9939KD.1 size=1048576 2024-02-23T06:34:22.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.170+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~Y3G95E9939KD.2 size=558433 2024-02-23T06:34:22.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.172+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=Y3G95E9939KD tag=UXLJODE86UBG type=write size=3704161 2024-02-23T06:34:22.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.174+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~VC13RXQFKWOM.0 size=1048576 2024-02-23T06:34:22.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.175+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~VC13RXQFKWOM.1 size=1035885 2024-02-23T06:34:22.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.175+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=VC13RXQFKWOM tag=P3Q87LDL7K89 type=write size=3133037 2024-02-23T06:34:22.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.177+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~WIQE88XR5Z1Z.0 size=56957 2024-02-23T06:34:22.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.180+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=WIQE88XR5Z1Z tag=NB0FM64S5VEI type=write size=1105533 2024-02-23T06:34:22.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.182+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~M0VS7RCMLTT7.0 size=35813 2024-02-23T06:34:22.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.182+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=M0VS7RCMLTT7 tag=N1MNEETHV7NA type=write size=1084389 2024-02-23T06:34:22.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.183+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~4ACSBSKLVEYI.0 size=1048576 2024-02-23T06:34:22.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.184+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~4ACSBSKLVEYI.1 size=813876 2024-02-23T06:34:22.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.186+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=4ACSBSKLVEYI tag=FXN0PXCBKNQ6 type=write size=2911028 2024-02-23T06:34:22.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.187+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=QEZDIYSA0HEN type=del size=3328581 2024-02-23T06:34:22.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.189+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~1VCICACEZ4Q3.0 size=1029776 2024-02-23T06:34:22.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.190+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=1VCICACEZ4Q3 tag=OINBB5N4YS5Y type=write size=2078352 2024-02-23T06:34:22.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.192+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~N1QULRI09P37.0 size=1048576 2024-02-23T06:34:22.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.193+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~N1QULRI09P37.1 size=839048 2024-02-23T06:34:22.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.193+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=N1QULRI09P37 tag=6692W5CMANLG type=write size=2936200 2024-02-23T06:34:22.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.194+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=0VU2YPR41ZZD type=del 2024-02-23T06:34:22.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.196+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~JCWYO4C94UW6.0 size=1048576 2024-02-23T06:34:22.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.197+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~JCWYO4C94UW6.1 size=928286 2024-02-23T06:34:22.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.197+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=JCWYO4C94UW6 tag=1VU459AXER17 type=write size=3025438 2024-02-23T06:34:22.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.198+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~FO1S19FTFHRY.0 size=31896 2024-02-23T06:34:22.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.200+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=FO1S19FTFHRY tag=0RMAV4TXHOF0 type=write size=1080472 2024-02-23T06:34:22.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.201+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=7IJLTJ7EPKHC type=del size=3416875 2024-02-23T06:34:22.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.202+0000 7f5e72834780 1 < canceled part key=_multipart_WETP4ONTU3HL.2~UEBULLIIRXNN.0 size=1048576 2024-02-23T06:34:22.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.203+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~UEBULLIIRXNN.1 size=79655 2024-02-23T06:34:22.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.205+0000 7f5e72834780 1 < canceled multipart upload key=WETP4ONTU3HL upload=UEBULLIIRXNN tag=3JEVIQ0CXBFF type=write size=2176807 2024-02-23T06:34:22.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.206+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=T3REAXD5OIOW type=del size=823606 2024-02-23T06:34:22.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.207+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=LZ4GKL6XEZTL type=del 2024-02-23T06:34:22.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.209+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~QPVOFYMMZOKS.0 size=1048576 2024-02-23T06:34:22.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.210+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~QPVOFYMMZOKS.1 size=1048576 2024-02-23T06:34:22.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.210+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~QPVOFYMMZOKS.2 size=912047 2024-02-23T06:34:22.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.210+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=QPVOFYMMZOKS tag=MAFPSNYQBII7 type=write size=4057775 2024-02-23T06:34:22.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.212+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~BYRKMHB757FP.0 size=150472 2024-02-23T06:34:22.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.214+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=BYRKMHB757FP tag=QEMPBIPX6EGT type=write size=1199048 2024-02-23T06:34:22.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.216+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~MBN0PB481XT1.0 size=1048576 2024-02-23T06:34:22.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.217+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~MBN0PB481XT1.1 size=1029257 2024-02-23T06:34:22.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.217+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=MBN0PB481XT1 tag=XOEEPOVFEYDH type=write size=3126409 2024-02-23T06:34:22.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.218+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=B85WQIBN0SUC type=write size=334803 2024-02-23T06:34:22.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.220+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~04O1AB88T5ZC.0 size=1048576 2024-02-23T06:34:22.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.221+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~04O1AB88T5ZC.1 size=1048576 2024-02-23T06:34:22.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.221+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~04O1AB88T5ZC.2 size=858223 2024-02-23T06:34:22.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.222+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=04O1AB88T5ZC tag=Q143SSV1WG0G type=write size=4003951 2024-02-23T06:34:22.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.223+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=TDS4UOIAWC1N type=del 2024-02-23T06:34:22.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.224+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=P9ET3LN38N0Z type=del size=3616622 2024-02-23T06:34:22.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.225+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=CWLTM5GLH9BY type=del 2024-02-23T06:34:22.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.227+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~2YYVGDM032ZC.0 size=449954 2024-02-23T06:34:22.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.227+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=2YYVGDM032ZC tag=0VFP80LAHKT3 type=write size=1498530 2024-02-23T06:34:22.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.228+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=O9UV29SVCGEI type=del size=4078270 2024-02-23T06:34:22.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.230+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~2GB00O7O51HX.0 size=1048576 2024-02-23T06:34:22.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.231+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~2GB00O7O51HX.1 size=319833 2024-02-23T06:34:22.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.231+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=2GB00O7O51HX tag=92C62EJ16PAL type=write size=2416985 2024-02-23T06:34:22.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.233+0000 7f5e72834780 1 < suggested update operation key=GWTK3YV0RY21 tag=E37A2RZ9JB9R type=del size=2546660 2024-02-23T06:34:22.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.235+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=CC1ORBQTB3G3 type=del size=2214075 2024-02-23T06:34:22.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.236+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=1WJ7VG9TS12J type=del 2024-02-23T06:34:22.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.238+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~K7W20XCTO153.0 size=1048576 2024-02-23T06:34:22.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.239+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~K7W20XCTO153.1 size=290179 2024-02-23T06:34:22.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.239+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=K7W20XCTO153 tag=LWDHTU7GG2QZ type=write size=2387331 2024-02-23T06:34:22.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.240+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=PYCSZQ3BH24A type=del 2024-02-23T06:34:22.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.241+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=NQJHFFCIXVSP type=del size=3770509 2024-02-23T06:34:22.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.242+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~VC13RXQFKWOM.0 size=1048576 2024-02-23T06:34:22.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.245+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~VC13RXQFKWOM.1 size=1035885 2024-02-23T06:34:22.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.247+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=VC13RXQFKWOM tag=P3Q87LDL7K89 type=write size=3133037 2024-02-23T06:34:22.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.248+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=DENRQ6AIMPWH type=del size=1114183 2024-02-23T06:34:22.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.249+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~M0VS7RCMLTT7.0 size=35813 2024-02-23T06:34:22.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.251+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=M0VS7RCMLTT7 tag=N1MNEETHV7NA type=write size=1084389 2024-02-23T06:34:22.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.252+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=A1UFXRIUVSID type=del size=3565534 2024-02-23T06:34:22.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.253+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=QEZDIYSA0HEN type=del 2024-02-23T06:34:22.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.254+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=4E3GGR36HX2Y type=write size=494332 2024-02-23T06:34:22.256 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.255+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~N1QULRI09P37.0 size=1048576 2024-02-23T06:34:22.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.256+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~N1QULRI09P37.1 size=839048 2024-02-23T06:34:22.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.258+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=N1QULRI09P37 tag=6692W5CMANLG type=write size=2936200 2024-02-23T06:34:22.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.259+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=HP4YGI0G0MQ9 type=del size=1759510 2024-02-23T06:34:22.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.260+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~JCWYO4C94UW6.0 size=1048576 2024-02-23T06:34:22.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.261+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~JCWYO4C94UW6.1 size=928286 2024-02-23T06:34:22.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.263+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=JCWYO4C94UW6 tag=1VU459AXER17 type=write size=3025438 2024-02-23T06:34:22.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.265+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~VDPQR8XJYVNU.0 size=1048576 2024-02-23T06:34:22.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.266+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~VDPQR8XJYVNU.1 size=1047314 2024-02-23T06:34:22.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.266+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=VDPQR8XJYVNU tag=ONQGI453ACQM type=write size=3144466 2024-02-23T06:34:22.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.267+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=7IJLTJ7EPKHC type=del 2024-02-23T06:34:22.269 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.268+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=W61HS42N9QEQ type=write size=692809 2024-02-23T06:34:22.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.269+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=T3REAXD5OIOW type=del 2024-02-23T06:34:22.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.271+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~VRDB2GCNARLB.0 size=1048576 2024-02-23T06:34:22.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.272+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~VRDB2GCNARLB.1 size=271006 2024-02-23T06:34:22.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.272+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=VRDB2GCNARLB tag=7DAJ22OIGNBN type=write size=2368158 2024-02-23T06:34:22.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.273+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~QPVOFYMMZOKS.0 size=1048576 2024-02-23T06:34:22.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.274+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~QPVOFYMMZOKS.1 size=1048576 2024-02-23T06:34:22.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.275+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~QPVOFYMMZOKS.2 size=912047 2024-02-23T06:34:22.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.277+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=QPVOFYMMZOKS tag=MAFPSNYQBII7 type=write size=4057775 2024-02-23T06:34:22.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.278+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=CSBFJLR1HEQC type=del size=547457 2024-02-23T06:34:22.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.279+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~MBN0PB481XT1.0 size=1048576 2024-02-23T06:34:22.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.280+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~MBN0PB481XT1.1 size=1029257 2024-02-23T06:34:22.284 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.283+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=MBN0PB481XT1 tag=XOEEPOVFEYDH type=write size=3126409 2024-02-23T06:34:22.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.285+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~F57QHK33KNCV.0 size=1048576 2024-02-23T06:34:22.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.286+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~F57QHK33KNCV.1 size=972750 2024-02-23T06:34:22.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.286+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=F57QHK33KNCV tag=TCZ6N637N1KX type=write size=3069902 2024-02-23T06:34:22.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.287+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~04O1AB88T5ZC.0 size=1048576 2024-02-23T06:34:22.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.289+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~04O1AB88T5ZC.1 size=1048576 2024-02-23T06:34:22.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.289+0000 7f5e72834780 1 < canceled part key=_multipart_N8RXOY8X71MO.2~04O1AB88T5ZC.2 size=858223 2024-02-23T06:34:22.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.290+0000 7f5e72834780 1 < canceled multipart upload key=N8RXOY8X71MO upload=04O1AB88T5ZC tag=Q143SSV1WG0G type=write size=4003951 2024-02-23T06:34:22.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.292+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=8JDY4BAGC1BX type=del size=1434213 2024-02-23T06:34:22.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.293+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=P9ET3LN38N0Z type=del 2024-02-23T06:34:22.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.295+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~MD8FU6RX008L.0 size=1048576 2024-02-23T06:34:22.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.296+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~MD8FU6RX008L.1 size=1048576 2024-02-23T06:34:22.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.297+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~MD8FU6RX008L.2 size=207804 2024-02-23T06:34:22.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.297+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=MD8FU6RX008L tag=N8QPI0OH2UEU type=write size=3353532 2024-02-23T06:34:22.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.298+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~2YYVGDM032ZC.0 size=449954 2024-02-23T06:34:22.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.300+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=2YYVGDM032ZC tag=0VFP80LAHKT3 type=write size=1498530 2024-02-23T06:34:22.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.302+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~3PB6CNMWKJ97.0 size=721169 2024-02-23T06:34:22.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.302+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=3PB6CNMWKJ97 tag=QU6B8TUU3FN0 type=write size=1769745 2024-02-23T06:34:22.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.303+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~2GB00O7O51HX.0 size=1048576 2024-02-23T06:34:22.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.304+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~2GB00O7O51HX.1 size=319833 2024-02-23T06:34:22.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.308+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=2GB00O7O51HX tag=92C62EJ16PAL type=write size=2416985 2024-02-23T06:34:22.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.309+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=S6CXBVHJ9TOI type=del size=1502160 2024-02-23T06:34:22.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.311+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=CC1ORBQTB3G3 type=del 2024-02-23T06:34:22.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.312+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=UG0NLSRVT3MP type=del size=1322160 2024-02-23T06:34:22.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.313+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~K7W20XCTO153.0 size=1048576 2024-02-23T06:34:22.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.314+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~K7W20XCTO153.1 size=290179 2024-02-23T06:34:22.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.316+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=K7W20XCTO153 tag=LWDHTU7GG2QZ type=write size=2387331 2024-02-23T06:34:22.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.317+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=PGP4YGQFK6JM type=del size=2701054 2024-02-23T06:34:22.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.319+0000 7f5e72834780 1 < suggested remove operation key=N8RXOY8X71MO tag=NQJHFFCIXVSP type=del 2024-02-23T06:34:22.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.320+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=V90OASS947BG type=del size=3655598 2024-02-23T06:34:22.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.322+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=DENRQ6AIMPWH type=del 2024-02-23T06:34:22.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.323+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=LR4FSGQAVS2K type=del size=2480270 2024-02-23T06:34:22.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.325+0000 7f5e72834780 1 < suggested remove operation key=TNH85ZWPALJN tag=A1UFXRIUVSID type=del 2024-02-23T06:34:22.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.326+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=ZJDYYCEETJBD type=del size=3188149 2024-02-23T06:34:22.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.329+0000 7f5e72834780 1 < suggested remove operation key=M5LH10WTDP0P tag=4E3GGR36HX2Y type=write 2024-02-23T06:34:22.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.331+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NSKE1XMXIROF.0 size=1048576 2024-02-23T06:34:22.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.332+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NSKE1XMXIROF.1 size=1010669 2024-02-23T06:34:22.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.332+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=NSKE1XMXIROF tag=N7VI0531MQBA type=write size=3107821 2024-02-23T06:34:22.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.333+0000 7f5e72834780 1 < canceled operation key=TPADM4812N0Z tag=HP4YGI0G0MQ9 type=del size=1759510 2024-02-23T06:34:22.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.335+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~XDEDV53Y6KQV.0 size=1048576 2024-02-23T06:34:22.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.336+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~XDEDV53Y6KQV.1 size=1048576 2024-02-23T06:34:22.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.337+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~XDEDV53Y6KQV.2 size=67144 2024-02-23T06:34:22.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.337+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=XDEDV53Y6KQV tag=G3FMDFQH6JT7 type=write size=3212872 2024-02-23T06:34:22.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.338+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~VDPQR8XJYVNU.0 size=1048576 2024-02-23T06:34:22.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.339+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~VDPQR8XJYVNU.1 size=1047314 2024-02-23T06:34:22.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.341+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=VDPQR8XJYVNU tag=ONQGI453ACQM type=write size=3144466 2024-02-23T06:34:22.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.342+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=JNXH7VZLPL2R type=del size=2311497 2024-02-23T06:34:22.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.343+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=W61HS42N9QEQ type=write size=692809 2024-02-23T06:34:22.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.345+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~VHRQ6DYXQ5QX.0 size=855287 2024-02-23T06:34:22.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.345+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=VHRQ6DYXQ5QX tag=LGDIRGH31FFT type=write size=1903863 2024-02-23T06:34:22.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.345+0000 7f5e72834780 1 < canceled part key=_multipart_QZLNM2RQ9SDC.2~VRDB2GCNARLB.0 size=1048576 2024-02-23T06:34:22.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.346+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~VRDB2GCNARLB.1 size=271006 2024-02-23T06:34:22.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.349+0000 7f5e72834780 1 < canceled multipart upload key=QZLNM2RQ9SDC upload=VRDB2GCNARLB tag=7DAJ22OIGNBN type=write size=2368158 2024-02-23T06:34:22.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.351+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~SMV6E4RRK0DX.0 size=272024 2024-02-23T06:34:22.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.351+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=SMV6E4RRK0DX tag=3OO531F9YK8C type=write size=1320600 2024-02-23T06:34:22.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.352+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=CSBFJLR1HEQC type=del 2024-02-23T06:34:22.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.353+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=UQRQ1ZLEEGKI type=del size=2536555 2024-02-23T06:34:22.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.355+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~F57QHK33KNCV.0 size=1048576 2024-02-23T06:34:22.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.355+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~F57QHK33KNCV.1 size=972750 2024-02-23T06:34:22.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.357+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=F57QHK33KNCV tag=TCZ6N637N1KX type=write size=3069902 2024-02-23T06:34:22.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.358+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=XECCHKIHI6QW type=write size=596121 2024-02-23T06:34:22.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.360+0000 7f5e72834780 1 < canceled operation key=VER8U5YMTPS6 tag=8JDY4BAGC1BX type=del size=1434213 2024-02-23T06:34:22.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.361+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=0PU26A8T6UYM type=del size=3369101 2024-02-23T06:34:22.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.362+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~MD8FU6RX008L.0 size=1048576 2024-02-23T06:34:22.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.363+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~MD8FU6RX008L.1 size=1048576 2024-02-23T06:34:22.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.364+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~MD8FU6RX008L.2 size=207804 2024-02-23T06:34:22.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.366+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=MD8FU6RX008L tag=N8QPI0OH2UEU type=write size=3353532 2024-02-23T06:34:22.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.367+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=GASG1CB0KZ7A type=del size=792040 2024-02-23T06:34:22.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.368+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~3PB6CNMWKJ97.0 size=721169 2024-02-23T06:34:22.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.370+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=3PB6CNMWKJ97 tag=QU6B8TUU3FN0 type=write size=1769745 2024-02-23T06:34:22.373 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.372+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~CXO1Q1BLO6NC.0 size=1048576 2024-02-23T06:34:22.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.373+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~CXO1Q1BLO6NC.1 size=1048576 2024-02-23T06:34:22.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.374+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~CXO1Q1BLO6NC.2 size=390416 2024-02-23T06:34:22.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.374+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=CXO1Q1BLO6NC tag=9U4416BE8HQV type=write size=3536144 2024-02-23T06:34:22.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.375+0000 7f5e72834780 -1 < failed to complete operation key=N8RXOY8X71MO tag=S6CXBVHJ9TOI type=del size=1502160: (22) Invalid argument 2024-02-23T06:34:22.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.376+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=01IAAK6PXPLF type=write size=30379 2024-02-23T06:34:22.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.377+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=UG0NLSRVT3MP type=del 2024-02-23T06:34:22.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.378+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=83PRNT38D9Y1 type=write size=438289 2024-02-23T06:34:22.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.379+0000 7f5e72834780 -1 < failed to complete operation key=M5LH10WTDP0P tag=PGP4YGQFK6JM type=del size=2701054: (22) Invalid argument 2024-02-23T06:34:22.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.380+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=VP6BUFN8FQ6D type=write size=413913 2024-02-23T06:34:22.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.382+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=V90OASS947BG type=del 2024-02-23T06:34:22.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.383+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=VBB1FGOVFB3Y type=del size=3645730 2024-02-23T06:34:22.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.385+0000 7f5e72834780 1 < suggested remove operation key=8Q6WC7B9BY5Q tag=LR4FSGQAVS2K type=del 2024-02-23T06:34:22.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.386+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=PPDA2A1J79ZE type=del size=337911 2024-02-23T06:34:22.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.387+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=ZJDYYCEETJBD type=del 2024-02-23T06:34:22.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.390+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=YNEJ46U9EX7L type=del size=2151655 2024-02-23T06:34:22.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.390+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~NSKE1XMXIROF.0 size=1048576 2024-02-23T06:34:22.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.391+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NSKE1XMXIROF.1 size=1010669 2024-02-23T06:34:22.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.394+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=NSKE1XMXIROF tag=N7VI0531MQBA type=write size=3107821 2024-02-23T06:34:22.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.397+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~VHVMXT0YO8E0.0 size=1048576 2024-02-23T06:34:22.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.398+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~VHVMXT0YO8E0.1 size=1048576 2024-02-23T06:34:22.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.399+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~VHVMXT0YO8E0.2 size=861115 2024-02-23T06:34:22.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.399+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=VHVMXT0YO8E0 tag=LQ4JWUJNI02L type=write size=4006843 2024-02-23T06:34:22.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.400+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~XDEDV53Y6KQV.0 size=1048576 2024-02-23T06:34:22.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.401+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~XDEDV53Y6KQV.1 size=1048576 2024-02-23T06:34:22.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.402+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~XDEDV53Y6KQV.2 size=67144 2024-02-23T06:34:22.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.404+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=XDEDV53Y6KQV tag=G3FMDFQH6JT7 type=write size=3212872 2024-02-23T06:34:22.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.405+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=HL3V577YBBS8 type=write size=502159 2024-02-23T06:34:22.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.407+0000 7f5e72834780 1 < suggested remove operation key=4M7BT05YB0C3 tag=JNXH7VZLPL2R type=del 2024-02-23T06:34:22.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.409+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=10U81H46SNYX type=del size=1756364 2024-02-23T06:34:22.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.410+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~VHRQ6DYXQ5QX.0 size=855287 2024-02-23T06:34:22.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.412+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=VHRQ6DYXQ5QX tag=LGDIRGH31FFT type=write size=1903863 2024-02-23T06:34:22.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.414+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~YEJ5YVIV811V.0 size=313906 2024-02-23T06:34:22.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.414+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=YEJ5YVIV811V tag=RQTEQ2IVDDAE type=write size=1362482 2024-02-23T06:34:22.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.415+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~SMV6E4RRK0DX.0 size=272024 2024-02-23T06:34:22.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.417+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=SMV6E4RRK0DX tag=3OO531F9YK8C type=write size=1320600 2024-02-23T06:34:22.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.418+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=G1716718Z83P type=write size=904103 2024-02-23T06:34:22.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.419+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=UQRQ1ZLEEGKI type=del 2024-02-23T06:34:22.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.421+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~5RYOARU1KKW6.0 size=1048576 2024-02-23T06:34:22.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.422+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~5RYOARU1KKW6.1 size=1048576 2024-02-23T06:34:22.424 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.423+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~5RYOARU1KKW6.2 size=881757 2024-02-23T06:34:22.424 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.423+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=5RYOARU1KKW6 tag=WOM1YM8PHJOD type=write size=4027485 2024-02-23T06:34:22.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.424+0000 7f5e72834780 1 < canceled operation key=WETP4ONTU3HL tag=XECCHKIHI6QW type=write size=596121 2024-02-23T06:34:22.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.425+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=Y0SB4V477KHN type=del size=4115173 2024-02-23T06:34:22.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.426+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=0PU26A8T6UYM type=del 2024-02-23T06:34:22.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.428+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~1PPK2H7EOAJJ.0 size=1048576 2024-02-23T06:34:22.430 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.429+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~1PPK2H7EOAJJ.1 size=1048576 2024-02-23T06:34:22.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.430+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~1PPK2H7EOAJJ.2 size=1001329 2024-02-23T06:34:22.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.430+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=1PPK2H7EOAJJ tag=U78L1E0LOGJ7 type=write size=4147057 2024-02-23T06:34:22.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.432+0000 7f5e72834780 1 < suggested remove operation key=QGGULCYZ0ZSA tag=GASG1CB0KZ7A type=del 2024-02-23T06:34:22.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.435+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~EQ7M109D09ER.0 size=1048576 2024-02-23T06:34:22.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.436+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~EQ7M109D09ER.1 size=1048576 2024-02-23T06:34:22.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.437+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~EQ7M109D09ER.2 size=450526 2024-02-23T06:34:22.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.437+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=EQ7M109D09ER tag=B7J7G1YEC00S type=write size=3596254 2024-02-23T06:34:22.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.438+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~CXO1Q1BLO6NC.0 size=1048576 2024-02-23T06:34:22.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.439+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~CXO1Q1BLO6NC.1 size=1048576 2024-02-23T06:34:22.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.440+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~CXO1Q1BLO6NC.2 size=390416 2024-02-23T06:34:22.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.442+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=CXO1Q1BLO6NC tag=9U4416BE8HQV type=write size=3536144 2024-02-23T06:34:22.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.443+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=I8SBX5F8DYRZ type=del size=69777 2024-02-23T06:34:22.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.444+0000 7f5e72834780 1 < canceled operation key=JV6FJONY04AW tag=01IAAK6PXPLF type=write size=30379 2024-02-23T06:34:22.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.446+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~UZJ1SSVMGZ6B.0 size=1048576 2024-02-23T06:34:22.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.447+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~UZJ1SSVMGZ6B.1 size=1048576 2024-02-23T06:34:22.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.448+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~UZJ1SSVMGZ6B.2 size=640378 2024-02-23T06:34:22.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.448+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=UZJ1SSVMGZ6B tag=ME8GL3KVEHRY type=write size=3786106 2024-02-23T06:34:22.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.450+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=83PRNT38D9Y1 type=write size=438289 2024-02-23T06:34:22.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.451+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=XT551E1O08HP type=del size=3720724 2024-02-23T06:34:22.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.453+0000 7f5e72834780 1 < suggested update operation key=TNH85ZWPALJN tag=VP6BUFN8FQ6D type=write size=413913 2024-02-23T06:34:22.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.455+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=FGUZYI41QTAT type=del size=4171134 2024-02-23T06:34:22.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.456+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=VBB1FGOVFB3Y type=del 2024-02-23T06:34:22.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.457+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=264TVM73W6P2 type=del size=413788 2024-02-23T06:34:22.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.458+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=PPDA2A1J79ZE type=del 2024-02-23T06:34:22.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.459+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=0S61WHJG9RNR type=del size=4022981 2024-02-23T06:34:22.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.460+0000 7f5e72834780 -1 < failed to complete operation key=QGGULCYZ0ZSA tag=YNEJ46U9EX7L type=del size=2151655: (22) Invalid argument 2024-02-23T06:34:22.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.462+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~S0JRIASRFKS2.0 size=941043 2024-02-23T06:34:22.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.462+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=S0JRIASRFKS2 tag=YHGSQXET0NTG type=write size=1989619 2024-02-23T06:34:22.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.463+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~VHVMXT0YO8E0.0 size=1048576 2024-02-23T06:34:22.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.464+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~VHVMXT0YO8E0.1 size=1048576 2024-02-23T06:34:22.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.465+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~VHVMXT0YO8E0.2 size=861115 2024-02-23T06:34:22.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.467+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=VHVMXT0YO8E0 tag=LQ4JWUJNI02L type=write size=4006843 2024-02-23T06:34:22.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.469+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~5HT0E4EUIY77.0 size=1048576 2024-02-23T06:34:22.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.470+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~5HT0E4EUIY77.1 size=1048576 2024-02-23T06:34:22.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.471+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~5HT0E4EUIY77.2 size=30350 2024-02-23T06:34:22.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.471+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=5HT0E4EUIY77 tag=52YW50VL3T4O type=write size=3176078 2024-02-23T06:34:22.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.472+0000 7f5e72834780 1 < canceled operation key=9AQCXLBZW3EV tag=HL3V577YBBS8 type=write size=502159 2024-02-23T06:34:22.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.476+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~K0361AVGVD4J.0 size=1048576 2024-02-23T06:34:22.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.476+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~K0361AVGVD4J.1 size=36283 2024-02-23T06:34:22.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.476+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=K0361AVGVD4J tag=WQ7NCSLUU8VD type=write size=2133435 2024-02-23T06:34:22.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.479+0000 7f5e72834780 1 < suggested update operation key=TNH85ZWPALJN tag=10U81H46SNYX type=del size=1756364 2024-02-23T06:34:22.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.480+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=HDK39IQNQ3AC type=del size=613828 2024-02-23T06:34:22.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.481+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~YEJ5YVIV811V.0 size=313906 2024-02-23T06:34:22.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.483+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=YEJ5YVIV811V tag=RQTEQ2IVDDAE type=write size=1362482 2024-02-23T06:34:22.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.484+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=I0UAJJ5PJ9IO type=del size=2977924 2024-02-23T06:34:22.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.485+0000 7f5e72834780 1 < completed write operation key=0WLEPDK2O30W tag=G1716718Z83P type=write size=904103 2024-02-23T06:34:22.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.486+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=8T4VITUN7AK5 type=write size=328122 2024-02-23T06:34:22.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.488+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~5RYOARU1KKW6.0 size=1048576 2024-02-23T06:34:22.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.489+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~5RYOARU1KKW6.1 size=1048576 2024-02-23T06:34:22.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.490+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~5RYOARU1KKW6.2 size=881757 2024-02-23T06:34:22.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.492+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=5RYOARU1KKW6 tag=WOM1YM8PHJOD type=write size=4027485 2024-02-23T06:34:22.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.493+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=WLOKYU8MK63G type=del size=3927025 2024-02-23T06:34:22.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.495+0000 7f5e72834780 1 < suggested remove operation key=WETP4ONTU3HL tag=Y0SB4V477KHN type=del 2024-02-23T06:34:22.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.498+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~7R1AXWDQTJLK.0 size=1048576 2024-02-23T06:34:22.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.498+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~7R1AXWDQTJLK.1 size=292552 2024-02-23T06:34:22.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.498+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=7R1AXWDQTJLK tag=XHS163Q3874N type=write size=2389704 2024-02-23T06:34:22.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.499+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~1PPK2H7EOAJJ.0 size=1048576 2024-02-23T06:34:22.501 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.500+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~1PPK2H7EOAJJ.1 size=1048576 2024-02-23T06:34:22.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.501+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~1PPK2H7EOAJJ.2 size=1001329 2024-02-23T06:34:22.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.503+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=1PPK2H7EOAJJ tag=U78L1E0LOGJ7 type=write size=4147057 2024-02-23T06:34:22.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.506+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~YSTCX6VXHC6R.0 size=1048576 2024-02-23T06:34:22.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.507+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~YSTCX6VXHC6R.1 size=1048576 2024-02-23T06:34:22.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.508+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~YSTCX6VXHC6R.2 size=686476 2024-02-23T06:34:22.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.508+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=YSTCX6VXHC6R tag=T4KA9M1N28EL type=write size=3832204 2024-02-23T06:34:22.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.508+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~EQ7M109D09ER.0 size=1048576 2024-02-23T06:34:22.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.509+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~EQ7M109D09ER.1 size=1048576 2024-02-23T06:34:22.511 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.510+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~EQ7M109D09ER.2 size=450526 2024-02-23T06:34:22.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.512+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=EQ7M109D09ER tag=B7J7G1YEC00S type=write size=3596254 2024-02-23T06:34:22.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.515+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~D90IR5RRSY4A.0 size=1048576 2024-02-23T06:34:22.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.516+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~D90IR5RRSY4A.1 size=602140 2024-02-23T06:34:22.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.516+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=D90IR5RRSY4A tag=F3IR1WCDFGFK type=write size=2699292 2024-02-23T06:34:22.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.518+0000 7f5e72834780 1 < suggested remove operation key=0WLEPDK2O30W tag=I8SBX5F8DYRZ type=del 2024-02-23T06:34:22.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.519+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=K7DA4077VEXV type=del size=4035578 2024-02-23T06:34:22.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.521+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~UZJ1SSVMGZ6B.0 size=1048576 2024-02-23T06:34:22.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.522+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~UZJ1SSVMGZ6B.1 size=1048576 2024-02-23T06:34:22.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.522+0000 7f5e72834780 1 < canceled part key=_multipart_9ZCNDGBEPWMN.2~UZJ1SSVMGZ6B.2 size=640378 2024-02-23T06:34:22.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.524+0000 7f5e72834780 1 < canceled multipart upload key=9ZCNDGBEPWMN upload=UZJ1SSVMGZ6B tag=ME8GL3KVEHRY type=write size=3786106 2024-02-23T06:34:22.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.526+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~8WVJJZ9182CL.0 size=526080 2024-02-23T06:34:22.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.526+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=8WVJJZ9182CL tag=CSVFHZ1ZPCJZ type=write size=1574656 2024-02-23T06:34:22.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.527+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=XT551E1O08HP type=del 2024-02-23T06:34:22.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.528+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=T5ACJACN5LVZ type=del size=4049491 2024-02-23T06:34:22.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.530+0000 7f5e72834780 1 < canceled operation key=9AQCXLBZW3EV tag=FGUZYI41QTAT type=del size=4171134 2024-02-23T06:34:22.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.532+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~XKN4YG43O9J5.0 size=1048576 2024-02-23T06:34:22.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.533+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~XKN4YG43O9J5.1 size=1048576 2024-02-23T06:34:22.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.534+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~XKN4YG43O9J5.2 size=260840 2024-02-23T06:34:22.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.534+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=XKN4YG43O9J5 tag=8F92J2Y3R36E type=write size=3406568 2024-02-23T06:34:22.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.535+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=264TVM73W6P2 type=del 2024-02-23T06:34:22.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.539+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RZX1RHIXWP11.0 size=1048576 2024-02-23T06:34:22.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.540+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RZX1RHIXWP11.1 size=1048576 2024-02-23T06:34:22.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.541+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RZX1RHIXWP11.2 size=870888 2024-02-23T06:34:22.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.541+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=RZX1RHIXWP11 tag=H4LI4DMNMBDH type=write size=4016616 2024-02-23T06:34:22.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.543+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=0S61WHJG9RNR type=del 2024-02-23T06:34:22.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.544+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=CE82233VQKAR type=del size=3583887 2024-02-23T06:34:22.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.545+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~S0JRIASRFKS2.0 size=941043 2024-02-23T06:34:22.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.547+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=S0JRIASRFKS2 tag=YHGSQXET0NTG type=write size=1989619 2024-02-23T06:34:22.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.548+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=8ZGM1PQODEB8 type=del size=2798817 2024-02-23T06:34:22.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.550+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~5HT0E4EUIY77.0 size=1048576 2024-02-23T06:34:22.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.551+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~5HT0E4EUIY77.1 size=1048576 2024-02-23T06:34:22.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.552+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~5HT0E4EUIY77.2 size=30350 2024-02-23T06:34:22.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.554+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=5HT0E4EUIY77 tag=52YW50VL3T4O type=write size=3176078 2024-02-23T06:34:22.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.556+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NJHUV1OBPI07.0 size=1048576 2024-02-23T06:34:22.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.557+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NJHUV1OBPI07.1 size=604867 2024-02-23T06:34:22.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.557+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=NJHUV1OBPI07 tag=GNMPX6QNPTRC type=write size=2702019 2024-02-23T06:34:22.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.559+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~K0361AVGVD4J.0 size=1048576 2024-02-23T06:34:22.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.560+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~K0361AVGVD4J.1 size=36283 2024-02-23T06:34:22.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.562+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=K0361AVGVD4J tag=WQ7NCSLUU8VD type=write size=2133435 2024-02-23T06:34:22.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.564+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~PNBM62XXLVU5.0 size=1048576 2024-02-23T06:34:22.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.565+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~PNBM62XXLVU5.1 size=514722 2024-02-23T06:34:22.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.565+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=PNBM62XXLVU5 tag=F3BVYC8TCUFL type=write size=2611874 2024-02-23T06:34:22.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.566+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=HDK39IQNQ3AC type=del 2024-02-23T06:34:22.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.567+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=SN8VFWIMFZPG type=write size=508537 2024-02-23T06:34:22.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.568+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=I0UAJJ5PJ9IO type=del 2024-02-23T06:34:22.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.570+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=RPC363O5QZ3P type=del size=2101789 2024-02-23T06:34:22.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.571+0000 7f5e72834780 -1 < failed to complete operation key=WETP4ONTU3HL tag=8T4VITUN7AK5 type=write size=328122: (22) Invalid argument 2024-02-23T06:34:22.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.572+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=4UNBBOFK9MQ9 type=del size=4162922 2024-02-23T06:34:22.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.573+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=WLOKYU8MK63G type=del 2024-02-23T06:34:22.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.574+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=CM2KD6DUDBT1 type=del size=2025235 2024-02-23T06:34:22.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.575+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~7R1AXWDQTJLK.0 size=1048576 2024-02-23T06:34:22.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.575+0000 7f5e72834780 1 < canceled part key=_multipart_R3STDBS79MV0.2~7R1AXWDQTJLK.1 size=292552 2024-02-23T06:34:22.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.577+0000 7f5e72834780 1 < canceled multipart upload key=R3STDBS79MV0 upload=7R1AXWDQTJLK tag=XHS163Q3874N type=write size=2389704 2024-02-23T06:34:22.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.578+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=9L60033PQGAK type=del size=475369 2024-02-23T06:34:22.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.580+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~YSTCX6VXHC6R.0 size=1048576 2024-02-23T06:34:22.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.581+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~YSTCX6VXHC6R.1 size=1048576 2024-02-23T06:34:22.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.581+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~YSTCX6VXHC6R.2 size=686476 2024-02-23T06:34:22.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.584+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=YSTCX6VXHC6R tag=T4KA9M1N28EL type=write size=3832204 2024-02-23T06:34:22.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.585+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=76T36OYH5ES4 type=del size=890099 2024-02-23T06:34:22.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.586+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~D90IR5RRSY4A.0 size=1048576 2024-02-23T06:34:22.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.587+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~D90IR5RRSY4A.1 size=602140 2024-02-23T06:34:22.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.589+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=D90IR5RRSY4A tag=F3IR1WCDFGFK type=write size=2699292 2024-02-23T06:34:22.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.591+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~DNVTFVT53GPL.0 size=1048576 2024-02-23T06:34:22.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.591+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~DNVTFVT53GPL.1 size=555419 2024-02-23T06:34:22.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.591+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=DNVTFVT53GPL tag=XINF9MWXGX3N type=write size=2652571 2024-02-23T06:34:22.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.593+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=K7DA4077VEXV type=del 2024-02-23T06:34:22.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.594+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=VGLSUSKQ0T0X type=del size=1083491 2024-02-23T06:34:22.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.595+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~8WVJJZ9182CL.0 size=526080 2024-02-23T06:34:22.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.597+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=8WVJJZ9182CL tag=CSVFHZ1ZPCJZ type=write size=1574656 2024-02-23T06:34:22.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.599+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=BRF2WE80C6OH type=del size=1838103 2024-02-23T06:34:22.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.600+0000 7f5e72834780 1 < canceled operation key=4M7BT05YB0C3 tag=T5ACJACN5LVZ type=del size=4049491 2024-02-23T06:34:22.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.601+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=J79Q1OW12YIP type=del size=2365453 2024-02-23T06:34:22.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.601+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~XKN4YG43O9J5.0 size=1048576 2024-02-23T06:34:22.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.602+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~XKN4YG43O9J5.1 size=1048576 2024-02-23T06:34:22.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.603+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~XKN4YG43O9J5.2 size=260840 2024-02-23T06:34:22.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.605+0000 7f5e72834780 1 < canceled multipart upload key=ZC75CQ2789VE upload=XKN4YG43O9J5 tag=8F92J2Y3R36E type=write size=3406568 2024-02-23T06:34:22.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.607+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~2NEBZR06QBO2.0 size=609824 2024-02-23T06:34:22.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.607+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=2NEBZR06QBO2 tag=DEB05NL18FLR type=write size=1658400 2024-02-23T06:34:22.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.608+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RZX1RHIXWP11.0 size=1048576 2024-02-23T06:34:22.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.609+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RZX1RHIXWP11.1 size=1048576 2024-02-23T06:34:22.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.610+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RZX1RHIXWP11.2 size=870888 2024-02-23T06:34:22.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.612+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=RZX1RHIXWP11 tag=H4LI4DMNMBDH type=write size=4016616 2024-02-23T06:34:22.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.616+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~AX3I2EANSUGE.0 size=1048576 2024-02-23T06:34:22.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.617+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~AX3I2EANSUGE.1 size=1048576 2024-02-23T06:34:22.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.619+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~AX3I2EANSUGE.2 size=845648 2024-02-23T06:34:22.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.619+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=AX3I2EANSUGE tag=33TBT55BOH1F type=write size=3991376 2024-02-23T06:34:22.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.620+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=CE82233VQKAR type=del 2024-02-23T06:34:22.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.622+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~GACS4LWILJ6C.0 size=1048576 2024-02-23T06:34:22.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.623+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~GACS4LWILJ6C.1 size=1005554 2024-02-23T06:34:22.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.623+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=GACS4LWILJ6C tag=E1Q8ZO0V4X72 type=write size=3102706 2024-02-23T06:34:22.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.624+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=8ZGM1PQODEB8 type=del 2024-02-23T06:34:22.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.626+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~1AK62POKFQ7M.0 size=1048576 2024-02-23T06:34:22.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.627+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~1AK62POKFQ7M.1 size=73074 2024-02-23T06:34:22.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.627+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=1AK62POKFQ7M tag=P7H81BNDRXS5 type=write size=2170226 2024-02-23T06:34:22.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.628+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NJHUV1OBPI07.0 size=1048576 2024-02-23T06:34:22.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.629+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NJHUV1OBPI07.1 size=604867 2024-02-23T06:34:22.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.631+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=NJHUV1OBPI07 tag=GNMPX6QNPTRC type=write size=2702019 2024-02-23T06:34:22.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.632+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=Y71DN9L0J3C8 type=del size=3922136 2024-02-23T06:34:22.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.633+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~PNBM62XXLVU5.0 size=1048576 2024-02-23T06:34:22.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.634+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~PNBM62XXLVU5.1 size=514722 2024-02-23T06:34:22.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.636+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=PNBM62XXLVU5 tag=F3BVYC8TCUFL type=write size=2611874 2024-02-23T06:34:22.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.637+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=M42KJNCU8YPH type=del size=3982287 2024-02-23T06:34:22.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.639+0000 7f5e72834780 1 < suggested remove operation key=N8RXOY8X71MO tag=SN8VFWIMFZPG type=write 2024-02-23T06:34:22.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.640+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=W87JGL96W6K8 type=write size=48057 2024-02-23T06:34:22.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.642+0000 7f5e72834780 1 < suggested update operation key=26EE3EHDK8EM tag=RPC363O5QZ3P type=del size=2101789 2024-02-23T06:34:22.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.643+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=859G0B04NDR7 type=del size=2513528 2024-02-23T06:34:22.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.645+0000 7f5e72834780 1 < suggested remove operation key=JV6FJONY04AW tag=4UNBBOFK9MQ9 type=del 2024-02-23T06:34:22.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.647+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~XUKD6OKL7CR2.0 size=1048576 2024-02-23T06:34:22.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.648+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~XUKD6OKL7CR2.1 size=1048576 2024-02-23T06:34:22.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.649+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~XUKD6OKL7CR2.2 size=350617 2024-02-23T06:34:22.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.649+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=XUKD6OKL7CR2 tag=RQ2X0WMPUZ11 type=write size=3496345 2024-02-23T06:34:22.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.650+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=CM2KD6DUDBT1 type=del 2024-02-23T06:34:22.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.651+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=A9EO8ZKCV8RJ type=del size=1588300 2024-02-23T06:34:22.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.653+0000 7f5e72834780 1 < canceled operation key=M5LH10WTDP0P tag=9L60033PQGAK type=del size=475369 2024-02-23T06:34:22.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.655+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~IGCUWJR3HF1Y.0 size=1048576 2024-02-23T06:34:22.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.655+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~IGCUWJR3HF1Y.1 size=936397 2024-02-23T06:34:22.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.655+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=IGCUWJR3HF1Y tag=3CN48BWO16ZG type=write size=3033549 2024-02-23T06:34:22.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.657+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=76T36OYH5ES4 type=del 2024-02-23T06:34:22.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.659+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~EWGIKI2AJSNR.0 size=503756 2024-02-23T06:34:22.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.659+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=EWGIKI2AJSNR tag=ISXCQQ7SLYEI type=write size=1552332 2024-02-23T06:34:22.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.660+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~DNVTFVT53GPL.0 size=1048576 2024-02-23T06:34:22.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.661+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~DNVTFVT53GPL.1 size=555419 2024-02-23T06:34:22.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.663+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=DNVTFVT53GPL tag=XINF9MWXGX3N type=write size=2652571 2024-02-23T06:34:22.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.664+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=GMN84INOG0DB type=write size=744115 2024-02-23T06:34:22.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.665+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=VGLSUSKQ0T0X type=del 2024-02-23T06:34:22.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.666+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=TT7X039I5WG0 type=del size=1068092 2024-02-23T06:34:22.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.667+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=BRF2WE80C6OH type=del 2024-02-23T06:34:22.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.669+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=AFBXPFQJ1B4L type=del size=316953 2024-02-23T06:34:22.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.670+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=J79Q1OW12YIP type=del 2024-02-23T06:34:22.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.672+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~EUGHX019K87R.0 size=1048576 2024-02-23T06:34:22.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.673+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~EUGHX019K87R.1 size=1048576 2024-02-23T06:34:22.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.673+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~EUGHX019K87R.2 size=390512 2024-02-23T06:34:22.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.673+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=EUGHX019K87R tag=XB6QQKGAKXCC type=write size=3536240 2024-02-23T06:34:22.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.675+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~2NEBZR06QBO2.0 size=609824 2024-02-23T06:34:22.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.676+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=2NEBZR06QBO2 tag=DEB05NL18FLR type=write size=1658400 2024-02-23T06:34:22.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.678+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=D7A0SP3YU9CB type=write size=28369 2024-02-23T06:34:22.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.679+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~AX3I2EANSUGE.0 size=1048576 2024-02-23T06:34:22.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.680+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~AX3I2EANSUGE.1 size=1048576 2024-02-23T06:34:22.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.681+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~AX3I2EANSUGE.2 size=845648 2024-02-23T06:34:22.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.683+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=AX3I2EANSUGE tag=33TBT55BOH1F type=write size=3991376 2024-02-23T06:34:22.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.684+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=H768BP6KK7TJ type=write size=1046652 2024-02-23T06:34:22.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.685+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~GACS4LWILJ6C.0 size=1048576 2024-02-23T06:34:22.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.686+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~GACS4LWILJ6C.1 size=1005554 2024-02-23T06:34:22.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.688+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=GACS4LWILJ6C tag=E1Q8ZO0V4X72 type=write size=3102706 2024-02-23T06:34:22.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.689+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=7WL1H3CRNY9F type=del size=1147301 2024-02-23T06:34:22.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.690+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~1AK62POKFQ7M.0 size=1048576 2024-02-23T06:34:22.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.691+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~1AK62POKFQ7M.1 size=73074 2024-02-23T06:34:22.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.693+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=1AK62POKFQ7M tag=P7H81BNDRXS5 type=write size=2170226 2024-02-23T06:34:22.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.694+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=XFV73A4Z51BC type=write size=672624 2024-02-23T06:34:22.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.695+0000 7f5e72834780 1 < canceled operation key=9ZCNDGBEPWMN tag=Y71DN9L0J3C8 type=del size=3922136 2024-02-23T06:34:22.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.697+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~PG0B85JBVO5S.0 size=1048576 2024-02-23T06:34:22.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.698+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~PG0B85JBVO5S.1 size=1048576 2024-02-23T06:34:22.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.699+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~PG0B85JBVO5S.2 size=784102 2024-02-23T06:34:22.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.699+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=PG0B85JBVO5S tag=4GGCOTC8VD5R type=write size=3929830 2024-02-23T06:34:22.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.700+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=M42KJNCU8YPH type=del 2024-02-23T06:34:22.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.701+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=50JB3NP6NJCW type=del size=2676394 2024-02-23T06:34:22.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.703+0000 7f5e72834780 1 < completed write operation key=ZM1YKZOUFSCY tag=W87JGL96W6K8 type=write size=48057 2024-02-23T06:34:22.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.704+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=MKZG7UZPYHCB type=del size=3856937 2024-02-23T06:34:22.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.705+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=859G0B04NDR7 type=del 2024-02-23T06:34:22.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.707+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~5FQ7SJ1CMD8G.0 size=863610 2024-02-23T06:34:22.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.707+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=5FQ7SJ1CMD8G tag=2P2N5SJDYKV2 type=write size=1912186 2024-02-23T06:34:22.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.709+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~XUKD6OKL7CR2.0 size=1048576 2024-02-23T06:34:22.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.710+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~XUKD6OKL7CR2.1 size=1048576 2024-02-23T06:34:22.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.711+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~XUKD6OKL7CR2.2 size=350617 2024-02-23T06:34:22.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.713+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=XUKD6OKL7CR2 tag=RQ2X0WMPUZ11 type=write size=3496345 2024-02-23T06:34:22.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.714+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=FQC82S5TYIBN type=write size=406543 2024-02-23T06:34:22.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.715+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=A9EO8ZKCV8RJ type=del 2024-02-23T06:34:22.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.717+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HK8NRQKBVXAE.0 size=1048576 2024-02-23T06:34:22.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.718+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HK8NRQKBVXAE.1 size=1048576 2024-02-23T06:34:22.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.719+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HK8NRQKBVXAE.2 size=977600 2024-02-23T06:34:22.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.719+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=HK8NRQKBVXAE tag=G9EXJG14WDL4 type=write size=4123328 2024-02-23T06:34:22.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.720+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~IGCUWJR3HF1Y.0 size=1048576 2024-02-23T06:34:22.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.721+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~IGCUWJR3HF1Y.1 size=936397 2024-02-23T06:34:22.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.724+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=IGCUWJR3HF1Y tag=3CN48BWO16ZG type=write size=3033549 2024-02-23T06:34:22.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.726+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~MHJXCJ115NB6.0 size=1048576 2024-02-23T06:34:22.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.727+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~MHJXCJ115NB6.1 size=1048576 2024-02-23T06:34:22.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.728+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~MHJXCJ115NB6.2 size=605729 2024-02-23T06:34:22.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.728+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=MHJXCJ115NB6 tag=YDGN52E4MHYE type=write size=3751457 2024-02-23T06:34:22.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.729+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~EWGIKI2AJSNR.0 size=503756 2024-02-23T06:34:22.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.731+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=EWGIKI2AJSNR tag=ISXCQQ7SLYEI type=write size=1552332 2024-02-23T06:34:22.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.732+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=7SEEMJSPDL2D type=del size=1854599 2024-02-23T06:34:22.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.734+0000 7f5e72834780 1 < canceled operation key=0WLEPDK2O30W tag=GMN84INOG0DB type=write size=744115 2024-02-23T06:34:22.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.735+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=EMX667LD5GYN type=del size=36338 2024-02-23T06:34:22.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.736+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=TT7X039I5WG0 type=del 2024-02-23T06:34:22.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.737+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=MWBTN49ZL8F5 type=del size=2482002 2024-02-23T06:34:22.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.740+0000 7f5e72834780 1 < suggested remove operation key=RS03NUABC1U2 tag=AFBXPFQJ1B4L type=del 2024-02-23T06:34:22.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.742+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~MQBV3U9IIIWD.0 size=1048576 2024-02-23T06:34:22.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.743+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~MQBV3U9IIIWD.1 size=1048576 2024-02-23T06:34:22.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.744+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~MQBV3U9IIIWD.2 size=539097 2024-02-23T06:34:22.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.744+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=MQBV3U9IIIWD tag=KME7SLVFN0MY type=write size=3684825 2024-02-23T06:34:22.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.745+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~EUGHX019K87R.0 size=1048576 2024-02-23T06:34:22.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.746+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~EUGHX019K87R.1 size=1048576 2024-02-23T06:34:22.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.747+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~EUGHX019K87R.2 size=390512 2024-02-23T06:34:22.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.749+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=EUGHX019K87R tag=XB6QQKGAKXCC type=write size=3536240 2024-02-23T06:34:22.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.751+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~11M49K40CECO.0 size=1048576 2024-02-23T06:34:22.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.752+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~11M49K40CECO.1 size=856338 2024-02-23T06:34:22.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.752+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=11M49K40CECO tag=Q1TMKHQUQWV3 type=write size=2953490 2024-02-23T06:34:22.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.753+0000 7f5e72834780 1 < completed write operation key=9ZCNDGBEPWMN tag=D7A0SP3YU9CB type=write size=28369 2024-02-23T06:34:22.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.754+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=0A4AXF8OGANS type=del size=2264952 2024-02-23T06:34:22.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.757+0000 7f5e72834780 1 < suggested update operation key=WK98HMHAZIUB tag=H768BP6KK7TJ type=write size=1046652 2024-02-23T06:34:22.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.758+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=TFZMMZWGIGFH type=del size=949062 2024-02-23T06:34:22.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.759+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=7WL1H3CRNY9F type=del 2024-02-23T06:34:22.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.760+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=OMUBKQO8THP6 type=del size=2933372 2024-02-23T06:34:22.763 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.762+0000 7f5e72834780 1 < completed write operation key=883VBT1ADE6K tag=XFV73A4Z51BC type=write size=672624 2024-02-23T06:34:22.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.764+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~UVPOOVO4E8OC.0 size=474623 2024-02-23T06:34:22.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.764+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=UVPOOVO4E8OC tag=SAFHJTXB0H4Y type=write size=1523199 2024-02-23T06:34:22.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.765+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~PG0B85JBVO5S.0 size=1048576 2024-02-23T06:34:22.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.766+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~PG0B85JBVO5S.1 size=1048576 2024-02-23T06:34:22.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.767+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~PG0B85JBVO5S.2 size=784102 2024-02-23T06:34:22.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.769+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=PG0B85JBVO5S tag=4GGCOTC8VD5R type=write size=3929830 2024-02-23T06:34:22.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.770+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=7IORJ8H1FHC0 type=del size=2985548 2024-02-23T06:34:22.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.772+0000 7f5e72834780 1 < canceled operation key=03P6IEKSHB17 tag=50JB3NP6NJCW type=del size=2676394 2024-02-23T06:34:22.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.774+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~1F6S4QWRJNIS.0 size=1048576 2024-02-23T06:34:22.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.775+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~1F6S4QWRJNIS.1 size=647852 2024-02-23T06:34:22.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.775+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=1F6S4QWRJNIS tag=LZEOXMCUDI2J type=write size=2745004 2024-02-23T06:34:22.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.776+0000 7f5e72834780 1 < canceled operation key=JV6FJONY04AW tag=MKZG7UZPYHCB type=del size=3856937 2024-02-23T06:34:22.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.778+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~JQ6AG4P5XP79.0 size=148995 2024-02-23T06:34:22.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.778+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=JQ6AG4P5XP79 tag=LSPK4V3V8HE6 type=write size=1197571 2024-02-23T06:34:22.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.779+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~5FQ7SJ1CMD8G.0 size=863610 2024-02-23T06:34:22.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.781+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=5FQ7SJ1CMD8G tag=2P2N5SJDYKV2 type=write size=1912186 2024-02-23T06:34:22.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.783+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~G9WF5RAELX8F.0 size=1048576 2024-02-23T06:34:22.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.784+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~G9WF5RAELX8F.1 size=1048576 2024-02-23T06:34:22.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.785+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~G9WF5RAELX8F.2 size=64201 2024-02-23T06:34:22.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.785+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=G9WF5RAELX8F tag=LKQN6GVBPXQ1 type=write size=3209929 2024-02-23T06:34:22.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.786+0000 7f5e72834780 1 < completed write operation key=9ZCNDGBEPWMN tag=FQC82S5TYIBN type=write size=406543 2024-02-23T06:34:22.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.787+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=WCWDBGKVQYW5 type=del size=3536024 2024-02-23T06:34:22.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.788+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HK8NRQKBVXAE.0 size=1048576 2024-02-23T06:34:22.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.789+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HK8NRQKBVXAE.1 size=1048576 2024-02-23T06:34:22.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.790+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HK8NRQKBVXAE.2 size=977600 2024-02-23T06:34:22.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.792+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=HK8NRQKBVXAE tag=G9EXJG14WDL4 type=write size=4123328 2024-02-23T06:34:22.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.793+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=FN8UU1JO9CZ2 type=write size=554141 2024-02-23T06:34:22.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.794+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~MHJXCJ115NB6.0 size=1048576 2024-02-23T06:34:22.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.795+0000 7f5e72834780 1 < canceled part key=_multipart_721UW0AGSKVR.2~MHJXCJ115NB6.1 size=1048576 2024-02-23T06:34:22.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.795+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~MHJXCJ115NB6.2 size=605729 2024-02-23T06:34:22.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.797+0000 7f5e72834780 1 < canceled multipart upload key=721UW0AGSKVR upload=MHJXCJ115NB6 tag=YDGN52E4MHYE type=write size=3751457 2024-02-23T06:34:22.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.799+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=I2D8AM1FYNV1 type=del size=515643 2024-02-23T06:34:22.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.801+0000 7f5e72834780 1 < suggested update operation key=26EE3EHDK8EM tag=7SEEMJSPDL2D type=del size=1854599 2024-02-23T06:34:22.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.802+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=SDUVDDDVAD5G type=del size=1014143 2024-02-23T06:34:22.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.803+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=EMX667LD5GYN type=del 2024-02-23T06:34:22.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.804+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=RANEDMT3ZKKL type=del size=53779 2024-02-23T06:34:22.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.805+0000 7f5e72834780 1 < canceled operation key=8Q6WC7B9BY5Q tag=MWBTN49ZL8F5 type=del size=2482002 2024-02-23T06:34:22.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.807+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=LY569GFYZSWS type=del size=4157433 2024-02-23T06:34:22.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.808+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~MQBV3U9IIIWD.0 size=1048576 2024-02-23T06:34:22.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.809+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~MQBV3U9IIIWD.1 size=1048576 2024-02-23T06:34:22.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.809+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~MQBV3U9IIIWD.2 size=539097 2024-02-23T06:34:22.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.811+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=MQBV3U9IIIWD tag=KME7SLVFN0MY type=write size=3684825 2024-02-23T06:34:22.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.815+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~2JHG16LYH4RU.0 size=1048576 2024-02-23T06:34:22.817 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.816+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~2JHG16LYH4RU.1 size=1048576 2024-02-23T06:34:22.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.817+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~2JHG16LYH4RU.2 size=713690 2024-02-23T06:34:22.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.817+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=2JHG16LYH4RU tag=WITH1VJYDFDI type=write size=3859418 2024-02-23T06:34:22.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.818+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~11M49K40CECO.0 size=1048576 2024-02-23T06:34:22.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.819+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~11M49K40CECO.1 size=856338 2024-02-23T06:34:22.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.821+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=11M49K40CECO tag=Q1TMKHQUQWV3 type=write size=2953490 2024-02-23T06:34:22.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.822+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=OQTKL4KI86WL type=write size=411982 2024-02-23T06:34:22.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.823+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=0A4AXF8OGANS type=del 2024-02-23T06:34:22.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.824+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=DO1BKIYHBNN1 type=del size=3315829 2024-02-23T06:34:22.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.826+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=TFZMMZWGIGFH type=del 2024-02-23T06:34:22.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.827+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=G3251EN2YO0G type=del size=4114307 2024-02-23T06:34:22.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.829+0000 7f5e72834780 1 < suggested remove operation key=WK98HMHAZIUB tag=OMUBKQO8THP6 type=del 2024-02-23T06:34:22.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.830+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=OSRYN32RWTG5 type=del size=2853132 2024-02-23T06:34:22.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.831+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~UVPOOVO4E8OC.0 size=474623 2024-02-23T06:34:22.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.834+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=UVPOOVO4E8OC tag=SAFHJTXB0H4Y type=write size=1523199 2024-02-23T06:34:22.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.835+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=SXRMYFOG02DV type=del size=4060096 2024-02-23T06:34:22.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.836+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=7IORJ8H1FHC0 type=del 2024-02-23T06:34:22.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.837+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=JOZBS8KM8SPL type=del size=1500110 2024-02-23T06:34:22.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.839+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~1F6S4QWRJNIS.0 size=1048576 2024-02-23T06:34:22.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.840+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~1F6S4QWRJNIS.1 size=647852 2024-02-23T06:34:22.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.842+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=1F6S4QWRJNIS tag=LZEOXMCUDI2J type=write size=2745004 2024-02-23T06:34:22.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.844+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~J0YSOUBABCR2.0 size=471063 2024-02-23T06:34:22.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.844+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=J0YSOUBABCR2 tag=79JTU1CGLKEQ type=write size=1519639 2024-02-23T06:34:22.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.845+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~JQ6AG4P5XP79.0 size=148995 2024-02-23T06:34:22.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.847+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=JQ6AG4P5XP79 tag=LSPK4V3V8HE6 type=write size=1197571 2024-02-23T06:34:22.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.849+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~CGI38MNIB751.0 size=1048576 2024-02-23T06:34:22.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.850+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~CGI38MNIB751.1 size=1048576 2024-02-23T06:34:22.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.851+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~CGI38MNIB751.2 size=294566 2024-02-23T06:34:22.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.851+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=CGI38MNIB751 tag=MKTK834FAFZO type=write size=3440294 2024-02-23T06:34:22.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.852+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~G9WF5RAELX8F.0 size=1048576 2024-02-23T06:34:22.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.853+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~G9WF5RAELX8F.1 size=1048576 2024-02-23T06:34:22.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.854+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~G9WF5RAELX8F.2 size=64201 2024-02-23T06:34:22.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.856+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=G9WF5RAELX8F tag=LKQN6GVBPXQ1 type=write size=3209929 2024-02-23T06:34:22.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.857+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=76UZR4KNGVDF type=del size=368970 2024-02-23T06:34:22.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.858+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=WCWDBGKVQYW5 type=del 2024-02-23T06:34:22.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.860+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~35WACPGMAR7U.0 size=1048576 2024-02-23T06:34:22.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.861+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~35WACPGMAR7U.1 size=167994 2024-02-23T06:34:22.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.861+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=35WACPGMAR7U tag=2QBXKW88BD3T type=write size=2265146 2024-02-23T06:34:22.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.863+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=FN8UU1JO9CZ2 type=write size=554141 2024-02-23T06:34:22.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.864+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=EJGN9QADZ8JB type=del size=327608 2024-02-23T06:34:22.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.866+0000 7f5e72834780 1 < suggested update operation key=0WLEPDK2O30W tag=I2D8AM1FYNV1 type=del size=515643 2024-02-23T06:34:22.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.867+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=17KRB79S5FCJ type=del size=650767 2024-02-23T06:34:22.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.868+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=SDUVDDDVAD5G type=del 2024-02-23T06:34:22.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.871+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~1RL3D9KON8SR.0 size=1048576 2024-02-23T06:34:22.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.872+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~1RL3D9KON8SR.1 size=1048576 2024-02-23T06:34:22.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.873+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~1RL3D9KON8SR.2 size=916725 2024-02-23T06:34:22.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.873+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=1RL3D9KON8SR tag=PUS94EXYPMCK type=write size=4062453 2024-02-23T06:34:22.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.874+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=RANEDMT3ZKKL type=del 2024-02-23T06:34:22.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.876+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HWJLMN4MOGGO.0 size=1048576 2024-02-23T06:34:22.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.877+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HWJLMN4MOGGO.1 size=1048576 2024-02-23T06:34:22.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.878+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HWJLMN4MOGGO.2 size=756378 2024-02-23T06:34:22.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.878+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=HWJLMN4MOGGO tag=AQRC908E3Q2N type=write size=3902106 2024-02-23T06:34:22.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.879+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=LY569GFYZSWS type=del 2024-02-23T06:34:22.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.881+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~SJ7NBTNXTOXT.0 size=1048576 2024-02-23T06:34:22.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.882+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~SJ7NBTNXTOXT.1 size=1048576 2024-02-23T06:34:22.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.883+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~SJ7NBTNXTOXT.2 size=837929 2024-02-23T06:34:22.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.883+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=SJ7NBTNXTOXT tag=JP7ZLC91A5T6 type=write size=3983657 2024-02-23T06:34:22.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.884+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~2JHG16LYH4RU.0 size=1048576 2024-02-23T06:34:22.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.885+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~2JHG16LYH4RU.1 size=1048576 2024-02-23T06:34:22.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.886+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~2JHG16LYH4RU.2 size=713690 2024-02-23T06:34:22.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.888+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=2JHG16LYH4RU tag=WITH1VJYDFDI type=write size=3859418 2024-02-23T06:34:22.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.889+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=8WPZNT01WPSH type=del size=1454228 2024-02-23T06:34:22.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.891+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=OQTKL4KI86WL type=write size=411982 2024-02-23T06:34:22.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.893+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~GNP11109Y7EY.0 size=1048576 2024-02-23T06:34:22.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.894+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~GNP11109Y7EY.1 size=626704 2024-02-23T06:34:22.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.894+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=GNP11109Y7EY tag=F97AT1U0GSFX type=write size=2723856 2024-02-23T06:34:22.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.895+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=DO1BKIYHBNN1 type=del 2024-02-23T06:34:22.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.896+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=M68FYN2HETV1 type=del size=1816839 2024-02-23T06:34:22.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.897+0000 7f5e72834780 1 < canceled operation key=N8RXOY8X71MO tag=G3251EN2YO0G type=del size=4114307 2024-02-23T06:34:22.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.898+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=1NVHLGFMBF3U type=del size=1343498 2024-02-23T06:34:22.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.900+0000 7f5e72834780 1 < canceled operation key=LUERFL6AN6HF tag=OSRYN32RWTG5 type=del size=2853132 2024-02-23T06:34:22.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.901+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=5FAWKENTGLE4 type=del size=3410288 2024-02-23T06:34:22.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.902+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=SXRMYFOG02DV type=del 2024-02-23T06:34:22.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.903+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=RTWV2XYB4SI0 type=write size=317883 2024-02-23T06:34:22.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.905+0000 7f5e72834780 1 < suggested remove operation key=9AQCXLBZW3EV tag=JOZBS8KM8SPL type=del 2024-02-23T06:34:22.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.907+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~4JVSK7ZIGI94.0 size=222196 2024-02-23T06:34:22.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.907+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=4JVSK7ZIGI94 tag=I7XMM02QHU31 type=write size=1270772 2024-02-23T06:34:22.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.909+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~J0YSOUBABCR2.0 size=471063 2024-02-23T06:34:22.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.910+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=J0YSOUBABCR2 tag=79JTU1CGLKEQ type=write size=1519639 2024-02-23T06:34:22.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.913+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~9HJ7VHW7146D.0 size=867561 2024-02-23T06:34:22.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.913+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=9HJ7VHW7146D tag=7Q1OTHH1SOUF type=write size=1916137 2024-02-23T06:34:22.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.914+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~CGI38MNIB751.0 size=1048576 2024-02-23T06:34:22.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.915+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~CGI38MNIB751.1 size=1048576 2024-02-23T06:34:22.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.916+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~CGI38MNIB751.2 size=294566 2024-02-23T06:34:22.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.918+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=CGI38MNIB751 tag=MKTK834FAFZO type=write size=3440294 2024-02-23T06:34:22.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.919+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=85LQQ58JC0OU type=del size=761924 2024-02-23T06:34:22.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.921+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=76UZR4KNGVDF type=del size=368970 2024-02-23T06:34:22.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.922+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=6SMO0UC4TQZD type=write size=528383 2024-02-23T06:34:22.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.924+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~35WACPGMAR7U.0 size=1048576 2024-02-23T06:34:22.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.924+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~35WACPGMAR7U.1 size=167994 2024-02-23T06:34:22.927 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.926+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=35WACPGMAR7U tag=2QBXKW88BD3T type=write size=2265146 2024-02-23T06:34:22.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.928+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=O2MRX91I3G18 type=del size=2907763 2024-02-23T06:34:22.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.929+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=EJGN9QADZ8JB type=del 2024-02-23T06:34:22.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.931+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~KIGS9D0EG2YQ.0 size=1048576 2024-02-23T06:34:22.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.932+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~KIGS9D0EG2YQ.1 size=1048576 2024-02-23T06:34:22.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.933+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~KIGS9D0EG2YQ.2 size=65724 2024-02-23T06:34:22.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.933+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=KIGS9D0EG2YQ tag=EARXHCAIDGYF type=write size=3211452 2024-02-23T06:34:22.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.934+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=17KRB79S5FCJ type=del 2024-02-23T06:34:22.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.935+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=M9RQ1EOHDH1D type=del size=1132559 2024-02-23T06:34:22.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.937+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~1RL3D9KON8SR.0 size=1048576 2024-02-23T06:34:22.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.938+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~1RL3D9KON8SR.1 size=1048576 2024-02-23T06:34:22.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.938+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~1RL3D9KON8SR.2 size=916725 2024-02-23T06:34:22.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.940+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=1RL3D9KON8SR tag=PUS94EXYPMCK type=write size=4062453 2024-02-23T06:34:22.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.943+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=US3EBJJDCT4A type=del size=1442673 2024-02-23T06:34:22.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.945+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HWJLMN4MOGGO.0 size=1048576 2024-02-23T06:34:22.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.946+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HWJLMN4MOGGO.1 size=1048576 2024-02-23T06:34:22.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.947+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HWJLMN4MOGGO.2 size=756378 2024-02-23T06:34:22.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.949+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=HWJLMN4MOGGO tag=AQRC908E3Q2N type=write size=3902106 2024-02-23T06:34:22.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.951+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~AYWF6WB5QUO5.0 size=1048576 2024-02-23T06:34:22.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.952+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~AYWF6WB5QUO5.1 size=568879 2024-02-23T06:34:22.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.952+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=AYWF6WB5QUO5 tag=CQGVEFFHFOWH type=write size=2666031 2024-02-23T06:34:22.954 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.953+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~SJ7NBTNXTOXT.0 size=1048576 2024-02-23T06:34:22.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.954+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~SJ7NBTNXTOXT.1 size=1048576 2024-02-23T06:34:22.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.955+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~SJ7NBTNXTOXT.2 size=837929 2024-02-23T06:34:22.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.956+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=SJ7NBTNXTOXT tag=JP7ZLC91A5T6 type=write size=3983657 2024-02-23T06:34:22.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.957+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=8VGEC5FFKKN1 type=write size=148937 2024-02-23T06:34:22.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.959+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=8WPZNT01WPSH type=del 2024-02-23T06:34:22.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.960+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=K9KCATPER6LT type=del size=896869 2024-02-23T06:34:22.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.961+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~GNP11109Y7EY.0 size=1048576 2024-02-23T06:34:22.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.962+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~GNP11109Y7EY.1 size=626704 2024-02-23T06:34:22.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.963+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=GNP11109Y7EY tag=F97AT1U0GSFX type=write size=2723856 2024-02-23T06:34:22.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.965+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~MQN419273IWI.0 size=1048576 2024-02-23T06:34:22.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.966+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~MQN419273IWI.1 size=1048576 2024-02-23T06:34:22.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.967+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~MQN419273IWI.2 size=335103 2024-02-23T06:34:22.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.967+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=MQN419273IWI tag=RRXQJXDUS56X type=write size=3480831 2024-02-23T06:34:22.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.968+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=M68FYN2HETV1 type=del 2024-02-23T06:34:22.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.969+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=P98RHXIIQFL9 type=write size=281130 2024-02-23T06:34:22.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.970+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=1NVHLGFMBF3U type=del 2024-02-23T06:34:22.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.972+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~S2T6I4DEPQ8Y.0 size=1048576 2024-02-23T06:34:22.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.973+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~S2T6I4DEPQ8Y.1 size=570529 2024-02-23T06:34:22.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.973+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=S2T6I4DEPQ8Y tag=OAWRO0NSV9MR type=write size=2667681 2024-02-23T06:34:22.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.974+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=5FAWKENTGLE4 type=del 2024-02-23T06:34:22.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.976+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~OYDVRPIJU8DA.0 size=1048576 2024-02-23T06:34:22.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.977+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~OYDVRPIJU8DA.1 size=1048576 2024-02-23T06:34:22.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.978+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~OYDVRPIJU8DA.2 size=24367 2024-02-23T06:34:22.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.978+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=OYDVRPIJU8DA tag=8EHM4UV0Y6Y3 type=write size=3170095 2024-02-23T06:34:22.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.979+0000 7f5e72834780 1 < canceled operation key=26EE3EHDK8EM tag=RTWV2XYB4SI0 type=write size=317883 2024-02-23T06:34:22.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.981+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~1R85E2UQBFM0.0 size=1048576 2024-02-23T06:34:22.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.982+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~1R85E2UQBFM0.1 size=1048576 2024-02-23T06:34:22.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.983+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~1R85E2UQBFM0.2 size=708154 2024-02-23T06:34:22.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.983+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=1R85E2UQBFM0 tag=W6PMJ2WLSI82 type=write size=3853882 2024-02-23T06:34:22.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.984+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~4JVSK7ZIGI94.0 size=222196 2024-02-23T06:34:22.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.986+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=4JVSK7ZIGI94 tag=I7XMM02QHU31 type=write size=1270772 2024-02-23T06:34:22.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.987+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=2ZKAE6NK63CI type=del size=622101 2024-02-23T06:34:22.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.988+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~9HJ7VHW7146D.0 size=867561 2024-02-23T06:34:22.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.990+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=9HJ7VHW7146D tag=7Q1OTHH1SOUF type=write size=1916137 2024-02-23T06:34:22.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.993+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~GUSRNJLDWCZ7.0 size=585965 2024-02-23T06:34:22.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.993+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=GUSRNJLDWCZ7 tag=600K0NOEG4HX type=write size=1634541 2024-02-23T06:34:22.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.994+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=85LQQ58JC0OU type=del 2024-02-23T06:34:22.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.995+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=Z2J89N6B9OZ1 type=del size=1287829 2024-02-23T06:34:22.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.997+0000 7f5e72834780 1 < completed write operation key=9ZCNDGBEPWMN tag=6SMO0UC4TQZD type=write size=528383 2024-02-23T06:34:22.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.998+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=Y69P5H2P09XI type=del size=54342 2024-02-23T06:34:23.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:22.999+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=O2MRX91I3G18 type=del 2024-02-23T06:34:23.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.000+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=5RG25ZJ86KXX type=del size=3825429 2024-02-23T06:34:23.002 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.001+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~KIGS9D0EG2YQ.0 size=1048576 2024-02-23T06:34:23.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.002+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~KIGS9D0EG2YQ.1 size=1048576 2024-02-23T06:34:23.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.003+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~KIGS9D0EG2YQ.2 size=65724 2024-02-23T06:34:23.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.006+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=KIGS9D0EG2YQ tag=EARXHCAIDGYF type=write size=3211452 2024-02-23T06:34:23.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.008+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~9RAMVHZ2PA5H.0 size=1048576 2024-02-23T06:34:23.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.009+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~9RAMVHZ2PA5H.1 size=1048576 2024-02-23T06:34:23.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.010+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~9RAMVHZ2PA5H.2 size=521920 2024-02-23T06:34:23.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.010+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=9RAMVHZ2PA5H tag=D9H8SXC00E93 type=write size=3667648 2024-02-23T06:34:23.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.012+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=M9RQ1EOHDH1D type=del 2024-02-23T06:34:23.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.013+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=L4HB03US4KLU type=del size=579033 2024-02-23T06:34:23.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.014+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=US3EBJJDCT4A type=del 2024-02-23T06:34:23.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.015+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=XQ10INS157PV type=del size=1743313 2024-02-23T06:34:23.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.017+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~AYWF6WB5QUO5.0 size=1048576 2024-02-23T06:34:23.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.018+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~AYWF6WB5QUO5.1 size=568879 2024-02-23T06:34:23.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.020+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=AYWF6WB5QUO5 tag=CQGVEFFHFOWH type=write size=2666031 2024-02-23T06:34:23.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.021+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=QPDTCVZLI5L4 type=del size=979881 2024-02-23T06:34:23.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.023+0000 7f5e72834780 1 < completed write operation key=R3STDBS79MV0 tag=8VGEC5FFKKN1 type=write size=148937 2024-02-23T06:34:23.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.024+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=OYOMRLCD84EB type=write size=98724 2024-02-23T06:34:23.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.025+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=K9KCATPER6LT type=del 2024-02-23T06:34:23.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.026+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=L9L4FRZ611XZ type=write size=526356 2024-02-23T06:34:23.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.027+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~MQN419273IWI.0 size=1048576 2024-02-23T06:34:23.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.028+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~MQN419273IWI.1 size=1048576 2024-02-23T06:34:23.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.029+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~MQN419273IWI.2 size=335103 2024-02-23T06:34:23.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.031+0000 7f5e72834780 1 < canceled multipart upload key=26EE3EHDK8EM upload=MQN419273IWI tag=RRXQJXDUS56X type=write size=3480831 2024-02-23T06:34:23.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.033+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~QTOGXONQYGMF.0 size=110661 2024-02-23T06:34:23.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.033+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=QTOGXONQYGMF tag=LOR4ZG9AIAEA type=write size=1159237 2024-02-23T06:34:23.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.035+0000 7f5e72834780 1 < suggested update operation key=WETP4ONTU3HL tag=P98RHXIIQFL9 type=write size=281130 2024-02-23T06:34:23.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.036+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=R683HOF9KAPW type=del size=3855668 2024-02-23T06:34:23.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.037+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~S2T6I4DEPQ8Y.0 size=1048576 2024-02-23T06:34:23.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.038+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~S2T6I4DEPQ8Y.1 size=570529 2024-02-23T06:34:23.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.040+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=S2T6I4DEPQ8Y tag=OAWRO0NSV9MR type=write size=2667681 2024-02-23T06:34:23.043 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.042+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=0ZDNTSX5QL6Y type=del size=278008 2024-02-23T06:34:23.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.043+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~OYDVRPIJU8DA.0 size=1048576 2024-02-23T06:34:23.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.044+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~OYDVRPIJU8DA.1 size=1048576 2024-02-23T06:34:23.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.045+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~OYDVRPIJU8DA.2 size=24367 2024-02-23T06:34:23.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.047+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=OYDVRPIJU8DA tag=8EHM4UV0Y6Y3 type=write size=3170095 2024-02-23T06:34:23.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.048+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=KXHIUG6CI4RM type=write size=247942 2024-02-23T06:34:23.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.049+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~1R85E2UQBFM0.0 size=1048576 2024-02-23T06:34:23.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.050+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~1R85E2UQBFM0.1 size=1048576 2024-02-23T06:34:23.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.050+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~1R85E2UQBFM0.2 size=708154 2024-02-23T06:34:23.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.053+0000 7f5e72834780 1 < canceled multipart upload key=ZC75CQ2789VE upload=1R85E2UQBFM0 tag=W6PMJ2WLSI82 type=write size=3853882 2024-02-23T06:34:23.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.054+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=JSK9EKZYX8GB type=del size=808464 2024-02-23T06:34:23.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.056+0000 7f5e72834780 1 < suggested remove operation key=VER8U5YMTPS6 tag=2ZKAE6NK63CI type=del 2024-02-23T06:34:23.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.058+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~X20UG9JKI8S3.0 size=1048576 2024-02-23T06:34:23.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.059+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~X20UG9JKI8S3.1 size=832778 2024-02-23T06:34:23.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.059+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=X20UG9JKI8S3 tag=XANPE8YF09R3 type=write size=2929930 2024-02-23T06:34:23.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.061+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~GUSRNJLDWCZ7.0 size=585965 2024-02-23T06:34:23.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.062+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=GUSRNJLDWCZ7 tag=600K0NOEG4HX type=write size=1634541 2024-02-23T06:34:23.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.063+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=ZC6PVSXAJWPY type=del size=3437422 2024-02-23T06:34:23.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.066+0000 7f5e72834780 1 < suggested update operation key=R3STDBS79MV0 tag=Z2J89N6B9OZ1 type=del size=1287829 2024-02-23T06:34:23.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.068+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~VIKUMDU2RYN5.0 size=490577 2024-02-23T06:34:23.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.068+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=VIKUMDU2RYN5 tag=LYMKZXW2U7E7 type=write size=1539153 2024-02-23T06:34:23.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.069+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=Y69P5H2P09XI type=del 2024-02-23T06:34:23.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.070+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=6VR4W85YDSOM type=del size=3916031 2024-02-23T06:34:23.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.072+0000 7f5e72834780 1 < suggested remove operation key=M5LH10WTDP0P tag=5RG25ZJ86KXX type=del 2024-02-23T06:34:23.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.074+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~S84IOVYUHMH7.0 size=24503 2024-02-23T06:34:23.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.074+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=S84IOVYUHMH7 tag=27I2E4HRX36K type=write size=1073079 2024-02-23T06:34:23.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.076+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~9RAMVHZ2PA5H.0 size=1048576 2024-02-23T06:34:23.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.076+0000 7f5e72834780 1 < canceled part key=_multipart_721UW0AGSKVR.2~9RAMVHZ2PA5H.1 size=1048576 2024-02-23T06:34:23.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.077+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~9RAMVHZ2PA5H.2 size=521920 2024-02-23T06:34:23.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.079+0000 7f5e72834780 1 < canceled multipart upload key=721UW0AGSKVR upload=9RAMVHZ2PA5H tag=D9H8SXC00E93 type=write size=3667648 2024-02-23T06:34:23.081 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.080+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=0C2T6D09KX5Q type=del size=2667437 2024-02-23T06:34:23.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.081+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=L4HB03US4KLU type=del 2024-02-23T06:34:23.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.083+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~JCV6ZJ7P19JZ.0 size=92654 2024-02-23T06:34:23.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.083+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=JCV6ZJ7P19JZ tag=2VCYS6ONG5BQ type=write size=1141230 2024-02-23T06:34:23.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.084+0000 7f5e72834780 1 < canceled operation key=9ZCNDGBEPWMN tag=XQ10INS157PV type=del size=1743313 2024-02-23T06:34:23.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.086+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~LI9CNTK6HE6W.0 size=1048576 2024-02-23T06:34:23.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.087+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~LI9CNTK6HE6W.1 size=1048576 2024-02-23T06:34:23.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.088+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~LI9CNTK6HE6W.2 size=798990 2024-02-23T06:34:23.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.088+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=LI9CNTK6HE6W tag=J2PPEDY0XW8Z type=write size=3944718 2024-02-23T06:34:23.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.089+0000 7f5e72834780 1 < canceled operation key=QZLNM2RQ9SDC tag=QPDTCVZLI5L4 type=del size=979881 2024-02-23T06:34:23.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.090+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=6PBNWXUQ2X25 type=del size=1383150 2024-02-23T06:34:23.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.091+0000 7f5e72834780 1 < completed write operation key=GWTK3YV0RY21 tag=OYOMRLCD84EB type=write size=98724 2024-02-23T06:34:23.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.093+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=2MUB1ZBW8QOS type=write size=1027824 2024-02-23T06:34:23.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.094+0000 7f5e72834780 1 < completed write operation key=TNH85ZWPALJN tag=L9L4FRZ611XZ type=write size=526356 2024-02-23T06:34:23.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.096+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~GFUCUAHR1P8C.0 size=1048576 2024-02-23T06:34:23.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.097+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~GFUCUAHR1P8C.1 size=65939 2024-02-23T06:34:23.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.097+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=GFUCUAHR1P8C tag=QCSV7VB0LK2Q type=write size=2163091 2024-02-23T06:34:23.099 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.098+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~QTOGXONQYGMF.0 size=110661 2024-02-23T06:34:23.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.100+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=QTOGXONQYGMF tag=LOR4ZG9AIAEA type=write size=1159237 2024-02-23T06:34:23.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.101+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=Q2I99SFB9D9F type=del size=2520556 2024-02-23T06:34:23.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.102+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=R683HOF9KAPW type=del 2024-02-23T06:34:23.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.104+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~V5F101HVRFZ0.0 size=1048576 2024-02-23T06:34:23.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.105+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~V5F101HVRFZ0.1 size=648706 2024-02-23T06:34:23.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.105+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=V5F101HVRFZ0 tag=MAURJ61I8LUS type=write size=2745858 2024-02-23T06:34:23.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.106+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=0ZDNTSX5QL6Y type=del 2024-02-23T06:34:23.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.107+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=TFPPGHULK1NP type=write size=789224 2024-02-23T06:34:23.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.109+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=KXHIUG6CI4RM type=write size=247942 2024-02-23T06:34:23.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.110+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=O9BY1AZ1FE8Q type=write size=125042 2024-02-23T06:34:23.112 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.111+0000 7f5e72834780 1 < canceled operation key=8Q6WC7B9BY5Q tag=JSK9EKZYX8GB type=del size=808464 2024-02-23T06:34:23.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.112+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=8JQX391GQ2QL type=del size=1246336 2024-02-23T06:34:23.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.113+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~X20UG9JKI8S3.0 size=1048576 2024-02-23T06:34:23.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.114+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~X20UG9JKI8S3.1 size=832778 2024-02-23T06:34:23.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.116+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=X20UG9JKI8S3 tag=XANPE8YF09R3 type=write size=2929930 2024-02-23T06:34:23.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.118+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~TSNBP2KZX9JL.0 size=1048576 2024-02-23T06:34:23.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.119+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~TSNBP2KZX9JL.1 size=1048576 2024-02-23T06:34:23.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.120+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~TSNBP2KZX9JL.2 size=311218 2024-02-23T06:34:23.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.120+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=TSNBP2KZX9JL tag=32LRVEYULTNT type=write size=3456946 2024-02-23T06:34:23.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.122+0000 7f5e72834780 1 < suggested remove operation key=26EE3EHDK8EM tag=ZC6PVSXAJWPY type=del 2024-02-23T06:34:23.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.123+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=WR1PUTOOHA64 type=del size=2379091 2024-02-23T06:34:23.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.124+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~VIKUMDU2RYN5.0 size=490577 2024-02-23T06:34:23.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.126+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=VIKUMDU2RYN5 tag=LYMKZXW2U7E7 type=write size=1539153 2024-02-23T06:34:23.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.127+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=E0GQWM7CU318 type=del size=1468653 2024-02-23T06:34:23.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.128+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=6VR4W85YDSOM type=del 2024-02-23T06:34:23.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.130+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~0W5CJS8T0XPA.0 size=264182 2024-02-23T06:34:23.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.130+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=0W5CJS8T0XPA tag=YQUPNO8RIUNF type=write size=1312758 2024-02-23T06:34:23.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.130+0000 7f5e72834780 1 < canceled part key=_multipart_LUERFL6AN6HF.2~S84IOVYUHMH7.0 size=24503 2024-02-23T06:34:23.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.132+0000 7f5e72834780 1 < canceled multipart upload key=LUERFL6AN6HF upload=S84IOVYUHMH7 tag=27I2E4HRX36K type=write size=1073079 2024-02-23T06:34:23.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.134+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~AY7XQAF6FZWN.0 size=1048576 2024-02-23T06:34:23.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.135+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~AY7XQAF6FZWN.1 size=1048576 2024-02-23T06:34:23.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.136+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~AY7XQAF6FZWN.2 size=512563 2024-02-23T06:34:23.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.136+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=AY7XQAF6FZWN tag=F54C0R2YJ5TB type=write size=3658291 2024-02-23T06:34:23.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.137+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=0C2T6D09KX5Q type=del 2024-02-23T06:34:23.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.139+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~03WC142SBX65.0 size=1048576 2024-02-23T06:34:23.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.140+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~03WC142SBX65.1 size=1048576 2024-02-23T06:34:23.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.141+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~03WC142SBX65.2 size=893572 2024-02-23T06:34:23.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.141+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=03WC142SBX65 tag=N8NEPB95Q8AU type=write size=4039300 2024-02-23T06:34:23.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.142+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~JCV6ZJ7P19JZ.0 size=92654 2024-02-23T06:34:23.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.144+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=JCV6ZJ7P19JZ tag=2VCYS6ONG5BQ type=write size=1141230 2024-02-23T06:34:23.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.145+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=IUGCTNELXDS4 type=del size=3601499 2024-02-23T06:34:23.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.146+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~LI9CNTK6HE6W.0 size=1048576 2024-02-23T06:34:23.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.147+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~LI9CNTK6HE6W.1 size=1048576 2024-02-23T06:34:23.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.148+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~LI9CNTK6HE6W.2 size=798990 2024-02-23T06:34:23.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.150+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=LI9CNTK6HE6W tag=J2PPEDY0XW8Z type=write size=3944718 2024-02-23T06:34:23.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.151+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=FQABYT45LY0E type=del size=747891 2024-02-23T06:34:23.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.153+0000 7f5e72834780 1 < canceled operation key=LUERFL6AN6HF tag=6PBNWXUQ2X25 type=del size=1383150 2024-02-23T06:34:23.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.155+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~BG1I24FRVSBD.0 size=53039 2024-02-23T06:34:23.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.155+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=BG1I24FRVSBD tag=GAHVNXHXI334 type=write size=1101615 2024-02-23T06:34:23.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.156+0000 7f5e72834780 1 < completed write operation key=TPADM4812N0Z tag=2MUB1ZBW8QOS type=write size=1027824 2024-02-23T06:34:23.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.159+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~JAH4IX9XBV7S.0 size=1048576 2024-02-23T06:34:23.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.160+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~JAH4IX9XBV7S.1 size=1048576 2024-02-23T06:34:23.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.161+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~JAH4IX9XBV7S.2 size=20881 2024-02-23T06:34:23.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.161+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=JAH4IX9XBV7S tag=I2XW3U2WDMGK type=write size=3166609 2024-02-23T06:34:23.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.163+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~GFUCUAHR1P8C.0 size=1048576 2024-02-23T06:34:23.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.164+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~GFUCUAHR1P8C.1 size=65939 2024-02-23T06:34:23.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.166+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=GFUCUAHR1P8C tag=QCSV7VB0LK2Q type=write size=2163091 2024-02-23T06:34:23.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.168+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~EO18WYFIAD9F.0 size=1048576 2024-02-23T06:34:23.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.169+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~EO18WYFIAD9F.1 size=1048576 2024-02-23T06:34:23.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.170+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~EO18WYFIAD9F.2 size=538542 2024-02-23T06:34:23.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.170+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=EO18WYFIAD9F tag=JH92GVWE1XUE type=write size=3684270 2024-02-23T06:34:23.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.171+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=Q2I99SFB9D9F type=del 2024-02-23T06:34:23.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.172+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=DI6A5X40QZ22 type=del size=2232976 2024-02-23T06:34:23.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.173+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~V5F101HVRFZ0.0 size=1048576 2024-02-23T06:34:23.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.174+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~V5F101HVRFZ0.1 size=648706 2024-02-23T06:34:23.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.176+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=V5F101HVRFZ0 tag=MAURJ61I8LUS type=write size=2745858 2024-02-23T06:34:23.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.177+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=0GR33G32OSZR type=del size=1016860 2024-02-23T06:34:23.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.178+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=TFPPGHULK1NP type=write size=789224 2024-02-23T06:34:23.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.180+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=2EIR9LNXCLW8 type=del size=2111136 2024-02-23T06:34:23.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.181+0000 7f5e72834780 1 < canceled operation key=GW6EKQ84FQ6L tag=O9BY1AZ1FE8Q type=write size=125042 2024-02-23T06:34:23.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.183+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~67P75NK1PCUH.0 size=274507 2024-02-23T06:34:23.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.183+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=67P75NK1PCUH tag=7FMOTP4X8627 type=write size=1323083 2024-02-23T06:34:23.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.184+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=8JQX391GQ2QL type=del 2024-02-23T06:34:23.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.186+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~QNCGDKCSQD0X.0 size=388734 2024-02-23T06:34:23.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.186+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=QNCGDKCSQD0X tag=223W27XZK8YD type=write size=1437310 2024-02-23T06:34:23.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.187+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~TSNBP2KZX9JL.0 size=1048576 2024-02-23T06:34:23.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.188+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~TSNBP2KZX9JL.1 size=1048576 2024-02-23T06:34:23.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.189+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~TSNBP2KZX9JL.2 size=311218 2024-02-23T06:34:23.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.192+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=TSNBP2KZX9JL tag=32LRVEYULTNT type=write size=3456946 2024-02-23T06:34:23.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.193+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=A1D7PU2WJQWQ type=del size=3770646 2024-02-23T06:34:23.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.194+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=WR1PUTOOHA64 type=del 2024-02-23T06:34:23.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.195+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=CWK19U6QENFG type=del size=1084514 2024-02-23T06:34:23.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.199+0000 7f5e72834780 1 < suggested remove operation key=VER8U5YMTPS6 tag=E0GQWM7CU318 type=del 2024-02-23T06:34:23.202 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.201+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~1DM3AXE191OL.0 size=1048576 2024-02-23T06:34:23.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.202+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~1DM3AXE191OL.1 size=1048576 2024-02-23T06:34:23.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.203+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~1DM3AXE191OL.2 size=248425 2024-02-23T06:34:23.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.203+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=1DM3AXE191OL tag=QGBEK0UN0OPB type=write size=3394153 2024-02-23T06:34:23.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.204+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~0W5CJS8T0XPA.0 size=264182 2024-02-23T06:34:23.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.206+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=0W5CJS8T0XPA tag=YQUPNO8RIUNF type=write size=1312758 2024-02-23T06:34:23.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.207+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=NYU51V2Y2QDY type=del size=3412834 2024-02-23T06:34:23.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.208+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~AY7XQAF6FZWN.0 size=1048576 2024-02-23T06:34:23.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.209+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~AY7XQAF6FZWN.1 size=1048576 2024-02-23T06:34:23.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.210+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~AY7XQAF6FZWN.2 size=512563 2024-02-23T06:34:23.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.212+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=AY7XQAF6FZWN tag=F54C0R2YJ5TB type=write size=3658291 2024-02-23T06:34:23.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.213+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=2NDSQNXCAXWN type=del size=3490558 2024-02-23T06:34:23.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.214+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~03WC142SBX65.0 size=1048576 2024-02-23T06:34:23.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.215+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~03WC142SBX65.1 size=1048576 2024-02-23T06:34:23.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.216+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~03WC142SBX65.2 size=893572 2024-02-23T06:34:23.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.218+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=03WC142SBX65 tag=N8NEPB95Q8AU type=write size=4039300 2024-02-23T06:34:23.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.220+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~6RJLKERGH6SJ.0 size=76845 2024-02-23T06:34:23.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.220+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=6RJLKERGH6SJ tag=7XDWCQO6VGUQ type=write size=1125421 2024-02-23T06:34:23.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.221+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=IUGCTNELXDS4 type=del 2024-02-23T06:34:23.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.223+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~FLQDJ6G1NP0G.0 size=1048576 2024-02-23T06:34:23.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.224+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~FLQDJ6G1NP0G.1 size=1048576 2024-02-23T06:34:23.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.225+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~FLQDJ6G1NP0G.2 size=353734 2024-02-23T06:34:23.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.225+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=FLQDJ6G1NP0G tag=N5HAGWLNVN8I type=write size=3499462 2024-02-23T06:34:23.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.227+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=FQABYT45LY0E type=del 2024-02-23T06:34:23.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.228+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=PAA2104GKURF type=del size=539592 2024-02-23T06:34:23.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.229+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~BG1I24FRVSBD.0 size=53039 2024-02-23T06:34:23.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.231+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=BG1I24FRVSBD tag=GAHVNXHXI334 type=write size=1101615 2024-02-23T06:34:23.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.232+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=5PRPR6EYJLVY type=write size=633894 2024-02-23T06:34:23.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.233+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~JAH4IX9XBV7S.0 size=1048576 2024-02-23T06:34:23.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.234+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~JAH4IX9XBV7S.1 size=1048576 2024-02-23T06:34:23.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.235+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~JAH4IX9XBV7S.2 size=20881 2024-02-23T06:34:23.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.237+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=JAH4IX9XBV7S tag=I2XW3U2WDMGK type=write size=3166609 2024-02-23T06:34:23.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.238+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=O9LSUNS82MK9 type=write size=122071 2024-02-23T06:34:23.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.239+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~EO18WYFIAD9F.0 size=1048576 2024-02-23T06:34:23.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.240+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~EO18WYFIAD9F.1 size=1048576 2024-02-23T06:34:23.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.241+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~EO18WYFIAD9F.2 size=538542 2024-02-23T06:34:23.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.242+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=EO18WYFIAD9F tag=JH92GVWE1XUE type=write size=3684270 2024-02-23T06:34:23.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.244+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~1G6OQ0Q1O2C8.0 size=1048576 2024-02-23T06:34:23.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.245+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~1G6OQ0Q1O2C8.1 size=1048576 2024-02-23T06:34:23.247 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.246+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~1G6OQ0Q1O2C8.2 size=89258 2024-02-23T06:34:23.247 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.246+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=1G6OQ0Q1O2C8 tag=S1KDO9AHLIFZ type=write size=3234986 2024-02-23T06:34:23.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.247+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=DI6A5X40QZ22 type=del 2024-02-23T06:34:23.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.248+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=JOD5BKSZLJ20 type=del size=1944740 2024-02-23T06:34:23.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.249+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=0GR33G32OSZR type=del 2024-02-23T06:34:23.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.251+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=WFPS7ZI4Q1YK type=del size=2440185 2024-02-23T06:34:23.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.252+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=2EIR9LNXCLW8 type=del 2024-02-23T06:34:23.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.253+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=8II7ZHTEZ42E type=del size=1452114 2024-02-23T06:34:23.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.254+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~67P75NK1PCUH.0 size=274507 2024-02-23T06:34:23.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.256+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=67P75NK1PCUH tag=7FMOTP4X8627 type=write size=1323083 2024-02-23T06:34:23.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.258+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~L9PZ26JKF2TU.0 size=1048576 2024-02-23T06:34:23.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.259+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~L9PZ26JKF2TU.1 size=50070 2024-02-23T06:34:23.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.259+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=L9PZ26JKF2TU tag=UVF9PENC7KKG type=write size=2147222 2024-02-23T06:34:23.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.260+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~QNCGDKCSQD0X.0 size=388734 2024-02-23T06:34:23.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.262+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=QNCGDKCSQD0X tag=223W27XZK8YD type=write size=1437310 2024-02-23T06:34:23.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.263+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=9TZRP3U1UZ8E type=del size=1621416 2024-02-23T06:34:23.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.266+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=A1D7PU2WJQWQ type=del 2024-02-23T06:34:23.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.267+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=FS3U66OTD21H type=del size=2907976 2024-02-23T06:34:23.269 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.268+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=CWK19U6QENFG type=del 2024-02-23T06:34:23.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.269+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=31OVZKPYV95L type=write size=272584 2024-02-23T06:34:23.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.270+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~1DM3AXE191OL.0 size=1048576 2024-02-23T06:34:23.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.271+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~1DM3AXE191OL.1 size=1048576 2024-02-23T06:34:23.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.272+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~1DM3AXE191OL.2 size=248425 2024-02-23T06:34:23.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.274+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=1DM3AXE191OL tag=QGBEK0UN0OPB type=write size=3394153 2024-02-23T06:34:23.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.276+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=ABQNYH89JEL8 type=del size=464367 2024-02-23T06:34:23.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.278+0000 7f5e72834780 1 < suggested update operation key=N8RXOY8X71MO tag=NYU51V2Y2QDY type=del size=3412834 2024-02-23T06:34:23.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.279+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=PJ7D3N47RN7U type=del size=3558715 2024-02-23T06:34:23.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.282+0000 7f5e72834780 1 < suggested remove operation key=N8RXOY8X71MO tag=2NDSQNXCAXWN type=del 2024-02-23T06:34:23.284 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.283+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=33LD2AYEVY0Y type=write size=82046 2024-02-23T06:34:23.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.284+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~6RJLKERGH6SJ.0 size=76845 2024-02-23T06:34:23.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.286+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=6RJLKERGH6SJ tag=7XDWCQO6VGUQ type=write size=1125421 2024-02-23T06:34:23.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.287+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=6S2P4NA2AKVK type=write size=343532 2024-02-23T06:34:23.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.289+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~FLQDJ6G1NP0G.0 size=1048576 2024-02-23T06:34:23.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.290+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~FLQDJ6G1NP0G.1 size=1048576 2024-02-23T06:34:23.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.291+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~FLQDJ6G1NP0G.2 size=353734 2024-02-23T06:34:23.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.293+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=FLQDJ6G1NP0G tag=N5HAGWLNVN8I type=write size=3499462 2024-02-23T06:34:23.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.294+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=YVKSDZYYIU2A type=del size=3229266 2024-02-23T06:34:23.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.296+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=PAA2104GKURF type=del 2024-02-23T06:34:23.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.298+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~SFG4O300ZO4D.0 size=1048576 2024-02-23T06:34:23.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.298+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~SFG4O300ZO4D.1 size=997810 2024-02-23T06:34:23.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.298+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=SFG4O300ZO4D tag=6HPRU009LUCF type=write size=3094962 2024-02-23T06:34:23.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.299+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=5PRPR6EYJLVY type=write size=633894 2024-02-23T06:34:23.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.301+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~I3IESMVBCBOZ.0 size=1048576 2024-02-23T06:34:23.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.302+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~I3IESMVBCBOZ.1 size=761186 2024-02-23T06:34:23.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.302+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=I3IESMVBCBOZ tag=CJOZT2YV3J7A type=write size=2858338 2024-02-23T06:34:23.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.305+0000 7f5e72834780 1 < suggested remove operation key=721UW0AGSKVR tag=O9LSUNS82MK9 type=write 2024-02-23T06:34:23.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.306+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=ZAOGT1Y9YCU3 type=del size=3707131 2024-02-23T06:34:23.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.307+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~1G6OQ0Q1O2C8.0 size=1048576 2024-02-23T06:34:23.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.307+0000 7f5e72834780 1 < canceled part key=_multipart_7N8OH7EETRN8.2~1G6OQ0Q1O2C8.1 size=1048576 2024-02-23T06:34:23.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.308+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~1G6OQ0Q1O2C8.2 size=89258 2024-02-23T06:34:23.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.310+0000 7f5e72834780 1 < canceled multipart upload key=7N8OH7EETRN8 upload=1G6OQ0Q1O2C8 tag=S1KDO9AHLIFZ type=write size=3234986 2024-02-23T06:34:23.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.311+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=COJQVRQBCRNQ type=del size=1924875 2024-02-23T06:34:23.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.312+0000 7f5e72834780 1 < canceled operation key=0WLEPDK2O30W tag=JOD5BKSZLJ20 type=del size=1944740 2024-02-23T06:34:23.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.314+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~AIM6S7ZN050Q.0 size=1048576 2024-02-23T06:34:23.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.315+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~AIM6S7ZN050Q.1 size=1048576 2024-02-23T06:34:23.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.316+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~AIM6S7ZN050Q.2 size=710314 2024-02-23T06:34:23.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.316+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=AIM6S7ZN050Q tag=CNWKIV10L6E4 type=write size=3856042 2024-02-23T06:34:23.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.317+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=WFPS7ZI4Q1YK type=del 2024-02-23T06:34:23.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.319+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~OWWT4GNQ0TSV.0 size=839593 2024-02-23T06:34:23.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.319+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=OWWT4GNQ0TSV tag=OBPJNOYX4T4W type=write size=1888169 2024-02-23T06:34:23.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.320+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=8II7ZHTEZ42E type=del 2024-02-23T06:34:23.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.322+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~W7KIL89QXFM7.0 size=485313 2024-02-23T06:34:23.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.322+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=W7KIL89QXFM7 tag=S0T9B1Z2ZIFO type=write size=1533889 2024-02-23T06:34:23.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.323+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~L9PZ26JKF2TU.0 size=1048576 2024-02-23T06:34:23.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.324+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~L9PZ26JKF2TU.1 size=50070 2024-02-23T06:34:23.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.327+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=L9PZ26JKF2TU tag=UVF9PENC7KKG type=write size=2147222 2024-02-23T06:34:23.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.328+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=29C0E236NJ9F type=write size=590795 2024-02-23T06:34:23.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.329+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=9TZRP3U1UZ8E type=del 2024-02-23T06:34:23.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.331+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~1QK4IY23W7OX.0 size=65836 2024-02-23T06:34:23.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.331+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=1QK4IY23W7OX tag=EH87TKX2GLOK type=write size=1114412 2024-02-23T06:34:23.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.332+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=FS3U66OTD21H type=del 2024-02-23T06:34:23.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.333+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=N64QW5NAOIV6 type=write size=115334 2024-02-23T06:34:23.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.335+0000 7f5e72834780 1 < suggested remove operation key=R4YA9DUAJABL tag=31OVZKPYV95L type=write 2024-02-23T06:34:23.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.337+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~FX3U1BZ7ZMFO.0 size=597935 2024-02-23T06:34:23.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.337+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=FX3U1BZ7ZMFO tag=2CKL36L78A4M type=write size=1646511 2024-02-23T06:34:23.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.339+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=ABQNYH89JEL8 type=del 2024-02-23T06:34:23.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.340+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=CBC03LE7MXVN type=write size=551099 2024-02-23T06:34:23.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.341+0000 7f5e72834780 -1 < failed to complete operation key=N8RXOY8X71MO tag=PJ7D3N47RN7U type=del size=3558715: (22) Invalid argument 2024-02-23T06:34:23.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.342+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=93JZJYGFHEGD type=write size=668082 2024-02-23T06:34:23.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.343+0000 7f5e72834780 1 < completed write operation key=ZM1YKZOUFSCY tag=33LD2AYEVY0Y type=write size=82046 2024-02-23T06:34:23.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.345+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~0DYZ34NSEYNW.0 size=1048576 2024-02-23T06:34:23.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.346+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~0DYZ34NSEYNW.1 size=696384 2024-02-23T06:34:23.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.347+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=0DYZ34NSEYNW tag=OWBB5MZD6XMD type=write size=2793536 2024-02-23T06:34:23.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.349+0000 7f5e72834780 1 < suggested update operation key=GW6EKQ84FQ6L tag=6S2P4NA2AKVK type=write size=343532 2024-02-23T06:34:23.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.350+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=0J4FAVSYUXDF type=del size=2153580 2024-02-23T06:34:23.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.351+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=YVKSDZYYIU2A type=del 2024-02-23T06:34:23.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.352+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=ZN01S35W0SCH type=del size=3583268 2024-02-23T06:34:23.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.353+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~SFG4O300ZO4D.0 size=1048576 2024-02-23T06:34:23.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.354+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~SFG4O300ZO4D.1 size=997810 2024-02-23T06:34:23.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.356+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=SFG4O300ZO4D tag=6HPRU009LUCF type=write size=3094962 2024-02-23T06:34:23.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.357+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=IJH2DBPAYCCB type=write size=31965 2024-02-23T06:34:23.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.358+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~I3IESMVBCBOZ.0 size=1048576 2024-02-23T06:34:23.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.359+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~I3IESMVBCBOZ.1 size=761186 2024-02-23T06:34:23.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.361+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=I3IESMVBCBOZ tag=CJOZT2YV3J7A type=write size=2858338 2024-02-23T06:34:23.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.363+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=LEHDSAMYAFWL type=write size=474605 2024-02-23T06:34:23.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.364+0000 7f5e72834780 1 < canceled operation key=M5LH10WTDP0P tag=ZAOGT1Y9YCU3 type=del size=3707131 2024-02-23T06:34:23.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.365+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=ZTFGCJGUJF13 type=del size=172195 2024-02-23T06:34:23.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.366+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=COJQVRQBCRNQ type=del 2024-02-23T06:34:23.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.367+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=PI3TWNDOBZAA type=del size=377429 2024-02-23T06:34:23.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.369+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~AIM6S7ZN050Q.0 size=1048576 2024-02-23T06:34:23.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.370+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~AIM6S7ZN050Q.1 size=1048576 2024-02-23T06:34:23.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.371+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~AIM6S7ZN050Q.2 size=710314 2024-02-23T06:34:23.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.373+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=AIM6S7ZN050Q tag=CNWKIV10L6E4 type=write size=3856042 2024-02-23T06:34:23.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.376+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~GHPB9KMVNF75.0 size=1048576 2024-02-23T06:34:23.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.377+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~GHPB9KMVNF75.1 size=1048576 2024-02-23T06:34:23.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.378+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~GHPB9KMVNF75.2 size=37661 2024-02-23T06:34:23.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.378+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=GHPB9KMVNF75 tag=0IW3ZCXIKA0H type=write size=3183389 2024-02-23T06:34:23.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.380+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~OWWT4GNQ0TSV.0 size=839593 2024-02-23T06:34:23.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.382+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=OWWT4GNQ0TSV tag=OBPJNOYX4T4W type=write size=1888169 2024-02-23T06:34:23.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.384+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~A0MIZCNEB88O.0 size=1040184 2024-02-23T06:34:23.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.384+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=A0MIZCNEB88O tag=KW7LR1E0DIJ2 type=write size=2088760 2024-02-23T06:34:23.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.385+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~W7KIL89QXFM7.0 size=485313 2024-02-23T06:34:23.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.387+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=W7KIL89QXFM7 tag=S0T9B1Z2ZIFO type=write size=1533889 2024-02-23T06:34:23.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.388+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=UZZ16CFCX12T type=del size=374180 2024-02-23T06:34:23.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.390+0000 7f5e72834780 1 < completed write operation key=GACVVXC2Z1YO tag=29C0E236NJ9F type=write size=590795 2024-02-23T06:34:23.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.392+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~9GNH3M7LXE8H.0 size=1048576 2024-02-23T06:34:23.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.393+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~9GNH3M7LXE8H.1 size=1048576 2024-02-23T06:34:23.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.393+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~9GNH3M7LXE8H.2 size=723408 2024-02-23T06:34:23.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.393+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=9GNH3M7LXE8H tag=QXP8M7ZM5AMI type=write size=3869136 2024-02-23T06:34:23.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.395+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~1QK4IY23W7OX.0 size=65836 2024-02-23T06:34:23.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.397+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=1QK4IY23W7OX tag=EH87TKX2GLOK type=write size=1114412 2024-02-23T06:34:23.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.398+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=DMKM2VY3YXBQ type=write size=68120 2024-02-23T06:34:23.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.399+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=N64QW5NAOIV6 type=write size=115334 2024-02-23T06:34:23.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.400+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=ZV380OOX6RPQ type=del size=2113648 2024-02-23T06:34:23.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.400+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~FX3U1BZ7ZMFO.0 size=597935 2024-02-23T06:34:23.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.402+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=FX3U1BZ7ZMFO tag=2CKL36L78A4M type=write size=1646511 2024-02-23T06:34:23.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.406+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~Z7GDZ18FTZOI.0 size=92385 2024-02-23T06:34:23.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.406+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=Z7GDZ18FTZOI tag=374JH7R5RDGZ type=write size=1140961 2024-02-23T06:34:23.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.407+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=CBC03LE7MXVN type=write size=551099 2024-02-23T06:34:23.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.409+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=IWJ82Z6TZ1GY type=write size=938240 2024-02-23T06:34:23.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.411+0000 7f5e72834780 1 < suggested remove operation key=MB8BZ2BXZE9M tag=93JZJYGFHEGD type=write 2024-02-23T06:34:23.414 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.413+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~RQI9OPNXFGC6.0 size=1048576 2024-02-23T06:34:23.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.414+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~RQI9OPNXFGC6.1 size=980099 2024-02-23T06:34:23.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.414+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=RQI9OPNXFGC6 tag=VRFPYQ6W13OM type=write size=3077251 2024-02-23T06:34:23.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.415+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~0DYZ34NSEYNW.0 size=1048576 2024-02-23T06:34:23.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.416+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~0DYZ34NSEYNW.1 size=696384 2024-02-23T06:34:23.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.418+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=0DYZ34NSEYNW tag=OWBB5MZD6XMD type=write size=2793536 2024-02-23T06:34:23.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.420+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~753S05NVXDSW.0 size=809813 2024-02-23T06:34:23.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.420+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=753S05NVXDSW tag=N2420ANN1B5S type=write size=1858389 2024-02-23T06:34:23.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.422+0000 7f5e72834780 1 < suggested remove operation key=N8RXOY8X71MO tag=0J4FAVSYUXDF type=del 2024-02-23T06:34:23.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.423+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=RPS5JN3OR8BP type=del size=3176074 2024-02-23T06:34:23.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.425+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=ZN01S35W0SCH type=del 2024-02-23T06:34:23.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.426+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=JKE410UDT7OX type=del size=2036127 2024-02-23T06:34:23.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.427+0000 7f5e72834780 1 < canceled operation key=26EE3EHDK8EM tag=IJH2DBPAYCCB type=write size=31965 2024-02-23T06:34:23.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.428+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=PFG1WYXDHU7Z type=del size=2720837 2024-02-23T06:34:23.430 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.429+0000 7f5e72834780 1 < completed write operation key=WK98HMHAZIUB tag=LEHDSAMYAFWL type=write size=474605 2024-02-23T06:34:23.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.431+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~AHBWX8EBED9O.0 size=532420 2024-02-23T06:34:23.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.431+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=AHBWX8EBED9O tag=PH9W01LLK0L2 type=write size=1580996 2024-02-23T06:34:23.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.432+0000 7f5e72834780 -1 < failed to complete operation key=MB8BZ2BXZE9M tag=ZTFGCJGUJF13 type=del size=172195: (22) Invalid argument 2024-02-23T06:34:23.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.434+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=PF62AFLPCX3X type=del size=1391 2024-02-23T06:34:23.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.435+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=PI3TWNDOBZAA type=del 2024-02-23T06:34:23.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.436+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=2S4BK1O8BQC7 type=del size=673086 2024-02-23T06:34:23.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.437+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~GHPB9KMVNF75.0 size=1048576 2024-02-23T06:34:23.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.438+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~GHPB9KMVNF75.1 size=1048576 2024-02-23T06:34:23.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.439+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~GHPB9KMVNF75.2 size=37661 2024-02-23T06:34:23.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.441+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=GHPB9KMVNF75 tag=0IW3ZCXIKA0H type=write size=3183389 2024-02-23T06:34:23.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.443+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~DLSMO9ZZVZI9.0 size=1048576 2024-02-23T06:34:23.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.444+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~DLSMO9ZZVZI9.1 size=1048576 2024-02-23T06:34:23.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.445+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~DLSMO9ZZVZI9.2 size=594884 2024-02-23T06:34:23.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.445+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=DLSMO9ZZVZI9 tag=CFC599IM35VT type=write size=3740612 2024-02-23T06:34:23.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.446+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~A0MIZCNEB88O.0 size=1040184 2024-02-23T06:34:23.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.448+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=A0MIZCNEB88O tag=KW7LR1E0DIJ2 type=write size=2088760 2024-02-23T06:34:23.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.449+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=6CACGB86THDF type=del size=2704518 2024-02-23T06:34:23.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.451+0000 7f5e72834780 1 < suggested update operation key=8Q6WC7B9BY5Q tag=UZZ16CFCX12T type=del size=374180 2024-02-23T06:34:23.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.453+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~CT7LCKIAJZUD.0 size=540289 2024-02-23T06:34:23.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.453+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=CT7LCKIAJZUD tag=UTKNAPJKU2FQ type=write size=1588865 2024-02-23T06:34:23.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.455+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~9GNH3M7LXE8H.0 size=1048576 2024-02-23T06:34:23.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.455+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~9GNH3M7LXE8H.1 size=1048576 2024-02-23T06:34:23.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.456+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~9GNH3M7LXE8H.2 size=723408 2024-02-23T06:34:23.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.458+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=9GNH3M7LXE8H tag=QXP8M7ZM5AMI type=write size=3869136 2024-02-23T06:34:23.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.459+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=EW1RH6EQ2Y9X type=del size=2994361 2024-02-23T06:34:23.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.462+0000 7f5e72834780 1 < suggested remove operation key=GWTK3YV0RY21 tag=DMKM2VY3YXBQ type=write 2024-02-23T06:34:23.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.463+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=R7JBOPIWEDJ3 type=del size=3141750 2024-02-23T06:34:23.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.464+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=ZV380OOX6RPQ type=del 2024-02-23T06:34:23.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.465+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=L4ZVEJKO92Z7 type=del size=2462395 2024-02-23T06:34:23.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.466+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~Z7GDZ18FTZOI.0 size=92385 2024-02-23T06:34:23.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.468+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=Z7GDZ18FTZOI tag=374JH7R5RDGZ type=write size=1140961 2024-02-23T06:34:23.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.469+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=U5LY6JK4VG73 type=del size=3702173 2024-02-23T06:34:23.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.470+0000 7f5e72834780 -1 < failed to complete operation key=N8RXOY8X71MO tag=IWJ82Z6TZ1GY type=write size=938240: (22) Invalid argument 2024-02-23T06:34:23.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.471+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=DC8J0YXANQNB type=del size=1451871 2024-02-23T06:34:23.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.472+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~RQI9OPNXFGC6.0 size=1048576 2024-02-23T06:34:23.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.473+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~RQI9OPNXFGC6.1 size=980099 2024-02-23T06:34:23.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.475+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=RQI9OPNXFGC6 tag=VRFPYQ6W13OM type=write size=3077251 2024-02-23T06:34:23.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.477+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~4623EUCOAEW0.0 size=1048576 2024-02-23T06:34:23.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.478+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~4623EUCOAEW0.1 size=868755 2024-02-23T06:34:23.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.478+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=4623EUCOAEW0 tag=QN6SYCAPJFCA type=write size=2965907 2024-02-23T06:34:23.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.480+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~753S05NVXDSW.0 size=809813 2024-02-23T06:34:23.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.482+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=753S05NVXDSW tag=N2420ANN1B5S type=write size=1858389 2024-02-23T06:34:23.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.484+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~D2D9210DKQ7A.0 size=1048576 2024-02-23T06:34:23.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.486+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~D2D9210DKQ7A.1 size=1048576 2024-02-23T06:34:23.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.487+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~D2D9210DKQ7A.2 size=178199 2024-02-23T06:34:23.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.487+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=D2D9210DKQ7A tag=TCE0A1XTMU3W type=write size=3323927 2024-02-23T06:34:23.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.490+0000 7f5e72834780 1 < suggested remove operation key=R4YA9DUAJABL tag=RPS5JN3OR8BP type=del 2024-02-23T06:34:23.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.492+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~KTKA7G7IM9D9.0 size=1048576 2024-02-23T06:34:23.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.493+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~KTKA7G7IM9D9.1 size=1048576 2024-02-23T06:34:23.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.494+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~KTKA7G7IM9D9.2 size=425967 2024-02-23T06:34:23.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.494+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=KTKA7G7IM9D9 tag=UY8HX9Q7LUQK type=write size=3571695 2024-02-23T06:34:23.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.496+0000 7f5e72834780 1 < suggested update operation key=MB8BZ2BXZE9M tag=JKE410UDT7OX type=del size=2036127 2024-02-23T06:34:23.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.498+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=1TSOLWLV37LO type=del size=1759729 2024-02-23T06:34:23.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.499+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=PFG1WYXDHU7Z type=del 2024-02-23T06:34:23.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.501+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~EQXV5QQ4O5AL.0 size=1048576 2024-02-23T06:34:23.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.502+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~EQXV5QQ4O5AL.1 size=89141 2024-02-23T06:34:23.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.502+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=EQXV5QQ4O5AL tag=YJ8S73VCEDT4 type=write size=2186293 2024-02-23T06:34:23.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.503+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~AHBWX8EBED9O.0 size=532420 2024-02-23T06:34:23.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.505+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=AHBWX8EBED9O tag=PH9W01LLK0L2 type=write size=1580996 2024-02-23T06:34:23.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.506+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=6E2YZ0MLYQ6Y type=write size=286306 2024-02-23T06:34:23.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.507+0000 7f5e72834780 1 < canceled operation key=0WLEPDK2O30W tag=PF62AFLPCX3X type=del size=1391 2024-02-23T06:34:23.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.509+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=78LZ2BY0W62C type=write size=722662 2024-02-23T06:34:23.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.511+0000 7f5e72834780 1 < suggested update operation key=0WLEPDK2O30W tag=2S4BK1O8BQC7 type=del size=673086 2024-02-23T06:34:23.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.512+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=32XWCB73WW1P type=del size=43747 2024-02-23T06:34:23.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.513+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~DLSMO9ZZVZI9.0 size=1048576 2024-02-23T06:34:23.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.514+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~DLSMO9ZZVZI9.1 size=1048576 2024-02-23T06:34:23.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.515+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~DLSMO9ZZVZI9.2 size=594884 2024-02-23T06:34:23.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.517+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=DLSMO9ZZVZI9 tag=CFC599IM35VT type=write size=3740612 2024-02-23T06:34:23.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.519+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~26P55LSZ09EK.0 size=1048576 2024-02-23T06:34:23.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.520+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~26P55LSZ09EK.1 size=427081 2024-02-23T06:34:23.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.520+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=26P55LSZ09EK tag=7G0VFLHHD334 type=write size=2524233 2024-02-23T06:34:23.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.521+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=6CACGB86THDF type=del size=2704518 2024-02-23T06:34:23.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.522+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=DRDACEHKRPA6 type=del size=3137311 2024-02-23T06:34:23.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.524+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~CT7LCKIAJZUD.0 size=540289 2024-02-23T06:34:23.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.526+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=CT7LCKIAJZUD tag=UTKNAPJKU2FQ type=write size=1588865 2024-02-23T06:34:23.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.528+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~QEEXY6G7Q81A.0 size=70983 2024-02-23T06:34:23.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.528+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=QEEXY6G7Q81A tag=6H715Z4GXDIV type=write size=1119559 2024-02-23T06:34:23.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.529+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=EW1RH6EQ2Y9X type=del 2024-02-23T06:34:23.532 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.531+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~5TEK082TECTU.0 size=1048576 2024-02-23T06:34:23.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.532+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~5TEK082TECTU.1 size=1048576 2024-02-23T06:34:23.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.533+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~5TEK082TECTU.2 size=1036269 2024-02-23T06:34:23.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.533+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=5TEK082TECTU tag=UJGTWRPEZ55F type=write size=4181997 2024-02-23T06:34:23.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.534+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=R7JBOPIWEDJ3 type=del 2024-02-23T06:34:23.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.536+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~VB6HDQBFZMR0.0 size=1048576 2024-02-23T06:34:23.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.537+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~VB6HDQBFZMR0.1 size=858022 2024-02-23T06:34:23.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.537+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=VB6HDQBFZMR0 tag=4I3MEAETXKMS type=write size=2955174 2024-02-23T06:34:23.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.539+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=L4ZVEJKO92Z7 type=del 2024-02-23T06:34:23.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.540+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=YJYR5J55NSKN type=del size=2020594 2024-02-23T06:34:23.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.541+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=U5LY6JK4VG73 type=del 2024-02-23T06:34:23.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.542+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=ZQQ8LSQMEC2A type=del size=723111 2024-02-23T06:34:23.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.544+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=DC8J0YXANQNB type=del 2024-02-23T06:34:23.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.545+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=KSU5W1CN8C4I type=del size=2676109 2024-02-23T06:34:23.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.546+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~4623EUCOAEW0.0 size=1048576 2024-02-23T06:34:23.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.547+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~4623EUCOAEW0.1 size=868755 2024-02-23T06:34:23.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.548+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=4623EUCOAEW0 tag=QN6SYCAPJFCA type=write size=2965907 2024-02-23T06:34:23.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.551+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~H1E2XOGEG1VA.0 size=1048576 2024-02-23T06:34:23.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.551+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~H1E2XOGEG1VA.1 size=111425 2024-02-23T06:34:23.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.551+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=H1E2XOGEG1VA tag=ZO9UVTH8TMT0 type=write size=2208577 2024-02-23T06:34:23.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.553+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~D2D9210DKQ7A.0 size=1048576 2024-02-23T06:34:23.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.554+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~D2D9210DKQ7A.1 size=1048576 2024-02-23T06:34:23.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.555+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~D2D9210DKQ7A.2 size=178199 2024-02-23T06:34:23.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.557+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=D2D9210DKQ7A tag=TCE0A1XTMU3W type=write size=3323927 2024-02-23T06:34:23.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.558+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=6SI1MQY0XEGU type=del size=675149 2024-02-23T06:34:23.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.559+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~KTKA7G7IM9D9.0 size=1048576 2024-02-23T06:34:23.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.560+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~KTKA7G7IM9D9.1 size=1048576 2024-02-23T06:34:23.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.561+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~KTKA7G7IM9D9.2 size=425967 2024-02-23T06:34:23.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.563+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=KTKA7G7IM9D9 tag=UY8HX9Q7LUQK type=write size=3571695 2024-02-23T06:34:23.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.564+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=JH7ROKI1JTVS type=del size=574842 2024-02-23T06:34:23.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.565+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=1TSOLWLV37LO type=del 2024-02-23T06:34:23.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.566+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=S75MM345G0BG type=write size=1032746 2024-02-23T06:34:23.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.567+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~EQXV5QQ4O5AL.0 size=1048576 2024-02-23T06:34:23.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.568+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~EQXV5QQ4O5AL.1 size=89141 2024-02-23T06:34:23.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.570+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=EQXV5QQ4O5AL tag=YJ8S73VCEDT4 type=write size=2186293 2024-02-23T06:34:23.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.571+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=PQ1HYEPTPBKS type=del size=2264732 2024-02-23T06:34:23.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.574+0000 7f5e72834780 1 < suggested remove operation key=7N8OH7EETRN8 tag=6E2YZ0MLYQ6Y type=write 2024-02-23T06:34:23.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.576+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~C2DZT7BIAYC6.0 size=1048576 2024-02-23T06:34:23.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.576+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~C2DZT7BIAYC6.1 size=1048576 2024-02-23T06:34:23.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.577+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~C2DZT7BIAYC6.2 size=814995 2024-02-23T06:34:23.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.577+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=C2DZT7BIAYC6 tag=OL3FJICC9X69 type=write size=3960723 2024-02-23T06:34:23.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.578+0000 7f5e72834780 1 < canceled operation key=N8RXOY8X71MO tag=78LZ2BY0W62C type=write size=722662 2024-02-23T06:34:23.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.581+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~35G2D2JKY5P4.0 size=771366 2024-02-23T06:34:23.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.581+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=35G2D2JKY5P4 tag=3JCXDCUB7TEB type=write size=1819942 2024-02-23T06:34:23.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.582+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=32XWCB73WW1P type=del 2024-02-23T06:34:23.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.583+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=INS12BERDTCV type=del size=1393054 2024-02-23T06:34:23.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.584+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~26P55LSZ09EK.0 size=1048576 2024-02-23T06:34:23.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.585+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~26P55LSZ09EK.1 size=427081 2024-02-23T06:34:23.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.587+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=26P55LSZ09EK tag=7G0VFLHHD334 type=write size=2524233 2024-02-23T06:34:23.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.589+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~BA5KUGS895W3.0 size=1048576 2024-02-23T06:34:23.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.590+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~BA5KUGS895W3.1 size=1048576 2024-02-23T06:34:23.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.590+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~BA5KUGS895W3.2 size=538741 2024-02-23T06:34:23.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.590+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=BA5KUGS895W3 tag=F99A846ERKZO type=write size=3684469 2024-02-23T06:34:23.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.594+0000 7f5e72834780 1 < suggested remove operation key=MB8BZ2BXZE9M tag=DRDACEHKRPA6 type=del 2024-02-23T06:34:23.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.595+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=TS7K93WQ7E51 type=del size=2659542 2024-02-23T06:34:23.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.596+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~QEEXY6G7Q81A.0 size=70983 2024-02-23T06:34:23.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.598+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=QEEXY6G7Q81A tag=6H715Z4GXDIV type=write size=1119559 2024-02-23T06:34:23.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.599+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=2AGLYC4TGZV7 type=del size=2014036 2024-02-23T06:34:23.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.600+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~5TEK082TECTU.0 size=1048576 2024-02-23T06:34:23.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.601+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~5TEK082TECTU.1 size=1048576 2024-02-23T06:34:23.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.601+0000 7f5e72834780 1 < canceled part key=_multipart_IDTA5RV6IUF6.2~5TEK082TECTU.2 size=1036269 2024-02-23T06:34:23.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.603+0000 7f5e72834780 1 < canceled multipart upload key=IDTA5RV6IUF6 upload=5TEK082TECTU tag=UJGTWRPEZ55F type=write size=4181997 2024-02-23T06:34:23.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.604+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=AYBWEYH80333 type=del size=1386318 2024-02-23T06:34:23.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.605+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~VB6HDQBFZMR0.0 size=1048576 2024-02-23T06:34:23.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.606+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~VB6HDQBFZMR0.1 size=858022 2024-02-23T06:34:23.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.608+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=VB6HDQBFZMR0 tag=4I3MEAETXKMS type=write size=2955174 2024-02-23T06:34:23.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.610+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~EOIX8W5FPTEO.0 size=1048576 2024-02-23T06:34:23.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.611+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~EOIX8W5FPTEO.1 size=1048576 2024-02-23T06:34:23.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.612+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~EOIX8W5FPTEO.2 size=906069 2024-02-23T06:34:23.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.612+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=EOIX8W5FPTEO tag=2OM5MKMLZ6KL type=write size=4051797 2024-02-23T06:34:23.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.614+0000 7f5e72834780 1 < suggested remove operation key=0WLEPDK2O30W tag=YJYR5J55NSKN type=del 2024-02-23T06:34:23.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.615+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=9BAHP0KWT4HV type=write size=491927 2024-02-23T06:34:23.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.617+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=ZQQ8LSQMEC2A type=del 2024-02-23T06:34:23.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.618+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=5JZD5PHO23EC type=del size=4111519 2024-02-23T06:34:23.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.619+0000 7f5e72834780 1 < canceled operation key=VEJ6D2J3LZI8 tag=KSU5W1CN8C4I type=del size=2676109 2024-02-23T06:34:23.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.621+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~X1XRBB16F7F1.0 size=600977 2024-02-23T06:34:23.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.621+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=X1XRBB16F7F1 tag=XH0MWQZXFAGJ type=write size=1649553 2024-02-23T06:34:23.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.621+0000 7f5e72834780 1 < canceled part key=_multipart_JV6FJONY04AW.2~H1E2XOGEG1VA.0 size=1048576 2024-02-23T06:34:23.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.621+0000 7f5e72834780 1 < canceled part key=_multipart_JV6FJONY04AW.2~H1E2XOGEG1VA.1 size=111425 2024-02-23T06:34:23.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.623+0000 7f5e72834780 1 < canceled multipart upload key=JV6FJONY04AW upload=H1E2XOGEG1VA tag=ZO9UVTH8TMT0 type=write size=2208577 2024-02-23T06:34:23.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.626+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~41CDMF88GM32.0 size=1048576 2024-02-23T06:34:23.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.627+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~41CDMF88GM32.1 size=1048576 2024-02-23T06:34:23.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.628+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~41CDMF88GM32.2 size=113554 2024-02-23T06:34:23.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.628+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=41CDMF88GM32 tag=SMALMAX6HCMG type=write size=3259282 2024-02-23T06:34:23.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.629+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=6SI1MQY0XEGU type=del 2024-02-23T06:34:23.631 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.630+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=LG35203EBKO1 type=write size=320834 2024-02-23T06:34:23.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.632+0000 7f5e72834780 1 < suggested update operation key=GWTK3YV0RY21 tag=JH7ROKI1JTVS type=del size=574842 2024-02-23T06:34:23.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.634+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~ULK9FYE8OVHG.0 size=540515 2024-02-23T06:34:23.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.634+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=ULK9FYE8OVHG tag=8I3SLACT605Z type=write size=1589091 2024-02-23T06:34:23.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.637+0000 7f5e72834780 1 < suggested remove operation key=VEJ6D2J3LZI8 tag=S75MM345G0BG type=write 2024-02-23T06:34:23.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.638+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=SATE7EA15QJN type=write size=725601 2024-02-23T06:34:23.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.639+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=PQ1HYEPTPBKS type=del 2024-02-23T06:34:23.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.640+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=KQCTUC4HKLEQ type=del size=2289127 2024-02-23T06:34:23.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.641+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~C2DZT7BIAYC6.0 size=1048576 2024-02-23T06:34:23.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.641+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~C2DZT7BIAYC6.1 size=1048576 2024-02-23T06:34:23.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.642+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~C2DZT7BIAYC6.2 size=814995 2024-02-23T06:34:23.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.644+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=C2DZT7BIAYC6 tag=OL3FJICC9X69 type=write size=3960723 2024-02-23T06:34:23.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.645+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=9L1BFB5OI667 type=del size=995485 2024-02-23T06:34:23.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.646+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~35G2D2JKY5P4.0 size=771366 2024-02-23T06:34:23.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.648+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=35G2D2JKY5P4 tag=3JCXDCUB7TEB type=write size=1819942 2024-02-23T06:34:23.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.650+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GCO20YG30M70.0 size=1048576 2024-02-23T06:34:23.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.651+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GCO20YG30M70.1 size=1048576 2024-02-23T06:34:23.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.652+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GCO20YG30M70.2 size=270221 2024-02-23T06:34:23.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.652+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=GCO20YG30M70 tag=U0ELXJSE71S1 type=write size=3415949 2024-02-23T06:34:23.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.653+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=INS12BERDTCV type=del 2024-02-23T06:34:23.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.655+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~6PERH4H3LHKM.0 size=1048576 2024-02-23T06:34:23.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.656+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~6PERH4H3LHKM.1 size=1048576 2024-02-23T06:34:23.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.657+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~6PERH4H3LHKM.2 size=92050 2024-02-23T06:34:23.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.657+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=6PERH4H3LHKM tag=XN5PYG5GMSQB type=write size=3237778 2024-02-23T06:34:23.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.658+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~BA5KUGS895W3.0 size=1048576 2024-02-23T06:34:23.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.659+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~BA5KUGS895W3.1 size=1048576 2024-02-23T06:34:23.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.660+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~BA5KUGS895W3.2 size=538741 2024-02-23T06:34:23.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.662+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=BA5KUGS895W3 tag=F99A846ERKZO type=write size=3684469 2024-02-23T06:34:23.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.664+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~F9UL0RVRRLSN.0 size=836553 2024-02-23T06:34:23.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.664+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=F9UL0RVRRLSN tag=B7UYJMG95NGG type=write size=1885129 2024-02-23T06:34:23.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.667+0000 7f5e72834780 1 < suggested update operation key=ZC75CQ2789VE tag=TS7K93WQ7E51 type=del size=2659542 2024-02-23T06:34:23.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.668+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=WWPKF9N2FPPV type=del size=2123523 2024-02-23T06:34:23.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.669+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=2AGLYC4TGZV7 type=del 2024-02-23T06:34:23.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.671+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=CZRVEW7Q6S5F type=del size=2977036 2024-02-23T06:34:23.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.672+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=AYBWEYH80333 type=del 2024-02-23T06:34:23.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.673+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=DQ2YKU9XBCSY type=del size=3768718 2024-02-23T06:34:23.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.674+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~EOIX8W5FPTEO.0 size=1048576 2024-02-23T06:34:23.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.675+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~EOIX8W5FPTEO.1 size=1048576 2024-02-23T06:34:23.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.676+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~EOIX8W5FPTEO.2 size=906069 2024-02-23T06:34:23.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.678+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=EOIX8W5FPTEO tag=2OM5MKMLZ6KL type=write size=4051797 2024-02-23T06:34:23.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.679+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=KJLKX0TDOFXI type=write size=17932 2024-02-23T06:34:23.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.680+0000 7f5e72834780 1 < completed write operation key=4M7BT05YB0C3 tag=9BAHP0KWT4HV type=write size=491927 2024-02-23T06:34:23.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.682+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=7LEPY00ODEL7 type=del size=569599 2024-02-23T06:34:23.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.683+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=5JZD5PHO23EC type=del 2024-02-23T06:34:23.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.684+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=8T8BME26MFR6 type=write size=980856 2024-02-23T06:34:23.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.685+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~X1XRBB16F7F1.0 size=600977 2024-02-23T06:34:23.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.687+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=X1XRBB16F7F1 tag=XH0MWQZXFAGJ type=write size=1649553 2024-02-23T06:34:23.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.688+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=2UQBQSXN8TNS type=del size=3096842 2024-02-23T06:34:23.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.690+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~41CDMF88GM32.0 size=1048576 2024-02-23T06:34:23.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.690+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~41CDMF88GM32.1 size=1048576 2024-02-23T06:34:23.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.690+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~41CDMF88GM32.2 size=113554 2024-02-23T06:34:23.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.693+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=41CDMF88GM32 tag=SMALMAX6HCMG type=write size=3259282 2024-02-23T06:34:23.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.695+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~0G00PIM2QHT3.0 size=1048576 2024-02-23T06:34:23.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.696+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~0G00PIM2QHT3.1 size=1048576 2024-02-23T06:34:23.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.697+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~0G00PIM2QHT3.2 size=645462 2024-02-23T06:34:23.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.697+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=0G00PIM2QHT3 tag=UBNHDVIN4OE6 type=write size=3791190 2024-02-23T06:34:23.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.698+0000 7f5e72834780 1 < canceled operation key=QGGULCYZ0ZSA tag=LG35203EBKO1 type=write size=320834 2024-02-23T06:34:23.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.701+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~FX3GZ0MJN6HX.0 size=1048576 2024-02-23T06:34:23.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.703+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~FX3GZ0MJN6HX.1 size=319096 2024-02-23T06:34:23.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.703+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=FX3GZ0MJN6HX tag=K970VDFUI4KH type=write size=2416248 2024-02-23T06:34:23.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.704+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~ULK9FYE8OVHG.0 size=540515 2024-02-23T06:34:23.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.708+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=ULK9FYE8OVHG tag=8I3SLACT605Z type=write size=1589091 2024-02-23T06:34:23.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.709+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=KO3QV4XWH3SC type=del size=1549142 2024-02-23T06:34:23.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.711+0000 7f5e72834780 1 < completed write operation key=883VBT1ADE6K tag=SATE7EA15QJN type=write size=725601 2024-02-23T06:34:23.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.712+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=0J3QU8B2J3M8 type=del size=2827552 2024-02-23T06:34:23.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.715+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=KQCTUC4HKLEQ type=del size=2289127 2024-02-23T06:34:23.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.716+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=M0HC5840WKIU type=del size=2558817 2024-02-23T06:34:23.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.717+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=9L1BFB5OI667 type=del 2024-02-23T06:34:23.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.718+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=HGQ1E87I1HX0 type=del size=918767 2024-02-23T06:34:23.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.720+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GCO20YG30M70.0 size=1048576 2024-02-23T06:34:23.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.721+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GCO20YG30M70.1 size=1048576 2024-02-23T06:34:23.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.722+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GCO20YG30M70.2 size=270221 2024-02-23T06:34:23.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.724+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=GCO20YG30M70 tag=U0ELXJSE71S1 type=write size=3415949 2024-02-23T06:34:23.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.725+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=IEM555AYVNK3 type=write size=327845 2024-02-23T06:34:23.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.726+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~6PERH4H3LHKM.0 size=1048576 2024-02-23T06:34:23.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.727+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~6PERH4H3LHKM.1 size=1048576 2024-02-23T06:34:23.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.728+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~6PERH4H3LHKM.2 size=92050 2024-02-23T06:34:23.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.730+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=6PERH4H3LHKM tag=XN5PYG5GMSQB type=write size=3237778 2024-02-23T06:34:23.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.732+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=BMIJHRLOMVQX type=del size=1032317 2024-02-23T06:34:23.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.733+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~F9UL0RVRRLSN.0 size=836553 2024-02-23T06:34:23.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.735+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=F9UL0RVRRLSN tag=B7UYJMG95NGG type=write size=1885129 2024-02-23T06:34:23.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.736+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=3CRP2YZ1WDY0 type=write size=91606 2024-02-23T06:34:23.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.737+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=WWPKF9N2FPPV type=del 2024-02-23T06:34:23.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.739+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HUG959Y1ISYN.0 size=1048576 2024-02-23T06:34:23.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.740+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~HUG959Y1ISYN.1 size=147617 2024-02-23T06:34:23.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.740+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=HUG959Y1ISYN tag=53O3A6HJGR11 type=write size=2244769 2024-02-23T06:34:23.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.742+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=CZRVEW7Q6S5F type=del 2024-02-23T06:34:23.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.743+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=RYWQGVSIMU8A type=del size=3603010 2024-02-23T06:34:23.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.744+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=DQ2YKU9XBCSY type=del 2024-02-23T06:34:23.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.745+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=2UQEAOZ67TL6 type=write size=417216 2024-02-23T06:34:23.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.747+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=KJLKX0TDOFXI type=write size=17932 2024-02-23T06:34:23.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.748+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=CVXWHYEYHGRN type=del size=2763618 2024-02-23T06:34:23.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.749+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=7LEPY00ODEL7 type=del 2024-02-23T06:34:23.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.750+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=4ISB6BBRQFKU type=del size=3733120 2024-02-23T06:34:23.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.751+0000 7f5e72834780 1 < completed write operation key=883VBT1ADE6K tag=8T8BME26MFR6 type=write size=980856 2024-02-23T06:34:23.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.753+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~1EUZBL7W97K3.0 size=109403 2024-02-23T06:34:23.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.753+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=1EUZBL7W97K3 tag=3I0WTUL167QV type=write size=1157979 2024-02-23T06:34:23.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.754+0000 7f5e72834780 1 < canceled operation key=TPADM4812N0Z tag=2UQBQSXN8TNS type=del size=3096842 2024-02-23T06:34:23.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.756+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=PDIY9OFH5USC type=write size=994804 2024-02-23T06:34:23.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.757+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~0G00PIM2QHT3.0 size=1048576 2024-02-23T06:34:23.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.758+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~0G00PIM2QHT3.1 size=1048576 2024-02-23T06:34:23.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.759+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~0G00PIM2QHT3.2 size=645462 2024-02-23T06:34:23.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.761+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=0G00PIM2QHT3 tag=UBNHDVIN4OE6 type=write size=3791190 2024-02-23T06:34:23.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.763+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~S3JF8BMYAURF.0 size=768168 2024-02-23T06:34:23.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.763+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=S3JF8BMYAURF tag=GXSESOCXDFEB type=write size=1816744 2024-02-23T06:34:23.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.764+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~FX3GZ0MJN6HX.0 size=1048576 2024-02-23T06:34:23.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.764+0000 7f5e72834780 1 < canceled part key=_multipart_M5LH10WTDP0P.2~FX3GZ0MJN6HX.1 size=319096 2024-02-23T06:34:23.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.766+0000 7f5e72834780 1 < canceled multipart upload key=M5LH10WTDP0P upload=FX3GZ0MJN6HX tag=K970VDFUI4KH type=write size=2416248 2024-02-23T06:34:23.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.768+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~JIOQSJB1H2YJ.0 size=1048576 2024-02-23T06:34:23.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.769+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~JIOQSJB1H2YJ.1 size=1048576 2024-02-23T06:34:23.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.770+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~JIOQSJB1H2YJ.2 size=46529 2024-02-23T06:34:23.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.770+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=JIOQSJB1H2YJ tag=ARQO5DUA8L8F type=write size=3192257 2024-02-23T06:34:23.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.771+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=KO3QV4XWH3SC type=del 2024-02-23T06:34:23.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.772+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=4V0QSEW5TG89 type=del size=2622346 2024-02-23T06:34:23.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.774+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=0J3QU8B2J3M8 type=del 2024-02-23T06:34:23.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.775+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=BM83A3Z2SJMB type=del size=759869 2024-02-23T06:34:23.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.777+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=M0HC5840WKIU type=del 2024-02-23T06:34:23.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.779+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~D2G0O11UMHQ3.0 size=1048576 2024-02-23T06:34:23.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.780+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~D2G0O11UMHQ3.1 size=581545 2024-02-23T06:34:23.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.780+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=D2G0O11UMHQ3 tag=1TPCZE4DWGLE type=write size=2678697 2024-02-23T06:34:23.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.781+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=HGQ1E87I1HX0 type=del 2024-02-23T06:34:23.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.783+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=B2XWVIM2UDM5 type=del size=1396039 2024-02-23T06:34:23.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.785+0000 7f5e72834780 1 < suggested update operation key=LUERFL6AN6HF tag=IEM555AYVNK3 type=write size=327845 2024-02-23T06:34:23.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.787+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=Y01GD5DKP3CL type=write size=469821 2024-02-23T06:34:23.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.788+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=BMIJHRLOMVQX type=del 2024-02-23T06:34:23.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.789+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=OP1U1CKE8BY1 type=write size=238673 2024-02-23T06:34:23.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.791+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=3CRP2YZ1WDY0 type=write size=91606 2024-02-23T06:34:23.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.793+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~W5L3LT5XQ24D.0 size=1048576 2024-02-23T06:34:23.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.794+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~W5L3LT5XQ24D.1 size=1048576 2024-02-23T06:34:23.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.795+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~W5L3LT5XQ24D.2 size=223610 2024-02-23T06:34:23.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.795+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=W5L3LT5XQ24D tag=ZRLV0V4MATJH type=write size=3369338 2024-02-23T06:34:23.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.796+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HUG959Y1ISYN.0 size=1048576 2024-02-23T06:34:23.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.797+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~HUG959Y1ISYN.1 size=147617 2024-02-23T06:34:23.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.799+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=HUG959Y1ISYN tag=53O3A6HJGR11 type=write size=2244769 2024-02-23T06:34:23.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.800+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=DBS5B0DE9BHM type=del size=1749989 2024-02-23T06:34:23.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.802+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=RYWQGVSIMU8A type=del 2024-02-23T06:34:23.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.804+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~P6LQ4G2TLVHV.0 size=1048576 2024-02-23T06:34:23.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.805+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~P6LQ4G2TLVHV.1 size=751016 2024-02-23T06:34:23.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.805+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=P6LQ4G2TLVHV tag=UTZ862T2ZOVG type=write size=2848168 2024-02-23T06:34:23.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.806+0000 7f5e72834780 1 < completed write operation key=WETP4ONTU3HL tag=2UQEAOZ67TL6 type=write size=417216 2024-02-23T06:34:23.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.808+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~I25VIHKPCFOB.0 size=1048576 2024-02-23T06:34:23.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.809+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~I25VIHKPCFOB.1 size=763627 2024-02-23T06:34:23.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.809+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=I25VIHKPCFOB tag=IYFYJ7M7LRYB type=write size=2860779 2024-02-23T06:34:23.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.810+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=CVXWHYEYHGRN type=del size=2763618 2024-02-23T06:34:23.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.812+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=S1Q74YO8R50M type=del size=2794921 2024-02-23T06:34:23.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.813+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=4ISB6BBRQFKU type=del 2024-02-23T06:34:23.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.814+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=754A4RMJ26CM type=write size=915931 2024-02-23T06:34:23.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.814+0000 7f5e72834780 1 < canceled part key=_multipart_RS03NUABC1U2.2~1EUZBL7W97K3.0 size=109403 2024-02-23T06:34:23.817 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.816+0000 7f5e72834780 1 < canceled multipart upload key=RS03NUABC1U2 upload=1EUZBL7W97K3 tag=3I0WTUL167QV type=write size=1157979 2024-02-23T06:34:23.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.818+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~38QLJLPDFDMA.0 size=701865 2024-02-23T06:34:23.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.818+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=38QLJLPDFDMA tag=1IS630XG9BMT type=write size=1750441 2024-02-23T06:34:23.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.820+0000 7f5e72834780 1 < completed write operation key=8Q6WC7B9BY5Q tag=PDIY9OFH5USC type=write size=994804 2024-02-23T06:34:23.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.822+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=UB0ETCYGPNDR type=del size=2815663 2024-02-23T06:34:23.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.823+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~S3JF8BMYAURF.0 size=768168 2024-02-23T06:34:23.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.825+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=S3JF8BMYAURF tag=GXSESOCXDFEB type=write size=1816744 2024-02-23T06:34:23.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.827+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~N4P4AN2TEYWS.0 size=75707 2024-02-23T06:34:23.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.827+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=N4P4AN2TEYWS tag=DNK9R2AL98WA type=write size=1124283 2024-02-23T06:34:23.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.828+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~JIOQSJB1H2YJ.0 size=1048576 2024-02-23T06:34:23.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.829+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~JIOQSJB1H2YJ.1 size=1048576 2024-02-23T06:34:23.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.830+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~JIOQSJB1H2YJ.2 size=46529 2024-02-23T06:34:23.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.831+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=JIOQSJB1H2YJ tag=ARQO5DUA8L8F type=write size=3192257 2024-02-23T06:34:23.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.833+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=6R4F6S8EGR41 type=write size=971983 2024-02-23T06:34:23.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.835+0000 7f5e72834780 1 < suggested remove operation key=GW6EKQ84FQ6L tag=4V0QSEW5TG89 type=del 2024-02-23T06:34:23.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.836+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=O6VVOXQS365B type=del size=632358 2024-02-23T06:34:23.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.838+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=BM83A3Z2SJMB type=del 2024-02-23T06:34:23.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.840+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~EW679LQF2Q2P.0 size=1048576 2024-02-23T06:34:23.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.841+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~EW679LQF2Q2P.1 size=436841 2024-02-23T06:34:23.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.841+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=EW679LQF2Q2P tag=CHG9N7G1S05Z type=write size=2533993 2024-02-23T06:34:23.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.843+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~D2G0O11UMHQ3.0 size=1048576 2024-02-23T06:34:23.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.845+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~D2G0O11UMHQ3.1 size=581545 2024-02-23T06:34:23.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.847+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=D2G0O11UMHQ3 tag=1TPCZE4DWGLE type=write size=2678697 2024-02-23T06:34:23.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.848+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=IW80DDPYH1R0 type=write size=317828 2024-02-23T06:34:23.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.849+0000 7f5e72834780 1 < canceled operation key=WK98HMHAZIUB tag=B2XWVIM2UDM5 type=del size=1396039 2024-02-23T06:34:23.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.850+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=253HIYBP131K type=del size=3133180 2024-02-23T06:34:23.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.851+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=Y01GD5DKP3CL type=write size=469821 2024-02-23T06:34:23.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.852+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=IVD3J4MDH7Y6 type=write size=359498 2024-02-23T06:34:23.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.854+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=OP1U1CKE8BY1 type=write size=238673 2024-02-23T06:34:23.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.855+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=YCC20D2UBC08 type=del size=906119 2024-02-23T06:34:23.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.856+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~W5L3LT5XQ24D.0 size=1048576 2024-02-23T06:34:23.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.857+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~W5L3LT5XQ24D.1 size=1048576 2024-02-23T06:34:23.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.858+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~W5L3LT5XQ24D.2 size=223610 2024-02-23T06:34:23.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.860+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=W5L3LT5XQ24D tag=ZRLV0V4MATJH type=write size=3369338 2024-02-23T06:34:23.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.861+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=AHGRJ46G02ID type=write size=452573 2024-02-23T06:34:23.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.862+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=DBS5B0DE9BHM type=del 2024-02-23T06:34:23.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.864+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~M6NN31WG1K3S.0 size=368678 2024-02-23T06:34:23.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.864+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=M6NN31WG1K3S tag=CLNLB6NB5G1V type=write size=1417254 2024-02-23T06:34:23.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.865+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~P6LQ4G2TLVHV.0 size=1048576 2024-02-23T06:34:23.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.866+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~P6LQ4G2TLVHV.1 size=751016 2024-02-23T06:34:23.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.868+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=P6LQ4G2TLVHV tag=UTZ862T2ZOVG type=write size=2848168 2024-02-23T06:34:23.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.869+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=2IIIIFL2GSZN type=del size=390038 2024-02-23T06:34:23.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.870+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~I25VIHKPCFOB.0 size=1048576 2024-02-23T06:34:23.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.871+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~I25VIHKPCFOB.1 size=763627 2024-02-23T06:34:23.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.873+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=I25VIHKPCFOB tag=IYFYJ7M7LRYB type=write size=2860779 2024-02-23T06:34:23.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.875+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~ZG6DN8RB1EEZ.0 size=888541 2024-02-23T06:34:23.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.875+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=ZG6DN8RB1EEZ tag=I3N9KL0HZTOQ type=write size=1937117 2024-02-23T06:34:23.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.876+0000 7f5e72834780 1 < canceled operation key=JV6FJONY04AW tag=S1Q74YO8R50M type=del size=2794921 2024-02-23T06:34:23.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.879+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~30QO458ALOB2.0 size=1048576 2024-02-23T06:34:23.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.879+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~30QO458ALOB2.1 size=1048576 2024-02-23T06:34:23.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.880+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~30QO458ALOB2.2 size=546721 2024-02-23T06:34:23.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.880+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=30QO458ALOB2 tag=JZ1AI2HAINUR type=write size=3692449 2024-02-23T06:34:23.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.883+0000 7f5e72834780 1 < suggested update operation key=4M7BT05YB0C3 tag=754A4RMJ26CM type=write size=915931 2024-02-23T06:34:23.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.884+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=MC8ONFUI3LNL type=del size=116371 2024-02-23T06:34:23.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.885+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~38QLJLPDFDMA.0 size=701865 2024-02-23T06:34:23.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.887+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=38QLJLPDFDMA tag=1IS630XG9BMT type=write size=1750441 2024-02-23T06:34:23.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.888+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=CQ68OEM91TA6 type=write size=875837 2024-02-23T06:34:23.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.889+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=UB0ETCYGPNDR type=del 2024-02-23T06:34:23.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.890+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=J0QUJONPQ3NI type=del size=2062868 2024-02-23T06:34:23.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.891+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~N4P4AN2TEYWS.0 size=75707 2024-02-23T06:34:23.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.893+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=N4P4AN2TEYWS tag=DNK9R2AL98WA type=write size=1124283 2024-02-23T06:34:23.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.895+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~P3Q99QB6GDFC.0 size=937269 2024-02-23T06:34:23.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.895+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=P3Q99QB6GDFC tag=IOKJ3WV9EFF8 type=write size=1985845 2024-02-23T06:34:23.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.897+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=6R4F6S8EGR41 type=write size=971983 2024-02-23T06:34:23.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.898+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=6WVX901LVM34 type=write size=1002801 2024-02-23T06:34:23.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.899+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=O6VVOXQS365B type=del 2024-02-23T06:34:23.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.900+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=N864TQ6KY9NN type=del size=3476441 2024-02-23T06:34:23.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.901+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~EW679LQF2Q2P.0 size=1048576 2024-02-23T06:34:23.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.902+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~EW679LQF2Q2P.1 size=436841 2024-02-23T06:34:23.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.904+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=EW679LQF2Q2P tag=CHG9N7G1S05Z type=write size=2533993 2024-02-23T06:34:23.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.906+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=DXTYGJ4XK6PM type=write size=941264 2024-02-23T06:34:23.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.907+0000 7f5e72834780 1 < completed write operation key=9ZCNDGBEPWMN tag=IW80DDPYH1R0 type=write size=317828 2024-02-23T06:34:23.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.908+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=8N5KAVVJ1BHK type=del size=785860 2024-02-23T06:34:23.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.909+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=253HIYBP131K type=del 2024-02-23T06:34:23.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.911+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~T712P03M6QYR.0 size=1048576 2024-02-23T06:34:23.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.912+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~T712P03M6QYR.1 size=1048576 2024-02-23T06:34:23.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.913+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~T712P03M6QYR.2 size=405687 2024-02-23T06:34:23.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.913+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=T712P03M6QYR tag=GQ3PVFSF0CND type=write size=3551415 2024-02-23T06:34:23.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.914+0000 7f5e72834780 1 < canceled operation key=26EE3EHDK8EM tag=IVD3J4MDH7Y6 type=write size=359498 2024-02-23T06:34:23.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.915+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=OOT6FZYR3FS2 type=del size=203350 2024-02-23T06:34:23.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.918+0000 7f5e72834780 1 < suggested remove operation key=4M7BT05YB0C3 tag=YCC20D2UBC08 type=del 2024-02-23T06:34:23.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.919+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=9U10ZWVR0387 type=del size=1723265 2024-02-23T06:34:23.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.920+0000 7f5e72834780 1 < completed write operation key=MB8BZ2BXZE9M tag=AHGRJ46G02ID type=write size=452573 2024-02-23T06:34:23.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.922+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=N4A52LH300BD type=del size=3960601 2024-02-23T06:34:23.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.923+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~M6NN31WG1K3S.0 size=368678 2024-02-23T06:34:23.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.924+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=M6NN31WG1K3S tag=CLNLB6NB5G1V type=write size=1417254 2024-02-23T06:34:23.927 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.926+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=9O5E82YZISEJ type=write size=331136 2024-02-23T06:34:23.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.927+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=2IIIIFL2GSZN type=del 2024-02-23T06:34:23.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.928+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=JO82FM3GM262 type=del size=2830429 2024-02-23T06:34:23.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.930+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~ZG6DN8RB1EEZ.0 size=888541 2024-02-23T06:34:23.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.935+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=ZG6DN8RB1EEZ tag=I3N9KL0HZTOQ type=write size=1937117 2024-02-23T06:34:23.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.938+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RU4AZX1TO2QX.0 size=1048576 2024-02-23T06:34:23.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.939+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RU4AZX1TO2QX.1 size=509533 2024-02-23T06:34:23.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.939+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=RU4AZX1TO2QX tag=O3X5C7FBSCIH type=write size=2606685 2024-02-23T06:34:23.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.941+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~30QO458ALOB2.0 size=1048576 2024-02-23T06:34:23.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.941+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~30QO458ALOB2.1 size=1048576 2024-02-23T06:34:23.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.942+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~30QO458ALOB2.2 size=546721 2024-02-23T06:34:23.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.944+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=30QO458ALOB2 tag=JZ1AI2HAINUR type=write size=3692449 2024-02-23T06:34:23.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.946+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~SCNIHHI5UV58.0 size=1048576 2024-02-23T06:34:23.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.947+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~SCNIHHI5UV58.1 size=1048576 2024-02-23T06:34:23.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.948+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~SCNIHHI5UV58.2 size=284711 2024-02-23T06:34:23.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.948+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=SCNIHHI5UV58 tag=G4GNBSMMU8QN type=write size=3430439 2024-02-23T06:34:23.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.951+0000 7f5e72834780 1 < suggested remove operation key=8Q6WC7B9BY5Q tag=MC8ONFUI3LNL type=del 2024-02-23T06:34:23.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.952+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=DE5Z1043PX1U type=del size=2255957 2024-02-23T06:34:23.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.952+0000 7f5e72834780 -1 < no bi entry to suggest for operation key=4M7BT05YB0C3 tag=CQ68OEM91TA6 type=write size=875837: (2) No such file or directory 2024-02-23T06:34:23.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.953+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=WBK886LFOZ4R type=write size=219548 2024-02-23T06:34:23.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.955+0000 7f5e72834780 1 < canceled operation key=IDTA5RV6IUF6 tag=J0QUJONPQ3NI type=del size=2062868 2024-02-23T06:34:23.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.956+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=QCOJLIVTX89R type=del size=78617 2024-02-23T06:34:23.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.957+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~P3Q99QB6GDFC.0 size=937269 2024-02-23T06:34:23.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.959+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=P3Q99QB6GDFC tag=IOKJ3WV9EFF8 type=write size=1985845 2024-02-23T06:34:23.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.961+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~YMIRGGH5JIPF.0 size=903831 2024-02-23T06:34:23.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.961+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=YMIRGGH5JIPF tag=B9WF5EOVN7IF type=write size=1952407 2024-02-23T06:34:23.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.963+0000 7f5e72834780 1 < suggested remove operation key=TPADM4812N0Z tag=6WVX901LVM34 type=write 2024-02-23T06:34:23.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.965+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=AOM1DTBD6XQE type=del size=1925541 2024-02-23T06:34:23.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.966+0000 7f5e72834780 -1 < failed to complete operation key=TPADM4812N0Z tag=N864TQ6KY9NN type=del size=3476441: (22) Invalid argument 2024-02-23T06:34:23.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.968+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~RJDAXQ9AO3H9.0 size=1048576 2024-02-23T06:34:23.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.969+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~RJDAXQ9AO3H9.1 size=1048576 2024-02-23T06:34:23.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.970+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~RJDAXQ9AO3H9.2 size=495222 2024-02-23T06:34:23.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.970+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=RJDAXQ9AO3H9 tag=5VBFNYLJWVDR type=write size=3640950 2024-02-23T06:34:23.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.972+0000 7f5e72834780 1 < suggested update operation key=JV6FJONY04AW tag=DXTYGJ4XK6PM type=write size=941264 2024-02-23T06:34:23.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.974+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~ZYVESY33YIL2.0 size=553770 2024-02-23T06:34:23.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.974+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=ZYVESY33YIL2 tag=NQYMBDGZLXUY type=write size=1602346 2024-02-23T06:34:23.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.976+0000 7f5e72834780 1 < suggested remove operation key=03P6IEKSHB17 tag=8N5KAVVJ1BHK type=del 2024-02-23T06:34:23.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.979+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~SMF49EFIEXB8.0 size=497332 2024-02-23T06:34:23.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.979+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=SMF49EFIEXB8 tag=WEM2FKH4AZO5 type=write size=1545908 2024-02-23T06:34:23.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.980+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~T712P03M6QYR.0 size=1048576 2024-02-23T06:34:23.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.981+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~T712P03M6QYR.1 size=1048576 2024-02-23T06:34:23.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.982+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~T712P03M6QYR.2 size=405687 2024-02-23T06:34:23.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.984+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=T712P03M6QYR tag=GQ3PVFSF0CND type=write size=3551415 2024-02-23T06:34:23.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.986+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~XE1HCR1H571T.0 size=1048576 2024-02-23T06:34:23.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.987+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~XE1HCR1H571T.1 size=1048576 2024-02-23T06:34:23.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.988+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~XE1HCR1H571T.2 size=532073 2024-02-23T06:34:23.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.988+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=XE1HCR1H571T tag=SXQCP390S4YI type=write size=3677801 2024-02-23T06:34:23.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.989+0000 7f5e72834780 -1 < failed to complete operation key=8Q6WC7B9BY5Q tag=OOT6FZYR3FS2 type=del size=203350: (22) Invalid argument 2024-02-23T06:34:23.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.992+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~GEIGNB4UX49O.0 size=344950 2024-02-23T06:34:23.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.992+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=GEIGNB4UX49O tag=0EGHME3BKMV4 type=write size=1393526 2024-02-23T06:34:23.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.993+0000 7f5e72834780 -1 < failed to complete operation key=03P6IEKSHB17 tag=9U10ZWVR0387 type=del size=1723265: (22) Invalid argument 2024-02-23T06:34:23.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.994+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=WJ816RU3XASM type=write size=520203 2024-02-23T06:34:23.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.995+0000 7f5e72834780 -1 < failed to complete operation key=JV6FJONY04AW tag=N4A52LH300BD type=del size=3960601: (22) Invalid argument 2024-02-23T06:34:23.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.997+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~5J3JYJB4MH3G.0 size=743881 2024-02-23T06:34:23.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.997+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=5J3JYJB4MH3G tag=RAGE9GEM0N0K type=write size=1792457 2024-02-23T06:34:23.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:23.998+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=9O5E82YZISEJ type=write size=331136 2024-02-23T06:34:24.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.000+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=LUZMJGQSCONO type=del size=4184540 2024-02-23T06:34:24.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.002+0000 7f5e72834780 1 < suggested update operation key=26EE3EHDK8EM tag=JO82FM3GM262 type=del size=2830429 2024-02-23T06:34:24.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.003+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=2X0OYCAOMNL8 type=del size=100653 2024-02-23T06:34:24.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.004+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RU4AZX1TO2QX.0 size=1048576 2024-02-23T06:34:24.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.005+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RU4AZX1TO2QX.1 size=509533 2024-02-23T06:34:24.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.008+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=RU4AZX1TO2QX tag=O3X5C7FBSCIH type=write size=2606685 2024-02-23T06:34:24.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.009+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=GAK7QO7XGA19 type=del size=919620 2024-02-23T06:34:24.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.010+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~SCNIHHI5UV58.0 size=1048576 2024-02-23T06:34:24.012 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.011+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~SCNIHHI5UV58.1 size=1048576 2024-02-23T06:34:24.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.012+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~SCNIHHI5UV58.2 size=284711 2024-02-23T06:34:24.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.014+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=SCNIHHI5UV58 tag=G4GNBSMMU8QN type=write size=3430439 2024-02-23T06:34:24.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.016+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~XIOKF2J2S8TJ.0 size=1048576 2024-02-23T06:34:24.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.017+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~XIOKF2J2S8TJ.1 size=1048576 2024-02-23T06:34:24.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.018+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~XIOKF2J2S8TJ.2 size=125477 2024-02-23T06:34:24.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.018+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=XIOKF2J2S8TJ tag=RHQT0TTMUR48 type=write size=3271205 2024-02-23T06:34:24.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.019+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=DE5Z1043PX1U type=del 2024-02-23T06:34:24.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.020+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=2ZHJOK1JXRHU type=del size=780377 2024-02-23T06:34:24.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.021+0000 7f5e72834780 1 < completed write operation key=GACVVXC2Z1YO tag=WBK886LFOZ4R type=write size=219548 2024-02-23T06:34:24.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.023+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=UHE73XX3IS5T type=del size=2251271 2024-02-23T06:34:24.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.024+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=QCOJLIVTX89R type=del 2024-02-23T06:34:24.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.026+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~BBUFHN4VLK1V.0 size=102085 2024-02-23T06:34:24.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.026+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=BBUFHN4VLK1V tag=LST15FR8DM9H type=write size=1150661 2024-02-23T06:34:24.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.027+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~YMIRGGH5JIPF.0 size=903831 2024-02-23T06:34:24.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.029+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=YMIRGGH5JIPF tag=B9WF5EOVN7IF type=write size=1952407 2024-02-23T06:34:24.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.030+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=UNQY8MCTVRTH type=del size=1174213 2024-02-23T06:34:24.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.032+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=AOM1DTBD6XQE type=del 2024-02-23T06:34:24.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.033+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=WXNJJHQU4EUC type=del size=3000917 2024-02-23T06:34:24.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.034+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~RJDAXQ9AO3H9.0 size=1048576 2024-02-23T06:34:24.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.035+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~RJDAXQ9AO3H9.1 size=1048576 2024-02-23T06:34:24.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.036+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~RJDAXQ9AO3H9.2 size=495222 2024-02-23T06:34:24.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.038+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=RJDAXQ9AO3H9 tag=5VBFNYLJWVDR type=write size=3640950 2024-02-23T06:34:24.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.040+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~LH74EVYTBHDH.0 size=1048576 2024-02-23T06:34:24.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.041+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~LH74EVYTBHDH.1 size=319902 2024-02-23T06:34:24.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.041+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=LH74EVYTBHDH tag=IAH6VTYNU9PX type=write size=2417054 2024-02-23T06:34:24.043 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.042+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~ZYVESY33YIL2.0 size=553770 2024-02-23T06:34:24.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.045+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=ZYVESY33YIL2 tag=NQYMBDGZLXUY type=write size=1602346 2024-02-23T06:34:24.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.047+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~I2941DDIDCSO.0 size=294037 2024-02-23T06:34:24.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.047+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=I2941DDIDCSO tag=UWDO6A04BNEC type=write size=1342613 2024-02-23T06:34:24.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.048+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~SMF49EFIEXB8.0 size=497332 2024-02-23T06:34:24.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.050+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=SMF49EFIEXB8 tag=WEM2FKH4AZO5 type=write size=1545908 2024-02-23T06:34:24.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.051+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=JWS0X16H9LRX type=del size=1247847 2024-02-23T06:34:24.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.052+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~XE1HCR1H571T.0 size=1048576 2024-02-23T06:34:24.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.053+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~XE1HCR1H571T.1 size=1048576 2024-02-23T06:34:24.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.054+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~XE1HCR1H571T.2 size=532073 2024-02-23T06:34:24.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.056+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=XE1HCR1H571T tag=SXQCP390S4YI type=write size=3677801 2024-02-23T06:34:24.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.058+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=VKAFUD5OO4FU type=del size=1813786 2024-02-23T06:34:24.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.059+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~GEIGNB4UX49O.0 size=344950 2024-02-23T06:34:24.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.061+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=GEIGNB4UX49O tag=0EGHME3BKMV4 type=write size=1393526 2024-02-23T06:34:24.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.063+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~4HC133H4J4D1.0 size=131030 2024-02-23T06:34:24.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.063+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=4HC133H4J4D1 tag=9K3O9MULNYOO type=write size=1179606 2024-02-23T06:34:24.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.065+0000 7f5e72834780 1 < completed write operation key=IDTA5RV6IUF6 tag=WJ816RU3XASM type=write size=520203 2024-02-23T06:34:24.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.066+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=65XCJWYMDWTL type=del size=19906 2024-02-23T06:34:24.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.067+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~5J3JYJB4MH3G.0 size=743881 2024-02-23T06:34:24.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.069+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=5J3JYJB4MH3G tag=RAGE9GEM0N0K type=write size=1792457 2024-02-23T06:34:24.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.071+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~23127GFNZ60B.0 size=1048576 2024-02-23T06:34:24.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.072+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~23127GFNZ60B.1 size=864283 2024-02-23T06:34:24.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.072+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=23127GFNZ60B tag=P3S2EWGH7TE0 type=write size=2961435 2024-02-23T06:34:24.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.073+0000 7f5e72834780 -1 < failed to complete operation key=26EE3EHDK8EM tag=LUZMJGQSCONO type=del size=4184540: (22) Invalid argument 2024-02-23T06:34:24.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.075+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=SW9NOKF9O3Y7 type=write size=976485 2024-02-23T06:34:24.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.077+0000 7f5e72834780 1 < suggested remove operation key=N8RXOY8X71MO tag=2X0OYCAOMNL8 type=del 2024-02-23T06:34:24.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.079+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RNYCKME78MVF.0 size=1048576 2024-02-23T06:34:24.081 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.080+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RNYCKME78MVF.1 size=1048576 2024-02-23T06:34:24.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.081+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~RNYCKME78MVF.2 size=922746 2024-02-23T06:34:24.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.081+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=RNYCKME78MVF tag=T9YI70MGDHCU type=write size=4068474 2024-02-23T06:34:24.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.082+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=GAK7QO7XGA19 type=del 2024-02-23T06:34:24.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.084+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~L4EML66T1PY2.0 size=1048576 2024-02-23T06:34:24.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.085+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~L4EML66T1PY2.1 size=529174 2024-02-23T06:34:24.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.085+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=L4EML66T1PY2 tag=VHVW1589EC80 type=write size=2626326 2024-02-23T06:34:24.087 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.086+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~XIOKF2J2S8TJ.0 size=1048576 2024-02-23T06:34:24.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.087+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~XIOKF2J2S8TJ.1 size=1048576 2024-02-23T06:34:24.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.088+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~XIOKF2J2S8TJ.2 size=125477 2024-02-23T06:34:24.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.090+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=XIOKF2J2S8TJ tag=RHQT0TTMUR48 type=write size=3271205 2024-02-23T06:34:24.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.092+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~KW7J7QZRIUIO.0 size=1048576 2024-02-23T06:34:24.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.093+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~KW7J7QZRIUIO.1 size=1048576 2024-02-23T06:34:24.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.094+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~KW7J7QZRIUIO.2 size=84665 2024-02-23T06:34:24.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.094+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=KW7J7QZRIUIO tag=L5ZHYX8GAXV0 type=write size=3230393 2024-02-23T06:34:24.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.096+0000 7f5e72834780 1 < suggested remove operation key=GACVVXC2Z1YO tag=2ZHJOK1JXRHU type=del 2024-02-23T06:34:24.100 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.099+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~DVT4JTJEMG0Y.0 size=1048576 2024-02-23T06:34:24.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.100+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~DVT4JTJEMG0Y.1 size=815053 2024-02-23T06:34:24.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.100+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=DVT4JTJEMG0Y tag=7MEPYKQU6XS5 type=write size=2912205 2024-02-23T06:34:24.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.101+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=UHE73XX3IS5T type=del 2024-02-23T06:34:24.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.103+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~FHW7JVSL0KE7.0 size=1048576 2024-02-23T06:34:24.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.104+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~FHW7JVSL0KE7.1 size=996635 2024-02-23T06:34:24.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.104+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=FHW7JVSL0KE7 tag=0D42MLV6FDKI type=write size=3093787 2024-02-23T06:34:24.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.106+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~BBUFHN4VLK1V.0 size=102085 2024-02-23T06:34:24.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.108+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=BBUFHN4VLK1V tag=LST15FR8DM9H type=write size=1150661 2024-02-23T06:34:24.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.109+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=M66854RJMLV1 type=del size=1954479 2024-02-23T06:34:24.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.110+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=UNQY8MCTVRTH type=del 2024-02-23T06:34:24.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.113+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~Z54QCM3K7FEQ.0 size=466256 2024-02-23T06:34:24.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.113+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=Z54QCM3K7FEQ tag=BV2T6KSEEEPI type=write size=1514832 2024-02-23T06:34:24.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.115+0000 7f5e72834780 1 < suggested remove operation key=GW6EKQ84FQ6L tag=WXNJJHQU4EUC type=del 2024-02-23T06:34:24.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.116+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=B6ULCZ4K1N91 type=del size=987071 2024-02-23T06:34:24.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.118+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~LH74EVYTBHDH.0 size=1048576 2024-02-23T06:34:24.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.119+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~LH74EVYTBHDH.1 size=319902 2024-02-23T06:34:24.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.121+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=LH74EVYTBHDH tag=IAH6VTYNU9PX type=write size=2417054 2024-02-23T06:34:24.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.122+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=IZ053T7J1HWG type=del size=741067 2024-02-23T06:34:24.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.123+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~I2941DDIDCSO.0 size=294037 2024-02-23T06:34:24.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.126+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=I2941DDIDCSO tag=UWDO6A04BNEC type=write size=1342613 2024-02-23T06:34:24.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.127+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=W535Z0TITYAJ type=del size=1976313 2024-02-23T06:34:24.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.129+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=JWS0X16H9LRX type=del 2024-02-23T06:34:24.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.131+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~9D0A67TKGBVW.0 size=1048576 2024-02-23T06:34:24.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.132+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~9D0A67TKGBVW.1 size=132660 2024-02-23T06:34:24.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.132+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=9D0A67TKGBVW tag=Y91U249IQQ8T type=write size=2229812 2024-02-23T06:34:24.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.133+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=VKAFUD5OO4FU type=del 2024-02-23T06:34:24.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.135+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~I5QNXC3TOXNT.0 size=1048576 2024-02-23T06:34:24.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.136+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~I5QNXC3TOXNT.1 size=380917 2024-02-23T06:34:24.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.136+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=I5QNXC3TOXNT tag=XDU1AB941US8 type=write size=2478069 2024-02-23T06:34:24.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.138+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~4HC133H4J4D1.0 size=131030 2024-02-23T06:34:24.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.140+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=4HC133H4J4D1 tag=9K3O9MULNYOO type=write size=1179606 2024-02-23T06:34:24.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.143+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~UR7CGZHPE0LC.0 size=1048576 2024-02-23T06:34:24.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.144+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~UR7CGZHPE0LC.1 size=47846 2024-02-23T06:34:24.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.144+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=UR7CGZHPE0LC tag=SYI1CRB3BE9U type=write size=2144998 2024-02-23T06:34:24.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.145+0000 7f5e72834780 -1 < failed to complete operation key=GACVVXC2Z1YO tag=65XCJWYMDWTL type=del size=19906: (22) Invalid argument 2024-02-23T06:34:24.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.146+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=0HTRBNPHMWOQ type=del size=2656294 2024-02-23T06:34:24.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.147+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~23127GFNZ60B.0 size=1048576 2024-02-23T06:34:24.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.147+0000 7f5e72834780 1 < canceled part key=_multipart_QZLNM2RQ9SDC.2~23127GFNZ60B.1 size=864283 2024-02-23T06:34:24.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.150+0000 7f5e72834780 1 < canceled multipart upload key=QZLNM2RQ9SDC upload=23127GFNZ60B tag=P3S2EWGH7TE0 type=write size=2961435 2024-02-23T06:34:24.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.152+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~M4R3QXK2DLC0.0 size=1048576 2024-02-23T06:34:24.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.153+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~M4R3QXK2DLC0.1 size=1048576 2024-02-23T06:34:24.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.154+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~M4R3QXK2DLC0.2 size=767029 2024-02-23T06:34:24.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.154+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=M4R3QXK2DLC0 tag=EZYQQ2XZ6339 type=write size=3912757 2024-02-23T06:34:24.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.156+0000 7f5e72834780 1 < suggested update operation key=TNH85ZWPALJN tag=SW9NOKF9O3Y7 type=write size=976485 2024-02-23T06:34:24.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.159+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=8ZS77IVCO0X4 type=del size=2492815 2024-02-23T06:34:24.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.160+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RNYCKME78MVF.0 size=1048576 2024-02-23T06:34:24.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.163+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RNYCKME78MVF.1 size=1048576 2024-02-23T06:34:24.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.164+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~RNYCKME78MVF.2 size=922746 2024-02-23T06:34:24.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.166+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=RNYCKME78MVF tag=T9YI70MGDHCU type=write size=4068474 2024-02-23T06:34:24.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.168+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~IZBYO3USC58M.0 size=971804 2024-02-23T06:34:24.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.168+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=IZBYO3USC58M tag=MG7002CTZGKQ type=write size=2020380 2024-02-23T06:34:24.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.168+0000 7f5e72834780 1 < canceled part key=_multipart_WK98HMHAZIUB.2~L4EML66T1PY2.0 size=1048576 2024-02-23T06:34:24.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.169+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~L4EML66T1PY2.1 size=529174 2024-02-23T06:34:24.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.171+0000 7f5e72834780 1 < canceled multipart upload key=WK98HMHAZIUB upload=L4EML66T1PY2 tag=VHVW1589EC80 type=write size=2626326 2024-02-23T06:34:24.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.173+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~49QZTVUPNJ4K.0 size=119365 2024-02-23T06:34:24.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.173+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=49QZTVUPNJ4K tag=ZHXUQ3CFFK1P type=write size=1167941 2024-02-23T06:34:24.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.175+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~KW7J7QZRIUIO.0 size=1048576 2024-02-23T06:34:24.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.176+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~KW7J7QZRIUIO.1 size=1048576 2024-02-23T06:34:24.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.177+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~KW7J7QZRIUIO.2 size=84665 2024-02-23T06:34:24.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.179+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=KW7J7QZRIUIO tag=L5ZHYX8GAXV0 type=write size=3230393 2024-02-23T06:34:24.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.181+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~EYF6QMHNGMMZ.0 size=1048576 2024-02-23T06:34:24.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.182+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~EYF6QMHNGMMZ.1 size=1048576 2024-02-23T06:34:24.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.183+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~EYF6QMHNGMMZ.2 size=930698 2024-02-23T06:34:24.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.183+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=EYF6QMHNGMMZ tag=6MAX0EG9GOLG type=write size=4076426 2024-02-23T06:34:24.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.184+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~DVT4JTJEMG0Y.0 size=1048576 2024-02-23T06:34:24.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.185+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~DVT4JTJEMG0Y.1 size=815053 2024-02-23T06:34:24.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.187+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=DVT4JTJEMG0Y tag=7MEPYKQU6XS5 type=write size=2912205 2024-02-23T06:34:24.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.188+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=AXR1P3A2I0JQ type=write size=878399 2024-02-23T06:34:24.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.190+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~FHW7JVSL0KE7.0 size=1048576 2024-02-23T06:34:24.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.191+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~FHW7JVSL0KE7.1 size=996635 2024-02-23T06:34:24.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.193+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=FHW7JVSL0KE7 tag=0D42MLV6FDKI type=write size=3093787 2024-02-23T06:34:24.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.194+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=HE6OETP0NBMX type=del size=156257 2024-02-23T06:34:24.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.195+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=M66854RJMLV1 type=del 2024-02-23T06:34:24.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.197+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~5JJLCMEBCGOF.0 size=1048576 2024-02-23T06:34:24.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.198+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~5JJLCMEBCGOF.1 size=1048576 2024-02-23T06:34:24.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.199+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~5JJLCMEBCGOF.2 size=493669 2024-02-23T06:34:24.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.199+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=5JJLCMEBCGOF tag=566MCQ4HQ4A9 type=write size=3639397 2024-02-23T06:34:24.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.200+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~Z54QCM3K7FEQ.0 size=466256 2024-02-23T06:34:24.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.202+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=Z54QCM3K7FEQ tag=BV2T6KSEEEPI type=write size=1514832 2024-02-23T06:34:24.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.204+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~HX2OXYM0FQ43.0 size=178498 2024-02-23T06:34:24.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.204+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=HX2OXYM0FQ43 tag=TZCNFSFV3U5E type=write size=1227074 2024-02-23T06:34:24.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.206+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=B6ULCZ4K1N91 type=del 2024-02-23T06:34:24.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.207+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=EJRJBBIEY1G2 type=write size=172219 2024-02-23T06:34:24.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.208+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=IZ053T7J1HWG type=del 2024-02-23T06:34:24.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.210+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=QJAOGT4TQXVY type=del size=1540862 2024-02-23T06:34:24.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.211+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=W535Z0TITYAJ type=del 2024-02-23T06:34:24.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.212+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=0LTTL6GZHLYR type=del size=4022026 2024-02-23T06:34:24.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.213+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~9D0A67TKGBVW.0 size=1048576 2024-02-23T06:34:24.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.214+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~9D0A67TKGBVW.1 size=132660 2024-02-23T06:34:24.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.216+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=9D0A67TKGBVW tag=Y91U249IQQ8T type=write size=2229812 2024-02-23T06:34:24.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.217+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=6QMLEAFXLN12 type=del size=64975 2024-02-23T06:34:24.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.218+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~I5QNXC3TOXNT.0 size=1048576 2024-02-23T06:34:24.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.218+0000 7f5e72834780 1 < canceled part key=_multipart_QZLNM2RQ9SDC.2~I5QNXC3TOXNT.1 size=380917 2024-02-23T06:34:24.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.220+0000 7f5e72834780 1 < canceled multipart upload key=QZLNM2RQ9SDC upload=I5QNXC3TOXNT tag=XDU1AB941US8 type=write size=2478069 2024-02-23T06:34:24.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.222+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~KCQPW9G4YSG0.0 size=1048576 2024-02-23T06:34:24.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.223+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~KCQPW9G4YSG0.1 size=1048576 2024-02-23T06:34:24.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.224+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~KCQPW9G4YSG0.2 size=704022 2024-02-23T06:34:24.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.224+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=KCQPW9G4YSG0 tag=3OIMF3VS43J4 type=write size=3849750 2024-02-23T06:34:24.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.225+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~UR7CGZHPE0LC.0 size=1048576 2024-02-23T06:34:24.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.226+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~UR7CGZHPE0LC.1 size=47846 2024-02-23T06:34:24.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.228+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=UR7CGZHPE0LC tag=SYI1CRB3BE9U type=write size=2144998 2024-02-23T06:34:24.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.230+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=DGPNMZCK0HH9 type=del size=1339927 2024-02-23T06:34:24.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.231+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=0HTRBNPHMWOQ type=del 2024-02-23T06:34:24.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.232+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=JWKNFC7PGU76 type=write size=876436 2024-02-23T06:34:24.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.233+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~M4R3QXK2DLC0.0 size=1048576 2024-02-23T06:34:24.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.233+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~M4R3QXK2DLC0.1 size=1048576 2024-02-23T06:34:24.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.234+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~M4R3QXK2DLC0.2 size=767029 2024-02-23T06:34:24.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.236+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=M4R3QXK2DLC0 tag=EZYQQ2XZ6339 type=write size=3912757 2024-02-23T06:34:24.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.237+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=I5117ZXS3O1U type=write size=391849 2024-02-23T06:34:24.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.240+0000 7f5e72834780 1 < suggested update operation key=7N8OH7EETRN8 tag=8ZS77IVCO0X4 type=del size=2492815 2024-02-23T06:34:24.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.242+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~B9S879VY1JNF.0 size=1048576 2024-02-23T06:34:24.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.243+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~B9S879VY1JNF.1 size=141260 2024-02-23T06:34:24.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.243+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=B9S879VY1JNF tag=GNZOETT3KH5F type=write size=2238412 2024-02-23T06:34:24.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.243+0000 7f5e72834780 1 < canceled part key=_multipart_TNH85ZWPALJN.2~IZBYO3USC58M.0 size=971804 2024-02-23T06:34:24.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.245+0000 7f5e72834780 1 < canceled multipart upload key=TNH85ZWPALJN upload=IZBYO3USC58M tag=MG7002CTZGKQ type=write size=2020380 2024-02-23T06:34:24.247 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.246+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=T1S1K29QSKUP type=del size=1928730 2024-02-23T06:34:24.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.247+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~49QZTVUPNJ4K.0 size=119365 2024-02-23T06:34:24.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.249+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=49QZTVUPNJ4K tag=ZHXUQ3CFFK1P type=write size=1167941 2024-02-23T06:34:24.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.250+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=SRKEZ8Z2U1TZ type=write size=446100 2024-02-23T06:34:24.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.251+0000 7f5e72834780 1 < canceled part key=_multipart_ZM1YKZOUFSCY.2~EYF6QMHNGMMZ.0 size=1048576 2024-02-23T06:34:24.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.251+0000 7f5e72834780 1 < canceled part key=_multipart_ZM1YKZOUFSCY.2~EYF6QMHNGMMZ.1 size=1048576 2024-02-23T06:34:24.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.251+0000 7f5e72834780 1 < canceled part key=_multipart_ZM1YKZOUFSCY.2~EYF6QMHNGMMZ.2 size=930698 2024-02-23T06:34:24.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.253+0000 7f5e72834780 1 < canceled multipart upload key=ZM1YKZOUFSCY upload=EYF6QMHNGMMZ tag=6MAX0EG9GOLG type=write size=4076426 2024-02-23T06:34:24.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.254+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=RUZ6E4D8XL9Z type=write size=347762 2024-02-23T06:34:24.256 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.255+0000 7f5e72834780 1 < completed write operation key=26EE3EHDK8EM tag=AXR1P3A2I0JQ type=write size=878399 2024-02-23T06:34:24.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.257+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=N3J45BW7XPP6 type=del size=2584397 2024-02-23T06:34:24.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.258+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=HE6OETP0NBMX type=del 2024-02-23T06:34:24.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.259+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=R4G7EZNM7CRM type=del size=1974677 2024-02-23T06:34:24.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.260+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~5JJLCMEBCGOF.0 size=1048576 2024-02-23T06:34:24.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.262+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~5JJLCMEBCGOF.1 size=1048576 2024-02-23T06:34:24.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.263+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~5JJLCMEBCGOF.2 size=493669 2024-02-23T06:34:24.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.265+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=5JJLCMEBCGOF tag=566MCQ4HQ4A9 type=write size=3639397 2024-02-23T06:34:24.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.267+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~OY26FAH1NTAP.0 size=435933 2024-02-23T06:34:24.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.267+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=OY26FAH1NTAP tag=I59E5VOEWIX5 type=write size=1484509 2024-02-23T06:34:24.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.269+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~HX2OXYM0FQ43.0 size=178498 2024-02-23T06:34:24.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.272+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=HX2OXYM0FQ43 tag=TZCNFSFV3U5E type=write size=1227074 2024-02-23T06:34:24.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.274+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~PA1R5WRGLX10.0 size=677721 2024-02-23T06:34:24.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.274+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=PA1R5WRGLX10 tag=HOXOWAYB8JCK type=write size=1726297 2024-02-23T06:34:24.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.275+0000 7f5e72834780 1 < completed write operation key=TNH85ZWPALJN tag=EJRJBBIEY1G2 type=write size=172219 2024-02-23T06:34:24.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.276+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=VZFSOO6FQPAZ type=del size=1220847 2024-02-23T06:34:24.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.278+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=QJAOGT4TQXVY type=del 2024-02-23T06:34:24.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.279+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=52KSOSSVNXW8 type=del size=876454 2024-02-23T06:34:24.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.281+0000 7f5e72834780 1 < suggested update operation key=LUERFL6AN6HF tag=0LTTL6GZHLYR type=del size=4022026 2024-02-23T06:34:24.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.284+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~9ZEBET6LYS0I.0 size=268077 2024-02-23T06:34:24.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.284+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=9ZEBET6LYS0I tag=3NLLD9D3GW0P type=write size=1316653 2024-02-23T06:34:24.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.285+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=6QMLEAFXLN12 type=del 2024-02-23T06:34:24.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.286+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=XQ8YW1SCFBZX type=del size=1337959 2024-02-23T06:34:24.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.287+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~KCQPW9G4YSG0.0 size=1048576 2024-02-23T06:34:24.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.288+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~KCQPW9G4YSG0.1 size=1048576 2024-02-23T06:34:24.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.289+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~KCQPW9G4YSG0.2 size=704022 2024-02-23T06:34:24.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.291+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=KCQPW9G4YSG0 tag=3OIMF3VS43J4 type=write size=3849750 2024-02-23T06:34:24.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.293+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=B05IU2T80BRV type=del size=2195240 2024-02-23T06:34:24.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.294+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=DGPNMZCK0HH9 type=del 2024-02-23T06:34:24.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.295+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=WDI7ITZHYAOB type=del size=3906083 2024-02-23T06:34:24.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.296+0000 7f5e72834780 1 < completed write operation key=GACVVXC2Z1YO tag=JWKNFC7PGU76 type=write size=876436 2024-02-23T06:34:24.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.297+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=AOZPJFH6Q7DJ type=del size=198942 2024-02-23T06:34:24.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.298+0000 7f5e72834780 1 < completed write operation key=M5LH10WTDP0P tag=I5117ZXS3O1U type=write size=391849 2024-02-23T06:34:24.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.299+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=2QLTSCFGRTAB type=del size=422534 2024-02-23T06:34:24.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.301+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~B9S879VY1JNF.0 size=1048576 2024-02-23T06:34:24.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.302+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~B9S879VY1JNF.1 size=141260 2024-02-23T06:34:24.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.304+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=B9S879VY1JNF tag=GNZOETT3KH5F type=write size=2238412 2024-02-23T06:34:24.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.305+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=UNYKSXPHQ5UW type=del size=3708846 2024-02-23T06:34:24.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.306+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=T1S1K29QSKUP type=del 2024-02-23T06:34:24.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.308+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~OP3M03VFJ4W9.0 size=853753 2024-02-23T06:34:24.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.308+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=OP3M03VFJ4W9 tag=K0J06UX2ZRVU type=write size=1902329 2024-02-23T06:34:24.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.309+0000 7f5e72834780 1 < completed write operation key=WETP4ONTU3HL tag=SRKEZ8Z2U1TZ type=write size=446100 2024-02-23T06:34:24.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.311+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~Q6DOCDN62622.0 size=1048576 2024-02-23T06:34:24.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.312+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~Q6DOCDN62622.1 size=4250 2024-02-23T06:34:24.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.312+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=Q6DOCDN62622 tag=47U2JOFVJR29 type=write size=2101402 2024-02-23T06:34:24.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.314+0000 7f5e72834780 1 < canceled operation key=M5LH10WTDP0P tag=RUZ6E4D8XL9Z type=write size=347762 2024-02-23T06:34:24.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.315+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=NP4WBAWX82VY type=del size=1716521 2024-02-23T06:34:24.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.316+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=N3J45BW7XPP6 type=del 2024-02-23T06:34:24.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.318+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~GG3LKYNAUIGB.0 size=1048576 2024-02-23T06:34:24.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.319+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~GG3LKYNAUIGB.1 size=177560 2024-02-23T06:34:24.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.319+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=GG3LKYNAUIGB tag=FD1SQQZ5HFKI type=write size=2274712 2024-02-23T06:34:24.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.322+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=R4G7EZNM7CRM type=del size=1974677 2024-02-23T06:34:24.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.324+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~GOOTFA759P0M.0 size=1048576 2024-02-23T06:34:24.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.325+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~GOOTFA759P0M.1 size=1048576 2024-02-23T06:34:24.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.326+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~GOOTFA759P0M.2 size=762325 2024-02-23T06:34:24.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.326+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=GOOTFA759P0M tag=0PFK8FH924UG type=write size=3908053 2024-02-23T06:34:24.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.327+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~OY26FAH1NTAP.0 size=435933 2024-02-23T06:34:24.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.329+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=OY26FAH1NTAP tag=I59E5VOEWIX5 type=write size=1484509 2024-02-23T06:34:24.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.331+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~M2ZF3UMQMPZ4.0 size=1048576 2024-02-23T06:34:24.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.332+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~M2ZF3UMQMPZ4.1 size=1048576 2024-02-23T06:34:24.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.332+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~M2ZF3UMQMPZ4.2 size=614050 2024-02-23T06:34:24.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.332+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=M2ZF3UMQMPZ4 tag=386G7BMT96JO type=write size=3759778 2024-02-23T06:34:24.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.334+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~PA1R5WRGLX10.0 size=677721 2024-02-23T06:34:24.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.335+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=PA1R5WRGLX10 tag=HOXOWAYB8JCK type=write size=1726297 2024-02-23T06:34:24.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.337+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=EK65GQTBIFPW type=del size=2424665 2024-02-23T06:34:24.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.338+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=VZFSOO6FQPAZ type=del 2024-02-23T06:34:24.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.339+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=KTMW9S1FCOYQ type=del size=3093968 2024-02-23T06:34:24.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.340+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=52KSOSSVNXW8 type=del 2024-02-23T06:34:24.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.342+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~YHQ02N1PKROE.0 size=1048576 2024-02-23T06:34:24.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.343+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~YHQ02N1PKROE.1 size=84412 2024-02-23T06:34:24.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.343+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=YHQ02N1PKROE tag=TRO6745R37UV type=write size=2181564 2024-02-23T06:34:24.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.344+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~9ZEBET6LYS0I.0 size=268077 2024-02-23T06:34:24.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.346+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=9ZEBET6LYS0I tag=3NLLD9D3GW0P type=write size=1316653 2024-02-23T06:34:24.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.349+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~NSGQKN9FFHXN.0 size=697530 2024-02-23T06:34:24.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.349+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=NSGQKN9FFHXN tag=ILVOLYYWO9RR type=write size=1746106 2024-02-23T06:34:24.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.351+0000 7f5e72834780 1 < suggested update operation key=QGGULCYZ0ZSA tag=XQ8YW1SCFBZX type=del size=1337959 2024-02-23T06:34:24.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.353+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=E1FQUKKONMLS type=write size=864658 2024-02-23T06:34:24.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.354+0000 7f5e72834780 1 < canceled operation key=VEJ6D2J3LZI8 tag=B05IU2T80BRV type=del size=2195240 2024-02-23T06:34:24.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.356+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~C6GC0B2GPWDM.0 size=1048576 2024-02-23T06:34:24.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.357+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~C6GC0B2GPWDM.1 size=1048576 2024-02-23T06:34:24.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.358+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~C6GC0B2GPWDM.2 size=374054 2024-02-23T06:34:24.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.358+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=C6GC0B2GPWDM tag=9J8E3VU6S8Z1 type=write size=3519782 2024-02-23T06:34:24.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.359+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=WDI7ITZHYAOB type=del 2024-02-23T06:34:24.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.361+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~02JSVASIKI7I.0 size=1048576 2024-02-23T06:34:24.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.362+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~02JSVASIKI7I.1 size=1048576 2024-02-23T06:34:24.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.363+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~02JSVASIKI7I.2 size=325460 2024-02-23T06:34:24.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.363+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=02JSVASIKI7I tag=B1QEX5RSVEFV type=write size=3471188 2024-02-23T06:34:24.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.365+0000 7f5e72834780 1 < suggested remove operation key=R3STDBS79MV0 tag=AOZPJFH6Q7DJ type=del 2024-02-23T06:34:24.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.366+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=1R271FLQT343 type=del size=2936313 2024-02-23T06:34:24.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.369+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=2QLTSCFGRTAB type=del size=422534 2024-02-23T06:34:24.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.370+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=VI9MQKUPLE49 type=del size=656378 2024-02-23T06:34:24.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.371+0000 7f5e72834780 1 < canceled operation key=ZC75CQ2789VE tag=UNYKSXPHQ5UW type=del size=3708846 2024-02-23T06:34:24.373 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.372+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=09130HAB4MQC type=del size=3666923 2024-02-23T06:34:24.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.372+0000 7f5e72834780 1 < canceled part key=_multipart_ZM1YKZOUFSCY.2~OP3M03VFJ4W9.0 size=853753 2024-02-23T06:34:24.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.374+0000 7f5e72834780 1 < canceled multipart upload key=ZM1YKZOUFSCY upload=OP3M03VFJ4W9 tag=K0J06UX2ZRVU type=write size=1902329 2024-02-23T06:34:24.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.376+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~9K5IM5FRWGW7.0 size=979248 2024-02-23T06:34:24.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.377+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=9K5IM5FRWGW7 tag=NJIN8O8TSR2P type=write size=2027824 2024-02-23T06:34:24.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.378+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~Q6DOCDN62622.0 size=1048576 2024-02-23T06:34:24.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.379+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~Q6DOCDN62622.1 size=4250 2024-02-23T06:34:24.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.381+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=Q6DOCDN62622 tag=47U2JOFVJR29 type=write size=2101402 2024-02-23T06:34:24.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.383+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=700EHDC1B331 type=write size=298834 2024-02-23T06:34:24.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.387+0000 7f5e72834780 1 < suggested update operation key=JV6FJONY04AW tag=NP4WBAWX82VY type=del size=1716521 2024-02-23T06:34:24.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.389+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~X7HIHOH7M1QK.0 size=1048576 2024-02-23T06:34:24.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.390+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~X7HIHOH7M1QK.1 size=1048576 2024-02-23T06:34:24.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.391+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~X7HIHOH7M1QK.2 size=429550 2024-02-23T06:34:24.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.391+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=X7HIHOH7M1QK tag=3LDA0PD1BKBO type=write size=3575278 2024-02-23T06:34:24.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.392+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~GG3LKYNAUIGB.0 size=1048576 2024-02-23T06:34:24.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.393+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~GG3LKYNAUIGB.1 size=177560 2024-02-23T06:34:24.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.395+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=GG3LKYNAUIGB tag=FD1SQQZ5HFKI type=write size=2274712 2024-02-23T06:34:24.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.397+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~WQ26D5YUIEN8.0 size=1048576 2024-02-23T06:34:24.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.398+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~WQ26D5YUIEN8.1 size=1048576 2024-02-23T06:34:24.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.399+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~WQ26D5YUIEN8.2 size=668567 2024-02-23T06:34:24.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.399+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=WQ26D5YUIEN8 tag=KOJOQ0CLILLL type=write size=3814295 2024-02-23T06:34:24.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.400+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~GOOTFA759P0M.0 size=1048576 2024-02-23T06:34:24.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.400+0000 7f5e72834780 1 < canceled part key=_multipart_JV6FJONY04AW.2~GOOTFA759P0M.1 size=1048576 2024-02-23T06:34:24.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.400+0000 7f5e72834780 1 < canceled part key=_multipart_JV6FJONY04AW.2~GOOTFA759P0M.2 size=762325 2024-02-23T06:34:24.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.402+0000 7f5e72834780 1 < canceled multipart upload key=JV6FJONY04AW upload=GOOTFA759P0M tag=0PFK8FH924UG type=write size=3908053 2024-02-23T06:34:24.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.403+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=68P2KWOR3EJP type=del size=1093299 2024-02-23T06:34:24.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.404+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~M2ZF3UMQMPZ4.0 size=1048576 2024-02-23T06:34:24.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.405+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~M2ZF3UMQMPZ4.1 size=1048576 2024-02-23T06:34:24.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.406+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~M2ZF3UMQMPZ4.2 size=614050 2024-02-23T06:34:24.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.408+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=M2ZF3UMQMPZ4 tag=386G7BMT96JO type=write size=3759778 2024-02-23T06:34:24.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.409+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=56II34131CH0 type=del size=1965192 2024-02-23T06:34:24.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.410+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=EK65GQTBIFPW type=del 2024-02-23T06:34:24.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.411+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=978G8E2VWIUB type=del size=335796 2024-02-23T06:34:24.414 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.412+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=KTMW9S1FCOYQ type=del 2024-02-23T06:34:24.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.413+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=9IFSQEBZ657E type=del size=3818097 2024-02-23T06:34:24.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.415+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~YHQ02N1PKROE.0 size=1048576 2024-02-23T06:34:24.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.416+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~YHQ02N1PKROE.1 size=84412 2024-02-23T06:34:24.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.417+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=YHQ02N1PKROE tag=TRO6745R37UV type=write size=2181564 2024-02-23T06:34:24.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.419+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~69DDQAVEFIH3.0 size=732155 2024-02-23T06:34:24.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.419+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=69DDQAVEFIH3 tag=078MD3BGPZ10 type=write size=1780731 2024-02-23T06:34:24.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.421+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~NSGQKN9FFHXN.0 size=697530 2024-02-23T06:34:24.424 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.423+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=NSGQKN9FFHXN tag=ILVOLYYWO9RR type=write size=1746106 2024-02-23T06:34:24.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.425+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~TB2JS9Q5IS95.0 size=1048576 2024-02-23T06:34:24.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.425+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~TB2JS9Q5IS95.1 size=1048576 2024-02-23T06:34:24.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.426+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~TB2JS9Q5IS95.2 size=197202 2024-02-23T06:34:24.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.426+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=TB2JS9Q5IS95 tag=J7OPB0T1XSCG type=write size=3342930 2024-02-23T06:34:24.430 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.429+0000 7f5e72834780 1 < suggested remove operation key=JV6FJONY04AW tag=E1FQUKKONMLS type=write 2024-02-23T06:34:24.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.431+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~MYMDBI54ORXL.0 size=1048576 2024-02-23T06:34:24.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.431+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~MYMDBI54ORXL.1 size=779727 2024-02-23T06:34:24.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.431+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=MYMDBI54ORXL tag=MYGZZNB7USCS type=write size=2876879 2024-02-23T06:34:24.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.433+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~C6GC0B2GPWDM.0 size=1048576 2024-02-23T06:34:24.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.434+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~C6GC0B2GPWDM.1 size=1048576 2024-02-23T06:34:24.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.434+0000 7f5e72834780 1 < canceled part key=_multipart_LUERFL6AN6HF.2~C6GC0B2GPWDM.2 size=374054 2024-02-23T06:34:24.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.436+0000 7f5e72834780 1 < canceled multipart upload key=LUERFL6AN6HF upload=C6GC0B2GPWDM tag=9J8E3VU6S8Z1 type=write size=3519782 2024-02-23T06:34:24.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.438+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~4SGU2W2M7XCB.0 size=176360 2024-02-23T06:34:24.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.438+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=4SGU2W2M7XCB tag=SMEQZUOI5R08 type=write size=1224936 2024-02-23T06:34:24.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.439+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~02JSVASIKI7I.0 size=1048576 2024-02-23T06:34:24.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.440+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~02JSVASIKI7I.1 size=1048576 2024-02-23T06:34:24.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.441+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~02JSVASIKI7I.2 size=325460 2024-02-23T06:34:24.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.445+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=02JSVASIKI7I tag=B1QEX5RSVEFV type=write size=3471188 2024-02-23T06:34:24.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.446+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=23L39KRUDKL8 type=del size=1618681 2024-02-23T06:34:24.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.447+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=1R271FLQT343 type=del 2024-02-23T06:34:24.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.448+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=NEQIO7DDK9O9 type=del size=1755718 2024-02-23T06:34:24.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.450+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=VI9MQKUPLE49 type=del 2024-02-23T06:34:24.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.452+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~GFTWSCZQMD32.0 size=782046 2024-02-23T06:34:24.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.452+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=GFTWSCZQMD32 tag=UNWAK4WIC7EY type=write size=1830622 2024-02-23T06:34:24.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.454+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=09130HAB4MQC type=del size=3666923 2024-02-23T06:34:24.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.456+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~IBDYCANU8IK4.0 size=136505 2024-02-23T06:34:24.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.456+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=IBDYCANU8IK4 tag=DNPERWCUG0G8 type=write size=1185081 2024-02-23T06:34:24.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.457+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~9K5IM5FRWGW7.0 size=979248 2024-02-23T06:34:24.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.459+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=9K5IM5FRWGW7 tag=NJIN8O8TSR2P type=write size=2027824 2024-02-23T06:34:24.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.462+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~MME2YUKHF0KB.0 size=1048576 2024-02-23T06:34:24.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.463+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~MME2YUKHF0KB.1 size=1048576 2024-02-23T06:34:24.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.463+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~MME2YUKHF0KB.2 size=820055 2024-02-23T06:34:24.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.463+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=MME2YUKHF0KB tag=U8MPRICQA81Z type=write size=3965783 2024-02-23T06:34:24.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.466+0000 7f5e72834780 1 < suggested remove operation key=VER8U5YMTPS6 tag=700EHDC1B331 type=write 2024-02-23T06:34:24.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.467+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=Y84S5G4V8UDS type=del size=2637751 2024-02-23T06:34:24.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.467+0000 7f5e72834780 1 < canceled part key=_multipart_9ZCNDGBEPWMN.2~X7HIHOH7M1QK.0 size=1048576 2024-02-23T06:34:24.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.468+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~X7HIHOH7M1QK.1 size=1048576 2024-02-23T06:34:24.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.469+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~X7HIHOH7M1QK.2 size=429550 2024-02-23T06:34:24.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.471+0000 7f5e72834780 1 < canceled multipart upload key=9ZCNDGBEPWMN upload=X7HIHOH7M1QK tag=3LDA0PD1BKBO type=write size=3575278 2024-02-23T06:34:24.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.472+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=72F2IHGS7LQT type=write size=92008 2024-02-23T06:34:24.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.474+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~WQ26D5YUIEN8.0 size=1048576 2024-02-23T06:34:24.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.474+0000 7f5e72834780 1 < canceled part key=_multipart_8Q6WC7B9BY5Q.2~WQ26D5YUIEN8.1 size=1048576 2024-02-23T06:34:24.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.475+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~WQ26D5YUIEN8.2 size=668567 2024-02-23T06:34:24.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.477+0000 7f5e72834780 1 < canceled multipart upload key=8Q6WC7B9BY5Q upload=WQ26D5YUIEN8 tag=KOJOQ0CLILLL type=write size=3814295 2024-02-23T06:34:24.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.478+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=FCKHWGJWBGAE type=del size=646560 2024-02-23T06:34:24.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.479+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=68P2KWOR3EJP type=del 2024-02-23T06:34:24.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.480+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=DFBOEMT3YGEQ type=del size=2159402 2024-02-23T06:34:24.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.482+0000 7f5e72834780 1 < canceled operation key=8Q6WC7B9BY5Q tag=56II34131CH0 type=del size=1965192 2024-02-23T06:34:24.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.484+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~S42I79QSSQJA.0 size=448917 2024-02-23T06:34:24.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.484+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=S42I79QSSQJA tag=387PZSS2UHOK type=write size=1497493 2024-02-23T06:34:24.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.485+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=978G8E2VWIUB type=del 2024-02-23T06:34:24.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.486+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=WQYEY9KXO8O4 type=del size=2490600 2024-02-23T06:34:24.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.487+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=9IFSQEBZ657E type=del 2024-02-23T06:34:24.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.488+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=2W3OPHXKXMOF type=del size=2494473 2024-02-23T06:34:24.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.489+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~69DDQAVEFIH3.0 size=732155 2024-02-23T06:34:24.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.490+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=69DDQAVEFIH3 tag=078MD3BGPZ10 type=write size=1780731 2024-02-23T06:34:24.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.493+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~3PQN5LG0TNO4.0 size=1191 2024-02-23T06:34:24.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.493+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=3PQN5LG0TNO4 tag=JNYIT6NNRKZX type=write size=1049767 2024-02-23T06:34:24.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.495+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~TB2JS9Q5IS95.0 size=1048576 2024-02-23T06:34:24.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.497+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~TB2JS9Q5IS95.1 size=1048576 2024-02-23T06:34:24.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.498+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~TB2JS9Q5IS95.2 size=197202 2024-02-23T06:34:24.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.501+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=TB2JS9Q5IS95 tag=J7OPB0T1XSCG type=write size=3342930 2024-02-23T06:34:24.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.503+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~24VKJIY08U17.0 size=401633 2024-02-23T06:34:24.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.503+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=24VKJIY08U17 tag=CSFJWA2FWEAS type=write size=1450209 2024-02-23T06:34:24.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.506+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~MYMDBI54ORXL.0 size=1048576 2024-02-23T06:34:24.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.507+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~MYMDBI54ORXL.1 size=779727 2024-02-23T06:34:24.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.508+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=MYMDBI54ORXL tag=MYGZZNB7USCS type=write size=2876879 2024-02-23T06:34:24.511 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.510+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=YY3Y3E76VBF4 type=del size=3981276 2024-02-23T06:34:24.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.511+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~4SGU2W2M7XCB.0 size=176360 2024-02-23T06:34:24.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.513+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=4SGU2W2M7XCB tag=SMEQZUOI5R08 type=write size=1224936 2024-02-23T06:34:24.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.514+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=WI5K1OG9C3AR type=del size=3100497 2024-02-23T06:34:24.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.515+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=23L39KRUDKL8 type=del 2024-02-23T06:34:24.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.517+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~52PCLQ4YIC7E.0 size=1048576 2024-02-23T06:34:24.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.518+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~52PCLQ4YIC7E.1 size=1048576 2024-02-23T06:34:24.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.519+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~52PCLQ4YIC7E.2 size=1026228 2024-02-23T06:34:24.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.519+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=52PCLQ4YIC7E tag=VN86BPJN0KLI type=write size=4171956 2024-02-23T06:34:24.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.520+0000 7f5e72834780 -1 < failed to complete operation key=VER8U5YMTPS6 tag=NEQIO7DDK9O9 type=del size=1755718: (22) Invalid argument 2024-02-23T06:34:24.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.522+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~G7L44EBA9YAQ.0 size=1048576 2024-02-23T06:34:24.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.523+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~G7L44EBA9YAQ.1 size=101401 2024-02-23T06:34:24.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.523+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=G7L44EBA9YAQ tag=OJX63Z5SS3BX type=write size=2198553 2024-02-23T06:34:24.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.524+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~GFTWSCZQMD32.0 size=782046 2024-02-23T06:34:24.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.526+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=GFTWSCZQMD32 tag=UNWAK4WIC7EY type=write size=1830622 2024-02-23T06:34:24.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.528+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~HU71IR5BP0Z3.0 size=885505 2024-02-23T06:34:24.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.528+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=HU71IR5BP0Z3 tag=70NFGV0NIL7S type=write size=1934081 2024-02-23T06:34:24.530 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.529+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~IBDYCANU8IK4.0 size=136505 2024-02-23T06:34:24.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.531+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=IBDYCANU8IK4 tag=DNPERWCUG0G8 type=write size=1185081 2024-02-23T06:34:24.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.533+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~K8YD4TZU8JJ6.0 size=1048576 2024-02-23T06:34:24.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.534+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~K8YD4TZU8JJ6.1 size=452577 2024-02-23T06:34:24.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.534+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=K8YD4TZU8JJ6 tag=PPWAA1082VMJ type=write size=2549729 2024-02-23T06:34:24.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.534+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~MME2YUKHF0KB.0 size=1048576 2024-02-23T06:34:24.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.535+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~MME2YUKHF0KB.1 size=1048576 2024-02-23T06:34:24.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.536+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~MME2YUKHF0KB.2 size=820055 2024-02-23T06:34:24.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.538+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=MME2YUKHF0KB tag=U8MPRICQA81Z type=write size=3965783 2024-02-23T06:34:24.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.540+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~QYFFYA1HPKGM.0 size=1048576 2024-02-23T06:34:24.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.541+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~QYFFYA1HPKGM.1 size=1048576 2024-02-23T06:34:24.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.542+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~QYFFYA1HPKGM.2 size=552572 2024-02-23T06:34:24.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.542+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=QYFFYA1HPKGM tag=W2JEDF9JG196 type=write size=3698300 2024-02-23T06:34:24.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.544+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=Y84S5G4V8UDS type=del 2024-02-23T06:34:24.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.545+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=Z2QS47GW1H2S type=del size=1286654 2024-02-23T06:34:24.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.546+0000 7f5e72834780 1 < completed write operation key=883VBT1ADE6K tag=72F2IHGS7LQT type=write size=92008 2024-02-23T06:34:24.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.547+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=I6Y6T4129WOD type=del size=1387665 2024-02-23T06:34:24.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.549+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=FCKHWGJWBGAE type=del 2024-02-23T06:34:24.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.551+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~0MXE8S33JNQI.0 size=1048576 2024-02-23T06:34:24.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.551+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~0MXE8S33JNQI.1 size=214096 2024-02-23T06:34:24.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.551+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=0MXE8S33JNQI tag=A9120PZVE8TH type=write size=2311248 2024-02-23T06:34:24.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.553+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=DFBOEMT3YGEQ type=del 2024-02-23T06:34:24.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.554+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=W94S6PUJUUA4 type=del size=3373107 2024-02-23T06:34:24.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.555+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~S42I79QSSQJA.0 size=448917 2024-02-23T06:34:24.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.557+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=S42I79QSSQJA tag=387PZSS2UHOK type=write size=1497493 2024-02-23T06:34:24.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.558+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=KJHE689BOXL8 type=write size=939505 2024-02-23T06:34:24.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.559+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=WQYEY9KXO8O4 type=del 2024-02-23T06:34:24.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.561+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~NL9343W8QKR8.0 size=1048576 2024-02-23T06:34:24.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.562+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~NL9343W8QKR8.1 size=1048576 2024-02-23T06:34:24.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.563+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~NL9343W8QKR8.2 size=284802 2024-02-23T06:34:24.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.563+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=NL9343W8QKR8 tag=KX5N0SMZ620G type=write size=3430530 2024-02-23T06:34:24.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.564+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=2W3OPHXKXMOF type=del 2024-02-23T06:34:24.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.565+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=ZKM7W7HZ0B84 type=del size=2909743 2024-02-23T06:34:24.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.567+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~3PQN5LG0TNO4.0 size=1191 2024-02-23T06:34:24.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.568+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=3PQN5LG0TNO4 tag=JNYIT6NNRKZX type=write size=1049767 2024-02-23T06:34:24.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.571+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~LJHKYA468J3Z.0 size=1048576 2024-02-23T06:34:24.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.571+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~LJHKYA468J3Z.1 size=521231 2024-02-23T06:34:24.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.571+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=LJHKYA468J3Z tag=3SKVM0WXVGPQ type=write size=2618383 2024-02-23T06:34:24.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.573+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~24VKJIY08U17.0 size=401633 2024-02-23T06:34:24.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.575+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=24VKJIY08U17 tag=CSFJWA2FWEAS type=write size=1450209 2024-02-23T06:34:24.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.578+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~NGHPMZM7F38P.0 size=222501 2024-02-23T06:34:24.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.578+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=NGHPMZM7F38P tag=88WF1298DEMQ type=write size=1271077 2024-02-23T06:34:24.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.579+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=YY3Y3E76VBF4 type=del 2024-02-23T06:34:24.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.580+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=Z45VS54GMI1R type=del size=3553856 2024-02-23T06:34:24.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.581+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=WI5K1OG9C3AR type=del 2024-02-23T06:34:24.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.583+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~03REBNN9A9QP.0 size=927081 2024-02-23T06:34:24.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.583+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=03REBNN9A9QP tag=NO9K7OSUMTZE type=write size=1975657 2024-02-23T06:34:24.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.584+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~52PCLQ4YIC7E.0 size=1048576 2024-02-23T06:34:24.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.585+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~52PCLQ4YIC7E.1 size=1048576 2024-02-23T06:34:24.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.586+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~52PCLQ4YIC7E.2 size=1026228 2024-02-23T06:34:24.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.588+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=52PCLQ4YIC7E tag=VN86BPJN0KLI type=write size=4171956 2024-02-23T06:34:24.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.590+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~TVSML1I03QFM.0 size=876003 2024-02-23T06:34:24.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.590+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=TVSML1I03QFM tag=JDP1OFPZUIOL type=write size=1924579 2024-02-23T06:34:24.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.592+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~G7L44EBA9YAQ.0 size=1048576 2024-02-23T06:34:24.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.593+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~G7L44EBA9YAQ.1 size=101401 2024-02-23T06:34:24.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.596+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=G7L44EBA9YAQ tag=OJX63Z5SS3BX type=write size=2198553 2024-02-23T06:34:24.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.598+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=2F24RBWLLX58 type=del size=3073063 2024-02-23T06:34:24.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.598+0000 7f5e72834780 1 < canceled part key=_multipart_WK98HMHAZIUB.2~HU71IR5BP0Z3.0 size=885505 2024-02-23T06:34:24.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.600+0000 7f5e72834780 1 < canceled multipart upload key=WK98HMHAZIUB upload=HU71IR5BP0Z3 tag=70NFGV0NIL7S type=write size=1934081 2024-02-23T06:34:24.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.601+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=015B60LJ39GH type=del size=1028812 2024-02-23T06:34:24.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.603+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~K8YD4TZU8JJ6.0 size=1048576 2024-02-23T06:34:24.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.604+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~K8YD4TZU8JJ6.1 size=452577 2024-02-23T06:34:24.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.607+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=K8YD4TZU8JJ6 tag=PPWAA1082VMJ type=write size=2549729 2024-02-23T06:34:24.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.608+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=O7SW34QNAGKU type=del size=105337 2024-02-23T06:34:24.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.609+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~QYFFYA1HPKGM.0 size=1048576 2024-02-23T06:34:24.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.610+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~QYFFYA1HPKGM.1 size=1048576 2024-02-23T06:34:24.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.611+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~QYFFYA1HPKGM.2 size=552572 2024-02-23T06:34:24.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.613+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=QYFFYA1HPKGM tag=W2JEDF9JG196 type=write size=3698300 2024-02-23T06:34:24.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.614+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=AEBKLPN4CHE1 type=del size=1008399 2024-02-23T06:34:24.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.615+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=Z2QS47GW1H2S type=del 2024-02-23T06:34:24.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.617+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~5HTYRA9PS4BV.0 size=1048576 2024-02-23T06:34:24.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.618+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~5HTYRA9PS4BV.1 size=1048576 2024-02-23T06:34:24.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.619+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~5HTYRA9PS4BV.2 size=472058 2024-02-23T06:34:24.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.619+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=5HTYRA9PS4BV tag=3CXBG0OBSQEH type=write size=3617786 2024-02-23T06:34:24.622 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.621+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=I6Y6T4129WOD type=del 2024-02-23T06:34:24.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.622+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=R7PIF55HARJ5 type=del size=3146697 2024-02-23T06:34:24.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.623+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~0MXE8S33JNQI.0 size=1048576 2024-02-23T06:34:24.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.624+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~0MXE8S33JNQI.1 size=214096 2024-02-23T06:34:24.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.626+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=0MXE8S33JNQI tag=A9120PZVE8TH type=write size=2311248 2024-02-23T06:34:24.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.627+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=TCYORK4NLGC9 type=del size=1808006 2024-02-23T06:34:24.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.629+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=W94S6PUJUUA4 type=del 2024-02-23T06:34:24.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.631+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~PATGHQ9NZONG.0 size=1048576 2024-02-23T06:34:24.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.632+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~PATGHQ9NZONG.1 size=222196 2024-02-23T06:34:24.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.632+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=PATGHQ9NZONG tag=TIB5MUPTX598 type=write size=2319348 2024-02-23T06:34:24.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.633+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=KJHE689BOXL8 type=write size=939505 2024-02-23T06:34:24.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.635+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~KDMVPH2YVTM8.0 size=1048576 2024-02-23T06:34:24.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.636+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~KDMVPH2YVTM8.1 size=1048576 2024-02-23T06:34:24.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.637+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~KDMVPH2YVTM8.2 size=485542 2024-02-23T06:34:24.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.637+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=KDMVPH2YVTM8 tag=D15TYHR7I583 type=write size=3631270 2024-02-23T06:34:24.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.638+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~NL9343W8QKR8.0 size=1048576 2024-02-23T06:34:24.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.639+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~NL9343W8QKR8.1 size=1048576 2024-02-23T06:34:24.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.640+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~NL9343W8QKR8.2 size=284802 2024-02-23T06:34:24.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.642+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=NL9343W8QKR8 tag=KX5N0SMZ620G type=write size=3430530 2024-02-23T06:34:24.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.644+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~HV9W4Y3KWFW4.0 size=1048576 2024-02-23T06:34:24.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.645+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~HV9W4Y3KWFW4.1 size=1048576 2024-02-23T06:34:24.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.646+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~HV9W4Y3KWFW4.2 size=391332 2024-02-23T06:34:24.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.646+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=HV9W4Y3KWFW4 tag=S8S978TAWDSO type=write size=3537060 2024-02-23T06:34:24.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.647+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=ZKM7W7HZ0B84 type=del 2024-02-23T06:34:24.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.648+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=K72LIJ1LJ26S type=del size=1759569 2024-02-23T06:34:24.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.649+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~LJHKYA468J3Z.0 size=1048576 2024-02-23T06:34:24.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.650+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~LJHKYA468J3Z.1 size=521231 2024-02-23T06:34:24.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.652+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=LJHKYA468J3Z tag=3SKVM0WXVGPQ type=write size=2618383 2024-02-23T06:34:24.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.655+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~H7UCD1QECWJE.0 size=1048576 2024-02-23T06:34:24.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.656+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~H7UCD1QECWJE.1 size=1048576 2024-02-23T06:34:24.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.657+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~H7UCD1QECWJE.2 size=570291 2024-02-23T06:34:24.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.657+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=H7UCD1QECWJE tag=3J1IMDI2FIQG type=write size=3716019 2024-02-23T06:34:24.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.658+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~NGHPMZM7F38P.0 size=222501 2024-02-23T06:34:24.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.660+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=NGHPMZM7F38P tag=88WF1298DEMQ type=write size=1271077 2024-02-23T06:34:24.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.661+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=S4P9V42H5OHY type=del size=1701117 2024-02-23T06:34:24.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.664+0000 7f5e72834780 1 < suggested remove operation key=WETP4ONTU3HL tag=Z45VS54GMI1R type=del 2024-02-23T06:34:24.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.665+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=Y6H6KMAR52QN type=del size=88970 2024-02-23T06:34:24.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.666+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~03REBNN9A9QP.0 size=927081 2024-02-23T06:34:24.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.668+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=03REBNN9A9QP tag=NO9K7OSUMTZE type=write size=1975657 2024-02-23T06:34:24.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.669+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=9QCEHFITN9NB type=del size=2506232 2024-02-23T06:34:24.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.670+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~TVSML1I03QFM.0 size=876003 2024-02-23T06:34:24.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.672+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=TVSML1I03QFM tag=JDP1OFPZUIOL type=write size=1924579 2024-02-23T06:34:24.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.673+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=VIUGLMV6CSQQ type=del size=2608412 2024-02-23T06:34:24.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.675+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=2F24RBWLLX58 type=del 2024-02-23T06:34:24.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.677+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~ZJBSPZ6TUCLM.0 size=1048576 2024-02-23T06:34:24.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.678+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~ZJBSPZ6TUCLM.1 size=813361 2024-02-23T06:34:24.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.678+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=ZJBSPZ6TUCLM tag=329W1FMGIIGP type=write size=2910513 2024-02-23T06:34:24.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.679+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=015B60LJ39GH type=del 2024-02-23T06:34:24.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.681+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=ETZ0TWJT405T type=write size=1006135 2024-02-23T06:34:24.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.682+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=O7SW34QNAGKU type=del 2024-02-23T06:34:24.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.685+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~ST1FQENL37FO.0 size=1048576 2024-02-23T06:34:24.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.686+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~ST1FQENL37FO.1 size=1048576 2024-02-23T06:34:24.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.687+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~ST1FQENL37FO.2 size=285586 2024-02-23T06:34:24.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.687+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=ST1FQENL37FO tag=P1LNEPTWHXFV type=write size=3431314 2024-02-23T06:34:24.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.688+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=AEBKLPN4CHE1 type=del 2024-02-23T06:34:24.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.690+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~7DR2TURNK9TL.0 size=1048576 2024-02-23T06:34:24.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.691+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~7DR2TURNK9TL.1 size=223242 2024-02-23T06:34:24.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.691+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=7DR2TURNK9TL tag=JCISTQKH29V5 type=write size=2320394 2024-02-23T06:34:24.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.693+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~5HTYRA9PS4BV.0 size=1048576 2024-02-23T06:34:24.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.694+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~5HTYRA9PS4BV.1 size=1048576 2024-02-23T06:34:24.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.694+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~5HTYRA9PS4BV.2 size=472058 2024-02-23T06:34:24.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.696+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=5HTYRA9PS4BV tag=3CXBG0OBSQEH type=write size=3617786 2024-02-23T06:34:24.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.697+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=O8TAYBJ9KHFQ type=del size=1726318 2024-02-23T06:34:24.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.699+0000 7f5e72834780 1 < canceled operation key=8Q6WC7B9BY5Q tag=R7PIF55HARJ5 type=del size=3146697 2024-02-23T06:34:24.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.701+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~P9II8JTK20G6.0 size=1048576 2024-02-23T06:34:24.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.702+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~P9II8JTK20G6.1 size=898668 2024-02-23T06:34:24.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.702+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=P9II8JTK20G6 tag=EF8SGS3RKWOF type=write size=2995820 2024-02-23T06:34:24.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.705+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=TCYORK4NLGC9 type=del size=1808006 2024-02-23T06:34:24.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.707+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~GGX6FYSYS5J9.0 size=1048576 2024-02-23T06:34:24.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.708+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~GGX6FYSYS5J9.1 size=111317 2024-02-23T06:34:24.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.708+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=GGX6FYSYS5J9 tag=KETD12LS3CEG type=write size=2208469 2024-02-23T06:34:24.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.709+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~PATGHQ9NZONG.0 size=1048576 2024-02-23T06:34:24.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.710+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~PATGHQ9NZONG.1 size=222196 2024-02-23T06:34:24.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.714+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=PATGHQ9NZONG tag=TIB5MUPTX598 type=write size=2319348 2024-02-23T06:34:24.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.715+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=VJ6B9EST41SM type=write size=501615 2024-02-23T06:34:24.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.715+0000 7f5e72834780 1 < canceled part key=_multipart_JV6FJONY04AW.2~KDMVPH2YVTM8.0 size=1048576 2024-02-23T06:34:24.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.716+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~KDMVPH2YVTM8.1 size=1048576 2024-02-23T06:34:24.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.717+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~KDMVPH2YVTM8.2 size=485542 2024-02-23T06:34:24.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.720+0000 7f5e72834780 1 < canceled multipart upload key=JV6FJONY04AW upload=KDMVPH2YVTM8 tag=D15TYHR7I583 type=write size=3631270 2024-02-23T06:34:24.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.721+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=MTTPJU6M9I6K type=del size=494595 2024-02-23T06:34:24.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.722+0000 7f5e72834780 1 < canceled part key=_multipart_GW6EKQ84FQ6L.2~HV9W4Y3KWFW4.0 size=1048576 2024-02-23T06:34:24.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.722+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~HV9W4Y3KWFW4.1 size=1048576 2024-02-23T06:34:24.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.725+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~HV9W4Y3KWFW4.2 size=391332 2024-02-23T06:34:24.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.727+0000 7f5e72834780 1 < canceled multipart upload key=GW6EKQ84FQ6L upload=HV9W4Y3KWFW4 tag=S8S978TAWDSO type=write size=3537060 2024-02-23T06:34:24.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.728+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=HHROZOC602XT type=del size=2825994 2024-02-23T06:34:24.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.729+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=K72LIJ1LJ26S type=del 2024-02-23T06:34:24.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.731+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~AYTSIDVCEW6S.0 size=460554 2024-02-23T06:34:24.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.731+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=AYTSIDVCEW6S tag=A9BM5MFPN122 type=write size=1509130 2024-02-23T06:34:24.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.732+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~H7UCD1QECWJE.0 size=1048576 2024-02-23T06:34:24.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.733+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~H7UCD1QECWJE.1 size=1048576 2024-02-23T06:34:24.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.734+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~H7UCD1QECWJE.2 size=570291 2024-02-23T06:34:24.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.736+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=H7UCD1QECWJE tag=3J1IMDI2FIQG type=write size=3716019 2024-02-23T06:34:24.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.738+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~OT4IPM4TQL9I.0 size=256639 2024-02-23T06:34:24.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.738+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=OT4IPM4TQL9I tag=BDPESLJRBMRI type=write size=1305215 2024-02-23T06:34:24.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.739+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=S4P9V42H5OHY type=del 2024-02-23T06:34:24.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.741+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~BJDXHMWAW39M.0 size=1048576 2024-02-23T06:34:24.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.741+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~BJDXHMWAW39M.1 size=854016 2024-02-23T06:34:24.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.741+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=BJDXHMWAW39M tag=24KE15CVSL30 type=write size=2951168 2024-02-23T06:34:24.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.742+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=Y6H6KMAR52QN type=del 2024-02-23T06:34:24.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.745+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~VU5CVZIWIJ8N.0 size=685631 2024-02-23T06:34:24.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.745+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=VU5CVZIWIJ8N tag=1JVRUCO8QQT0 type=write size=1734207 2024-02-23T06:34:24.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.746+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=9QCEHFITN9NB type=del 2024-02-23T06:34:24.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.747+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=KMN9TZ0F9S2V type=del size=713693 2024-02-23T06:34:24.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.749+0000 7f5e72834780 1 < suggested remove operation key=721UW0AGSKVR tag=VIUGLMV6CSQQ type=del 2024-02-23T06:34:24.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.751+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~KSMX7QH5TJ6D.0 size=799113 2024-02-23T06:34:24.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.751+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=KSMX7QH5TJ6D tag=WVV2YUMO5L68 type=write size=1847689 2024-02-23T06:34:24.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.752+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~ZJBSPZ6TUCLM.0 size=1048576 2024-02-23T06:34:24.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.753+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~ZJBSPZ6TUCLM.1 size=813361 2024-02-23T06:34:24.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.755+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=ZJBSPZ6TUCLM tag=329W1FMGIIGP type=write size=2910513 2024-02-23T06:34:24.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.758+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~M1AHXBOTI9Q2.0 size=1048576 2024-02-23T06:34:24.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.759+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~M1AHXBOTI9Q2.1 size=1048576 2024-02-23T06:34:24.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.760+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~M1AHXBOTI9Q2.2 size=61745 2024-02-23T06:34:24.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.760+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=M1AHXBOTI9Q2 tag=9AFALI75AVBK type=write size=3207473 2024-02-23T06:34:24.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.761+0000 7f5e72834780 1 < completed write operation key=0WLEPDK2O30W tag=ETZ0TWJT405T type=write size=1006135 2024-02-23T06:34:24.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.763+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~513VB0DB02NF.0 size=1048576 2024-02-23T06:34:24.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.764+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~513VB0DB02NF.1 size=345519 2024-02-23T06:34:24.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.764+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=513VB0DB02NF tag=TSFGQ2RGGW28 type=write size=2442671 2024-02-23T06:34:24.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.766+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~ST1FQENL37FO.0 size=1048576 2024-02-23T06:34:24.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.767+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~ST1FQENL37FO.1 size=1048576 2024-02-23T06:34:24.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.768+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~ST1FQENL37FO.2 size=285586 2024-02-23T06:34:24.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.770+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=ST1FQENL37FO tag=P1LNEPTWHXFV type=write size=3431314 2024-02-23T06:34:24.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.771+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=BINS0N7VNH4P type=write size=429511 2024-02-23T06:34:24.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.773+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~7DR2TURNK9TL.0 size=1048576 2024-02-23T06:34:24.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.774+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~7DR2TURNK9TL.1 size=223242 2024-02-23T06:34:24.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.776+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=7DR2TURNK9TL tag=JCISTQKH29V5 type=write size=2320394 2024-02-23T06:34:24.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.778+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~ZTPIQZQ01YKR.0 size=1048576 2024-02-23T06:34:24.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.779+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~ZTPIQZQ01YKR.1 size=260162 2024-02-23T06:34:24.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.779+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=ZTPIQZQ01YKR tag=7Z3P830UOBGE type=write size=2357314 2024-02-23T06:34:24.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.780+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=O8TAYBJ9KHFQ type=del 2024-02-23T06:34:24.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.781+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=B2WO83V9Z91X type=del size=2957594 2024-02-23T06:34:24.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.783+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~P9II8JTK20G6.0 size=1048576 2024-02-23T06:34:24.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.783+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~P9II8JTK20G6.1 size=898668 2024-02-23T06:34:24.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.785+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=P9II8JTK20G6 tag=EF8SGS3RKWOF type=write size=2995820 2024-02-23T06:34:24.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.786+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=RBNQMN0KYBHT type=write size=1002783 2024-02-23T06:34:24.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.788+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~GGX6FYSYS5J9.0 size=1048576 2024-02-23T06:34:24.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.788+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~GGX6FYSYS5J9.1 size=111317 2024-02-23T06:34:24.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.790+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=GGX6FYSYS5J9 tag=KETD12LS3CEG type=write size=2208469 2024-02-23T06:34:24.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.792+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~KJJMUX25BZ1F.0 size=1048576 2024-02-23T06:34:24.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.793+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~KJJMUX25BZ1F.1 size=1048576 2024-02-23T06:34:24.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.794+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~KJJMUX25BZ1F.2 size=496925 2024-02-23T06:34:24.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.794+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=KJJMUX25BZ1F tag=8E2DDOERIC8F type=write size=3642653 2024-02-23T06:34:24.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.795+0000 7f5e72834780 1 < completed write operation key=VEJ6D2J3LZI8 tag=VJ6B9EST41SM type=write size=501615 2024-02-23T06:34:24.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.797+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=KP4PMPW64MZ2 type=del size=3372860 2024-02-23T06:34:24.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.798+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=MTTPJU6M9I6K type=del 2024-02-23T06:34:24.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.799+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=VN8CR0IFAZFZ type=del size=2777909 2024-02-23T06:34:24.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.801+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=HHROZOC602XT type=del 2024-02-23T06:34:24.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.802+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=OJ9KX0QS7QW9 type=del size=2514482 2024-02-23T06:34:24.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.803+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~AYTSIDVCEW6S.0 size=460554 2024-02-23T06:34:24.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.805+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=AYTSIDVCEW6S tag=A9BM5MFPN122 type=write size=1509130 2024-02-23T06:34:24.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.806+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=T2G2SAHVHVV3 type=del size=2330405 2024-02-23T06:34:24.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.807+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~OT4IPM4TQL9I.0 size=256639 2024-02-23T06:34:24.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.809+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=OT4IPM4TQL9I tag=BDPESLJRBMRI type=write size=1305215 2024-02-23T06:34:24.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.811+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~3S56RDQSTY6Q.0 size=1048576 2024-02-23T06:34:24.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.812+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~3S56RDQSTY6Q.1 size=1048576 2024-02-23T06:34:24.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.813+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~3S56RDQSTY6Q.2 size=4600 2024-02-23T06:34:24.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.813+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=3S56RDQSTY6Q tag=3627C2HPD25P type=write size=3150328 2024-02-23T06:34:24.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.813+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~BJDXHMWAW39M.0 size=1048576 2024-02-23T06:34:24.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.814+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~BJDXHMWAW39M.1 size=854016 2024-02-23T06:34:24.817 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.816+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=BJDXHMWAW39M tag=24KE15CVSL30 type=write size=2951168 2024-02-23T06:34:24.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.818+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~UF3E01F4AXSJ.0 size=620575 2024-02-23T06:34:24.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.818+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=UF3E01F4AXSJ tag=SGU9SJ1FSIOI type=write size=1669151 2024-02-23T06:34:24.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.820+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~VU5CVZIWIJ8N.0 size=685631 2024-02-23T06:34:24.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.821+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=VU5CVZIWIJ8N tag=1JVRUCO8QQT0 type=write size=1734207 2024-02-23T06:34:24.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.824+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~1WD1ST41TZYV.0 size=1048576 2024-02-23T06:34:24.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.825+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~1WD1ST41TZYV.1 size=42885 2024-02-23T06:34:24.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.825+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=1WD1ST41TZYV tag=302L0ZUEIJ0B type=write size=2140037 2024-02-23T06:34:24.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.826+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=KMN9TZ0F9S2V type=del 2024-02-23T06:34:24.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.827+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=BJM4FHYKU9WW type=del size=943259 2024-02-23T06:34:24.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.830+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~KSMX7QH5TJ6D.0 size=799113 2024-02-23T06:34:24.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.831+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=KSMX7QH5TJ6D tag=WVV2YUMO5L68 type=write size=1847689 2024-02-23T06:34:24.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.833+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=ZWZA5WSCP2HG type=del size=11322 2024-02-23T06:34:24.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.834+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~M1AHXBOTI9Q2.0 size=1048576 2024-02-23T06:34:24.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.835+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~M1AHXBOTI9Q2.1 size=1048576 2024-02-23T06:34:24.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.836+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~M1AHXBOTI9Q2.2 size=61745 2024-02-23T06:34:24.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.838+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=M1AHXBOTI9Q2 tag=9AFALI75AVBK type=write size=3207473 2024-02-23T06:34:24.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.840+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~9B4T6LZNNTQ0.0 size=23199 2024-02-23T06:34:24.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.840+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=9B4T6LZNNTQ0 tag=E8D82O2JHL61 type=write size=1071775 2024-02-23T06:34:24.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.841+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~513VB0DB02NF.0 size=1048576 2024-02-23T06:34:24.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.842+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~513VB0DB02NF.1 size=345519 2024-02-23T06:34:24.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.844+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=513VB0DB02NF tag=TSFGQ2RGGW28 type=write size=2442671 2024-02-23T06:34:24.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.845+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=2VRL48CR3RQF type=write size=316838 2024-02-23T06:34:24.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.848+0000 7f5e72834780 1 < suggested update operation key=9AQCXLBZW3EV tag=BINS0N7VNH4P type=write size=429511 2024-02-23T06:34:24.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.849+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=F5113LMOEXW4 type=write size=900048 2024-02-23T06:34:24.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.850+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~ZTPIQZQ01YKR.0 size=1048576 2024-02-23T06:34:24.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.851+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~ZTPIQZQ01YKR.1 size=260162 2024-02-23T06:34:24.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.853+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=ZTPIQZQ01YKR tag=7Z3P830UOBGE type=write size=2357314 2024-02-23T06:34:24.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.854+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=JO0RGS5VKPOZ type=write size=720665 2024-02-23T06:34:24.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.857+0000 7f5e72834780 1 < suggested update operation key=GWTK3YV0RY21 tag=B2WO83V9Z91X type=del size=2957594 2024-02-23T06:34:24.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.858+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=19TD6KUWZC5D type=del size=3513139 2024-02-23T06:34:24.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.859+0000 7f5e72834780 1 < canceled operation key=IDTA5RV6IUF6 tag=RBNQMN0KYBHT type=write size=1002783 2024-02-23T06:34:24.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.861+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~O582EXLPBN5D.0 size=1048576 2024-02-23T06:34:24.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.862+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~O582EXLPBN5D.1 size=833944 2024-02-23T06:34:24.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.862+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=O582EXLPBN5D tag=0ECYTQZDM3EN type=write size=2931096 2024-02-23T06:34:24.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.863+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~KJJMUX25BZ1F.0 size=1048576 2024-02-23T06:34:24.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.864+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~KJJMUX25BZ1F.1 size=1048576 2024-02-23T06:34:24.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.865+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~KJJMUX25BZ1F.2 size=496925 2024-02-23T06:34:24.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.867+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=KJJMUX25BZ1F tag=8E2DDOERIC8F type=write size=3642653 2024-02-23T06:34:24.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.869+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~SPHF2C4ZP693.0 size=1048576 2024-02-23T06:34:24.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.870+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~SPHF2C4ZP693.1 size=646156 2024-02-23T06:34:24.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.870+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=SPHF2C4ZP693 tag=ELGZ586X3J54 type=write size=2743308 2024-02-23T06:34:24.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.872+0000 7f5e72834780 1 < suggested remove operation key=RS03NUABC1U2 tag=KP4PMPW64MZ2 type=del 2024-02-23T06:34:24.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.874+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=5ZH9VPYJ14J4 type=write size=408692 2024-02-23T06:34:24.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.875+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=VN8CR0IFAZFZ type=del 2024-02-23T06:34:24.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.876+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=I0PMHXHFZ838 type=write size=221482 2024-02-23T06:34:24.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.877+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=OJ9KX0QS7QW9 type=del 2024-02-23T06:34:24.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.880+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~VL82D1GC12DN.0 size=1048576 2024-02-23T06:34:24.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.881+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~VL82D1GC12DN.1 size=1048576 2024-02-23T06:34:24.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.882+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~VL82D1GC12DN.2 size=184727 2024-02-23T06:34:24.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.882+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=VL82D1GC12DN tag=7VEKBK4KEY96 type=write size=3330455 2024-02-23T06:34:24.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.883+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=T2G2SAHVHVV3 type=del 2024-02-23T06:34:24.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.885+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~XYZIQ9U6GGXB.0 size=1048576 2024-02-23T06:34:24.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.886+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~XYZIQ9U6GGXB.1 size=1048576 2024-02-23T06:34:24.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.887+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~XYZIQ9U6GGXB.2 size=628990 2024-02-23T06:34:24.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.887+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=XYZIQ9U6GGXB tag=NPTOUKFWPA21 type=write size=3774718 2024-02-23T06:34:24.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.888+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~3S56RDQSTY6Q.0 size=1048576 2024-02-23T06:34:24.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.889+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~3S56RDQSTY6Q.1 size=1048576 2024-02-23T06:34:24.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.890+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~3S56RDQSTY6Q.2 size=4600 2024-02-23T06:34:24.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.892+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=3S56RDQSTY6Q tag=3627C2HPD25P type=write size=3150328 2024-02-23T06:34:24.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.895+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~XRM80XNS9WTG.0 size=641940 2024-02-23T06:34:24.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.895+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=XRM80XNS9WTG tag=F3JQHJHSAYRU type=write size=1690516 2024-02-23T06:34:24.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.896+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~UF3E01F4AXSJ.0 size=620575 2024-02-23T06:34:24.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.898+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=UF3E01F4AXSJ tag=SGU9SJ1FSIOI type=write size=1669151 2024-02-23T06:34:24.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.899+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=1FSZ6IHWO9G9 type=write size=409083 2024-02-23T06:34:24.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.899+0000 7f5e72834780 1 < canceled part key=_multipart_GWTK3YV0RY21.2~1WD1ST41TZYV.0 size=1048576 2024-02-23T06:34:24.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.900+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~1WD1ST41TZYV.1 size=42885 2024-02-23T06:34:24.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.902+0000 7f5e72834780 1 < canceled multipart upload key=GWTK3YV0RY21 upload=1WD1ST41TZYV tag=302L0ZUEIJ0B type=write size=2140037 2024-02-23T06:34:24.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.903+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=8AFKPXLAF12W type=del size=1925573 2024-02-23T06:34:24.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.905+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=BJM4FHYKU9WW type=del 2024-02-23T06:34:24.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.906+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=BXDIR1SG2NQT type=write size=788626 2024-02-23T06:34:24.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.908+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=ZWZA5WSCP2HG type=del 2024-02-23T06:34:24.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.910+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~YINLJOGFIH70.0 size=1048576 2024-02-23T06:34:24.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.910+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~YINLJOGFIH70.1 size=972832 2024-02-23T06:34:24.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.910+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=YINLJOGFIH70 tag=FSOE8O0F3H38 type=write size=3069984 2024-02-23T06:34:24.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.912+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~9B4T6LZNNTQ0.0 size=23199 2024-02-23T06:34:24.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.914+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=9B4T6LZNNTQ0 tag=E8D82O2JHL61 type=write size=1071775 2024-02-23T06:34:24.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.916+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~EXRCCGHEW6PU.0 size=624651 2024-02-23T06:34:24.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.916+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=EXRCCGHEW6PU tag=J6PK2AXUFW0B type=write size=1673227 2024-02-23T06:34:24.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.917+0000 7f5e72834780 -1 < failed to complete operation key=9AQCXLBZW3EV tag=2VRL48CR3RQF type=write size=316838: (22) Invalid argument 2024-02-23T06:34:24.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.919+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~KQVYQ7HD1I5P.0 size=1048576 2024-02-23T06:34:24.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.921+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~KQVYQ7HD1I5P.1 size=1048576 2024-02-23T06:34:24.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.922+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~KQVYQ7HD1I5P.2 size=182849 2024-02-23T06:34:24.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.922+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=KQVYQ7HD1I5P tag=R9BKWGTVXOLL type=write size=3328577 2024-02-23T06:34:24.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.923+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=F5113LMOEXW4 type=write size=900048 2024-02-23T06:34:24.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.924+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=P00HSNHEQLTN type=del size=158306 2024-02-23T06:34:24.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.927+0000 7f5e72834780 1 < suggested update operation key=883VBT1ADE6K tag=JO0RGS5VKPOZ type=write size=720665 2024-02-23T06:34:24.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.930+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~V5S5Y2MO9DR5.0 size=1048576 2024-02-23T06:34:24.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.931+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~V5S5Y2MO9DR5.1 size=169642 2024-02-23T06:34:24.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.931+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=V5S5Y2MO9DR5 tag=LHKWC38KDVI0 type=write size=2266794 2024-02-23T06:34:24.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.932+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=19TD6KUWZC5D type=del 2024-02-23T06:34:24.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.934+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=H0KKED25X323 type=del size=1487891 2024-02-23T06:34:24.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.935+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~O582EXLPBN5D.0 size=1048576 2024-02-23T06:34:24.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.936+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~O582EXLPBN5D.1 size=833944 2024-02-23T06:34:24.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.938+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=O582EXLPBN5D tag=0ECYTQZDM3EN type=write size=2931096 2024-02-23T06:34:24.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.940+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=VFEV4OL23G3O type=write size=415769 2024-02-23T06:34:24.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.941+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~SPHF2C4ZP693.0 size=1048576 2024-02-23T06:34:24.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.943+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~SPHF2C4ZP693.1 size=646156 2024-02-23T06:34:24.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.947+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=SPHF2C4ZP693 tag=ELGZ586X3J54 type=write size=2743308 2024-02-23T06:34:24.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.948+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=557RE3RYXWLT type=del size=2163981 2024-02-23T06:34:24.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.950+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=5ZH9VPYJ14J4 type=write size=408692 2024-02-23T06:34:24.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.951+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=GZPUBZDJUYRK type=write size=925340 2024-02-23T06:34:24.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.952+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=I0PMHXHFZ838 type=write size=221482 2024-02-23T06:34:24.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.953+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=MWA6KCX0OHM4 type=del size=293071 2024-02-23T06:34:24.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.954+0000 7f5e72834780 1 < canceled part key=_multipart_7N8OH7EETRN8.2~VL82D1GC12DN.0 size=1048576 2024-02-23T06:34:24.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.955+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~VL82D1GC12DN.1 size=1048576 2024-02-23T06:34:24.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.956+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~VL82D1GC12DN.2 size=184727 2024-02-23T06:34:24.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.958+0000 7f5e72834780 1 < canceled multipart upload key=7N8OH7EETRN8 upload=VL82D1GC12DN tag=7VEKBK4KEY96 type=write size=3330455 2024-02-23T06:34:24.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.960+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~2OARWC2N9UP5.0 size=1048576 2024-02-23T06:34:24.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.961+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~2OARWC2N9UP5.1 size=1048576 2024-02-23T06:34:24.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.962+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~2OARWC2N9UP5.2 size=20234 2024-02-23T06:34:24.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.962+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=2OARWC2N9UP5 tag=8MORNNVIZ3UO type=write size=3165962 2024-02-23T06:34:24.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.963+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~XYZIQ9U6GGXB.0 size=1048576 2024-02-23T06:34:24.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.964+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~XYZIQ9U6GGXB.1 size=1048576 2024-02-23T06:34:24.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.965+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~XYZIQ9U6GGXB.2 size=628990 2024-02-23T06:34:24.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.967+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=XYZIQ9U6GGXB tag=NPTOUKFWPA21 type=write size=3774718 2024-02-23T06:34:24.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.969+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=EDKKVKMNTL6T type=del size=1257876 2024-02-23T06:34:24.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.970+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~XRM80XNS9WTG.0 size=641940 2024-02-23T06:34:24.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.972+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=XRM80XNS9WTG tag=F3JQHJHSAYRU type=write size=1690516 2024-02-23T06:34:24.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.973+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=VFEAPAIXFQSS type=del size=2479099 2024-02-23T06:34:24.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.975+0000 7f5e72834780 1 < completed write operation key=JV6FJONY04AW tag=1FSZ6IHWO9G9 type=write size=409083 2024-02-23T06:34:24.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.977+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~VKY2ZOJUJBP2.0 size=663985 2024-02-23T06:34:24.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.977+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=VKY2ZOJUJBP2 tag=6S5KDBS3J4IP type=write size=1712561 2024-02-23T06:34:24.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.978+0000 7f5e72834780 1 < canceled operation key=M5LH10WTDP0P tag=8AFKPXLAF12W type=del size=1925573 2024-02-23T06:34:24.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.980+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~YZ9DUDMH8EM0.0 size=1048576 2024-02-23T06:34:24.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.981+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~YZ9DUDMH8EM0.1 size=1048576 2024-02-23T06:34:24.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.982+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~YZ9DUDMH8EM0.2 size=458650 2024-02-23T06:34:24.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.982+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=YZ9DUDMH8EM0 tag=1L52YXU80LY6 type=write size=3604378 2024-02-23T06:34:24.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.983+0000 7f5e72834780 1 < completed write operation key=0WLEPDK2O30W tag=BXDIR1SG2NQT type=write size=788626 2024-02-23T06:34:24.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.985+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=YGU6MP2S1CFY type=del size=1458620 2024-02-23T06:34:24.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.986+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~YINLJOGFIH70.0 size=1048576 2024-02-23T06:34:24.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.987+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~YINLJOGFIH70.1 size=972832 2024-02-23T06:34:24.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.989+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=YINLJOGFIH70 tag=FSOE8O0F3H38 type=write size=3069984 2024-02-23T06:34:24.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.990+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=6YCMBT4OTA8O type=del size=824910 2024-02-23T06:34:24.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.990+0000 7f5e72834780 1 < canceled part key=_multipart_9ZCNDGBEPWMN.2~EXRCCGHEW6PU.0 size=624651 2024-02-23T06:34:24.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.992+0000 7f5e72834780 1 < canceled multipart upload key=9ZCNDGBEPWMN upload=EXRCCGHEW6PU tag=J6PK2AXUFW0B type=write size=1673227 2024-02-23T06:34:24.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.994+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~D0HBDJTUFXLH.0 size=1048576 2024-02-23T06:34:24.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.995+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~D0HBDJTUFXLH.1 size=649197 2024-02-23T06:34:24.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.995+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=D0HBDJTUFXLH tag=FXU8HX72ZDZJ type=write size=2746349 2024-02-23T06:34:24.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.996+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~KQVYQ7HD1I5P.0 size=1048576 2024-02-23T06:34:24.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.997+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~KQVYQ7HD1I5P.1 size=1048576 2024-02-23T06:34:24.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.998+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~KQVYQ7HD1I5P.2 size=182849 2024-02-23T06:34:25.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:24.999+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=KQVYQ7HD1I5P tag=R9BKWGTVXOLL type=write size=3328577 2024-02-23T06:34:25.002 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.001+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=ED30WQZNQLNQ type=del size=1967478 2024-02-23T06:34:25.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.002+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=P00HSNHEQLTN type=del 2024-02-23T06:34:25.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.003+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=IJVAPDC92EIB type=del size=4062996 2024-02-23T06:34:25.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.003+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~V5S5Y2MO9DR5.0 size=1048576 2024-02-23T06:34:25.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.004+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~V5S5Y2MO9DR5.1 size=169642 2024-02-23T06:34:25.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.006+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=V5S5Y2MO9DR5 tag=LHKWC38KDVI0 type=write size=2266794 2024-02-23T06:34:25.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.007+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=OJFZYPBA9K9Q type=write size=605892 2024-02-23T06:34:25.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.009+0000 7f5e72834780 1 < suggested update operation key=8Q6WC7B9BY5Q tag=H0KKED25X323 type=del size=1487891 2024-02-23T06:34:25.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.010+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=87P7AN090KJR type=write size=576053 2024-02-23T06:34:25.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.012+0000 7f5e72834780 1 < completed write operation key=JV6FJONY04AW tag=VFEV4OL23G3O type=write size=415769 2024-02-23T06:34:25.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.013+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=2LY7LHJ8OS5B type=del size=4083125 2024-02-23T06:34:25.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.014+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=557RE3RYXWLT type=del 2024-02-23T06:34:25.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.015+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=GE1FII5XYPMN type=del size=3422147 2024-02-23T06:34:25.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.017+0000 7f5e72834780 1 < suggested update operation key=WETP4ONTU3HL tag=GZPUBZDJUYRK type=write size=925340 2024-02-23T06:34:25.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.019+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~6QXFIB8QGBEW.0 size=1048576 2024-02-23T06:34:25.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.020+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~6QXFIB8QGBEW.1 size=1048576 2024-02-23T06:34:25.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.021+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~6QXFIB8QGBEW.2 size=432092 2024-02-23T06:34:25.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.021+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=6QXFIB8QGBEW tag=XUEA3SPSO2JP type=write size=3577820 2024-02-23T06:34:25.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.023+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=MWA6KCX0OHM4 type=del 2024-02-23T06:34:25.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.024+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=NIA2UFTCRZ83 type=del size=127469 2024-02-23T06:34:25.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.025+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~2OARWC2N9UP5.0 size=1048576 2024-02-23T06:34:25.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.026+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~2OARWC2N9UP5.1 size=1048576 2024-02-23T06:34:25.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.027+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~2OARWC2N9UP5.2 size=20234 2024-02-23T06:34:25.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.030+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=2OARWC2N9UP5 tag=8MORNNVIZ3UO type=write size=3165962 2024-02-23T06:34:25.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.032+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~3ZE8VSHY6GVU.0 size=1048576 2024-02-23T06:34:25.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.033+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~3ZE8VSHY6GVU.1 size=546721 2024-02-23T06:34:25.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.033+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=3ZE8VSHY6GVU tag=YYG8VG9XNQLR type=write size=2643873 2024-02-23T06:34:25.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.034+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=EDKKVKMNTL6T type=del 2024-02-23T06:34:25.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.035+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=YCUA0TY4RJGI type=del size=2470046 2024-02-23T06:34:25.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.036+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=VFEAPAIXFQSS type=del 2024-02-23T06:34:25.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.037+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=ADUGZNLPCGC2 type=del size=2662115 2024-02-23T06:34:25.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.038+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~VKY2ZOJUJBP2.0 size=663985 2024-02-23T06:34:25.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.040+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=VKY2ZOJUJBP2 tag=6S5KDBS3J4IP type=write size=1712561 2024-02-23T06:34:25.043 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.042+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~89KYFF2KN16O.0 size=1048576 2024-02-23T06:34:25.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.043+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~89KYFF2KN16O.1 size=1048576 2024-02-23T06:34:25.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.044+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~89KYFF2KN16O.2 size=536152 2024-02-23T06:34:25.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.044+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=89KYFF2KN16O tag=TU69TTTZ4E2H type=write size=3681880 2024-02-23T06:34:25.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.045+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~YZ9DUDMH8EM0.0 size=1048576 2024-02-23T06:34:25.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.046+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~YZ9DUDMH8EM0.1 size=1048576 2024-02-23T06:34:25.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.047+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~YZ9DUDMH8EM0.2 size=458650 2024-02-23T06:34:25.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.049+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=YZ9DUDMH8EM0 tag=1L52YXU80LY6 type=write size=3604378 2024-02-23T06:34:25.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.051+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~77Q0M9UD5H6N.0 size=1048576 2024-02-23T06:34:25.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.052+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~77Q0M9UD5H6N.1 size=1048576 2024-02-23T06:34:25.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.054+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~77Q0M9UD5H6N.2 size=946835 2024-02-23T06:34:25.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.054+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=77Q0M9UD5H6N tag=V27OUUKW7N6C type=write size=4092563 2024-02-23T06:34:25.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.056+0000 7f5e72834780 1 < suggested remove operation key=M5LH10WTDP0P tag=YGU6MP2S1CFY type=del 2024-02-23T06:34:25.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.057+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=O94IIK0XZT5D type=del size=3704803 2024-02-23T06:34:25.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.058+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=6YCMBT4OTA8O type=del 2024-02-23T06:34:25.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.060+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~PYL6OUSJE8BI.0 size=1048576 2024-02-23T06:34:25.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.061+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~PYL6OUSJE8BI.1 size=629966 2024-02-23T06:34:25.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.061+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=PYL6OUSJE8BI tag=01G23STBE0LB type=write size=2727118 2024-02-23T06:34:25.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.063+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~D0HBDJTUFXLH.0 size=1048576 2024-02-23T06:34:25.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.063+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~D0HBDJTUFXLH.1 size=649197 2024-02-23T06:34:25.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.065+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=D0HBDJTUFXLH tag=FXU8HX72ZDZJ type=write size=2746349 2024-02-23T06:34:25.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.067+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~J73W46EIU0RP.0 size=1048576 2024-02-23T06:34:25.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.068+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~J73W46EIU0RP.1 size=1048576 2024-02-23T06:34:25.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.069+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~J73W46EIU0RP.2 size=172856 2024-02-23T06:34:25.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.069+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=J73W46EIU0RP tag=AO4HN7PY3I2D type=write size=3318584 2024-02-23T06:34:25.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.070+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=ED30WQZNQLNQ type=del 2024-02-23T06:34:25.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.072+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~TQJXT2B93F63.0 size=1047684 2024-02-23T06:34:25.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.072+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=TQJXT2B93F63 tag=OL5B4B2UOH94 type=write size=2096260 2024-02-23T06:34:25.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.074+0000 7f5e72834780 -1 < failed to complete operation key=8Q6WC7B9BY5Q tag=IJVAPDC92EIB type=del size=4062996: (22) Invalid argument 2024-02-23T06:34:25.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.076+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~LJOJKWW6D0M5.0 size=1048576 2024-02-23T06:34:25.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.077+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~LJOJKWW6D0M5.1 size=994952 2024-02-23T06:34:25.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.077+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=LJOJKWW6D0M5 tag=V447LBGVUO8X type=write size=3092104 2024-02-23T06:34:25.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.079+0000 7f5e72834780 1 < suggested update operation key=4M7BT05YB0C3 tag=OJFZYPBA9K9Q type=write size=605892 2024-02-23T06:34:25.081 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.080+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=QZM1Z86DJJG1 type=write size=468964 2024-02-23T06:34:25.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.081+0000 7f5e72834780 1 < completed write operation key=0WLEPDK2O30W tag=87P7AN090KJR type=write size=576053 2024-02-23T06:34:25.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.083+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~AGIDIP3KNODL.0 size=459708 2024-02-23T06:34:25.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.083+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=AGIDIP3KNODL tag=LEZ1A82T0YEN type=write size=1508284 2024-02-23T06:34:25.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.084+0000 7f5e72834780 1 < canceled operation key=RS03NUABC1U2 tag=2LY7LHJ8OS5B type=del size=4083125 2024-02-23T06:34:25.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.086+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~PTVVB163MF9N.0 size=1048576 2024-02-23T06:34:25.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.087+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~PTVVB163MF9N.1 size=1048576 2024-02-23T06:34:25.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.088+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~PTVVB163MF9N.2 size=299351 2024-02-23T06:34:25.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.088+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=PTVVB163MF9N tag=MHDPWZ8QVE5J type=write size=3445079 2024-02-23T06:34:25.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.089+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=GE1FII5XYPMN type=del 2024-02-23T06:34:25.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.091+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=9YOWJBN4K557 type=del size=568379 2024-02-23T06:34:25.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.092+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~6QXFIB8QGBEW.0 size=1048576 2024-02-23T06:34:25.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.093+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~6QXFIB8QGBEW.1 size=1048576 2024-02-23T06:34:25.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.094+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~6QXFIB8QGBEW.2 size=432092 2024-02-23T06:34:25.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.096+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=6QXFIB8QGBEW tag=XUEA3SPSO2JP type=write size=3577820 2024-02-23T06:34:25.098 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.097+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=N7M88NMOQ88N type=del size=962085 2024-02-23T06:34:25.099 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.098+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=NIA2UFTCRZ83 type=del 2024-02-23T06:34:25.100 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.099+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=R3KJC1EU002L type=del size=3231443 2024-02-23T06:34:25.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.100+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~3ZE8VSHY6GVU.0 size=1048576 2024-02-23T06:34:25.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.101+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~3ZE8VSHY6GVU.1 size=546721 2024-02-23T06:34:25.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.103+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=3ZE8VSHY6GVU tag=YYG8VG9XNQLR type=write size=2643873 2024-02-23T06:34:25.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.104+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=LB2IVLX2BCMR type=del size=4190342 2024-02-23T06:34:25.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.105+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=YCUA0TY4RJGI type=del 2024-02-23T06:34:25.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.106+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=LFVCZIJKF5I3 type=del size=2124106 2024-02-23T06:34:25.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.108+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=ADUGZNLPCGC2 type=del 2024-02-23T06:34:25.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.109+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=E8X45AD8AHML type=del size=1981284 2024-02-23T06:34:25.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.110+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~89KYFF2KN16O.0 size=1048576 2024-02-23T06:34:25.112 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.111+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~89KYFF2KN16O.1 size=1048576 2024-02-23T06:34:25.113 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.112+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~89KYFF2KN16O.2 size=536152 2024-02-23T06:34:25.115 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.114+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=89KYFF2KN16O tag=TU69TTTZ4E2H type=write size=3681880 2024-02-23T06:34:25.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.116+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~WZ16C26RX5BA.0 size=1048576 2024-02-23T06:34:25.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.116+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~WZ16C26RX5BA.1 size=1048576 2024-02-23T06:34:25.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.117+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~WZ16C26RX5BA.2 size=866645 2024-02-23T06:34:25.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.117+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=WZ16C26RX5BA tag=371UFW9TP2RG type=write size=4012373 2024-02-23T06:34:25.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.119+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~77Q0M9UD5H6N.0 size=1048576 2024-02-23T06:34:25.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.120+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~77Q0M9UD5H6N.1 size=1048576 2024-02-23T06:34:25.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.121+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~77Q0M9UD5H6N.2 size=946835 2024-02-23T06:34:25.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.123+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=77Q0M9UD5H6N tag=V27OUUKW7N6C type=write size=4092563 2024-02-23T06:34:25.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.125+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~PX6ZAKGD8SG0.0 size=984551 2024-02-23T06:34:25.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.125+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=PX6ZAKGD8SG0 tag=Y9TVLVVX54OT type=write size=2033127 2024-02-23T06:34:25.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.126+0000 7f5e72834780 1 < canceled operation key=IDTA5RV6IUF6 tag=O94IIK0XZT5D type=del size=3704803 2024-02-23T06:34:25.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.128+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~JEMFHJ8LVPUV.0 size=1048576 2024-02-23T06:34:25.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.129+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~JEMFHJ8LVPUV.1 size=916671 2024-02-23T06:34:25.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.129+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=JEMFHJ8LVPUV tag=OVZB0J7SYORG type=write size=3013823 2024-02-23T06:34:25.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.130+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~PYL6OUSJE8BI.0 size=1048576 2024-02-23T06:34:25.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.131+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~PYL6OUSJE8BI.1 size=629966 2024-02-23T06:34:25.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.133+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=PYL6OUSJE8BI tag=01G23STBE0LB type=write size=2727118 2024-02-23T06:34:25.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.134+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=PF6QD53UR1CF type=del size=2756404 2024-02-23T06:34:25.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.136+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~J73W46EIU0RP.0 size=1048576 2024-02-23T06:34:25.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.136+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~J73W46EIU0RP.1 size=1048576 2024-02-23T06:34:25.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.136+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~J73W46EIU0RP.2 size=172856 2024-02-23T06:34:25.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.138+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=J73W46EIU0RP tag=AO4HN7PY3I2D type=write size=3318584 2024-02-23T06:34:25.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.140+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NXS9WVNHCHRU.0 size=1048576 2024-02-23T06:34:25.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.141+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NXS9WVNHCHRU.1 size=73877 2024-02-23T06:34:25.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.141+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=NXS9WVNHCHRU tag=9JTKVE2T0C2E type=write size=2171029 2024-02-23T06:34:25.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.143+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~TQJXT2B93F63.0 size=1047684 2024-02-23T06:34:25.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.145+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=TQJXT2B93F63 tag=OL5B4B2UOH94 type=write size=2096260 2024-02-23T06:34:25.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.147+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~RJ1VMSKCSI9Y.0 size=1048576 2024-02-23T06:34:25.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.148+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~RJ1VMSKCSI9Y.1 size=410133 2024-02-23T06:34:25.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.148+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=RJ1VMSKCSI9Y tag=HJAVG96ACLSQ type=write size=2507285 2024-02-23T06:34:25.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.149+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~LJOJKWW6D0M5.0 size=1048576 2024-02-23T06:34:25.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.150+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~LJOJKWW6D0M5.1 size=994952 2024-02-23T06:34:25.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.152+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=LJOJKWW6D0M5 tag=V447LBGVUO8X type=write size=3092104 2024-02-23T06:34:25.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.153+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=GU6PKVN3REJ0 type=del size=3265225 2024-02-23T06:34:25.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.154+0000 7f5e72834780 1 < completed write operation key=TPADM4812N0Z tag=QZM1Z86DJJG1 type=write size=468964 2024-02-23T06:34:25.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.155+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=SKGS95Q6MR1Z type=del size=1453740 2024-02-23T06:34:25.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.156+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~AGIDIP3KNODL.0 size=459708 2024-02-23T06:34:25.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.159+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=AGIDIP3KNODL tag=LEZ1A82T0YEN type=write size=1508284 2024-02-23T06:34:25.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.160+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=JAA0F6OCAC10 type=del size=1530567 2024-02-23T06:34:25.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.161+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~PTVVB163MF9N.0 size=1048576 2024-02-23T06:34:25.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.161+0000 7f5e72834780 1 < canceled part key=_multipart_GW6EKQ84FQ6L.2~PTVVB163MF9N.1 size=1048576 2024-02-23T06:34:25.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.161+0000 7f5e72834780 1 < canceled part key=_multipart_GW6EKQ84FQ6L.2~PTVVB163MF9N.2 size=299351 2024-02-23T06:34:25.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.164+0000 7f5e72834780 1 < canceled multipart upload key=GW6EKQ84FQ6L upload=PTVVB163MF9N tag=MHDPWZ8QVE5J type=write size=3445079 2024-02-23T06:34:25.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.165+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=F0DILBF9O1L3 type=del size=2111149 2024-02-23T06:34:25.168 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.166+0000 7f5e72834780 1 < canceled operation key=721UW0AGSKVR tag=9YOWJBN4K557 type=del size=568379 2024-02-23T06:34:25.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.168+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=Y8BG7QW89VVG type=del size=248912 2024-02-23T06:34:25.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.169+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=N7M88NMOQ88N type=del 2024-02-23T06:34:25.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.170+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=WVRG2XO5QS6W type=del size=1704317 2024-02-23T06:34:25.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.171+0000 7f5e72834780 1 < canceled operation key=N8RXOY8X71MO tag=R3KJC1EU002L type=del size=3231443 2024-02-23T06:34:25.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.172+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=E3US75XUJ2BK type=write size=1025289 2024-02-23T06:34:25.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.174+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=LB2IVLX2BCMR type=del 2024-02-23T06:34:25.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.176+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~OY7DF7I9C1G8.0 size=1031801 2024-02-23T06:34:25.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.176+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=OY7DF7I9C1G8 tag=81PFJBHK8EGA type=write size=2080377 2024-02-23T06:34:25.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.177+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=LFVCZIJKF5I3 type=del 2024-02-23T06:34:25.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.179+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~HQCUUCNSNBZ4.0 size=1048576 2024-02-23T06:34:25.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.180+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~HQCUUCNSNBZ4.1 size=1048576 2024-02-23T06:34:25.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.181+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~HQCUUCNSNBZ4.2 size=996426 2024-02-23T06:34:25.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.181+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=HQCUUCNSNBZ4 tag=1OP4JLU6MWPK type=write size=4142154 2024-02-23T06:34:25.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.182+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=E8X45AD8AHML type=del 2024-02-23T06:34:25.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.183+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=4V4PVFKBE97C type=del size=1654314 2024-02-23T06:34:25.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.183+0000 7f5e72834780 1 < canceled part key=_multipart_R4YA9DUAJABL.2~WZ16C26RX5BA.0 size=1048576 2024-02-23T06:34:25.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.184+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~WZ16C26RX5BA.1 size=1048576 2024-02-23T06:34:25.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.185+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~WZ16C26RX5BA.2 size=866645 2024-02-23T06:34:25.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.187+0000 7f5e72834780 1 < canceled multipart upload key=R4YA9DUAJABL upload=WZ16C26RX5BA tag=371UFW9TP2RG type=write size=4012373 2024-02-23T06:34:25.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.188+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=OT1C3TV43K5P type=write size=148172 2024-02-23T06:34:25.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.189+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~PX6ZAKGD8SG0.0 size=984551 2024-02-23T06:34:25.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.193+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=PX6ZAKGD8SG0 tag=Y9TVLVVX54OT type=write size=2033127 2024-02-23T06:34:25.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.195+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~VWDTHL5DCZW1.0 size=1048576 2024-02-23T06:34:25.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.196+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~VWDTHL5DCZW1.1 size=1048576 2024-02-23T06:34:25.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.197+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~VWDTHL5DCZW1.2 size=439431 2024-02-23T06:34:25.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.197+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=VWDTHL5DCZW1 tag=TQ9P0SCQHYLF type=write size=3585159 2024-02-23T06:34:25.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.197+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~JEMFHJ8LVPUV.0 size=1048576 2024-02-23T06:34:25.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.198+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~JEMFHJ8LVPUV.1 size=916671 2024-02-23T06:34:25.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.200+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=JEMFHJ8LVPUV tag=OVZB0J7SYORG type=write size=3013823 2024-02-23T06:34:25.202 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.201+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=SDFJ0S3QCHF5 type=del size=1097054 2024-02-23T06:34:25.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.202+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=PF6QD53UR1CF type=del 2024-02-23T06:34:25.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.203+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=X3N1XYPZBJYN type=del size=3558744 2024-02-23T06:34:25.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.205+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NXS9WVNHCHRU.0 size=1048576 2024-02-23T06:34:25.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.205+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~NXS9WVNHCHRU.1 size=73877 2024-02-23T06:34:25.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.207+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=NXS9WVNHCHRU tag=9JTKVE2T0C2E type=write size=2171029 2024-02-23T06:34:25.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.209+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~37OJJ09ZKB15.0 size=1048576 2024-02-23T06:34:25.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.210+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~37OJJ09ZKB15.1 size=1048576 2024-02-23T06:34:25.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.211+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~37OJJ09ZKB15.2 size=906262 2024-02-23T06:34:25.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.211+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=37OJJ09ZKB15 tag=1X0G2YN26A9R type=write size=4051990 2024-02-23T06:34:25.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.212+0000 7f5e72834780 1 < canceled part key=_multipart_IDTA5RV6IUF6.2~RJ1VMSKCSI9Y.0 size=1048576 2024-02-23T06:34:25.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.213+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~RJ1VMSKCSI9Y.1 size=410133 2024-02-23T06:34:25.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.215+0000 7f5e72834780 1 < canceled multipart upload key=IDTA5RV6IUF6 upload=RJ1VMSKCSI9Y tag=HJAVG96ACLSQ type=write size=2507285 2024-02-23T06:34:25.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.217+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~0QQX04U6UW8T.0 size=1048576 2024-02-23T06:34:25.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.218+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~0QQX04U6UW8T.1 size=1048576 2024-02-23T06:34:25.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.219+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~0QQX04U6UW8T.2 size=549918 2024-02-23T06:34:25.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.219+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=0QQX04U6UW8T tag=RBSXP2FZSPGB type=write size=3695646 2024-02-23T06:34:25.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.220+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=GU6PKVN3REJ0 type=del 2024-02-23T06:34:25.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.222+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=SL4BD7JA5Y4C type=write size=178186 2024-02-23T06:34:25.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.223+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=SKGS95Q6MR1Z type=del 2024-02-23T06:34:25.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.224+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=GSX6IJC58C5M type=del size=1969692 2024-02-23T06:34:25.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.225+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=JAA0F6OCAC10 type=del 2024-02-23T06:34:25.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.227+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~TQIMUPQ2MYZ5.0 size=1048576 2024-02-23T06:34:25.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.228+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~TQIMUPQ2MYZ5.1 size=1048576 2024-02-23T06:34:25.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.229+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~TQIMUPQ2MYZ5.2 size=131179 2024-02-23T06:34:25.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.229+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=TQIMUPQ2MYZ5 tag=6CEULPMCHDBP type=write size=3276907 2024-02-23T06:34:25.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.231+0000 7f5e72834780 1 < suggested remove operation key=JV6FJONY04AW tag=F0DILBF9O1L3 type=del 2024-02-23T06:34:25.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.233+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=9EQYMO42EZS9 type=del size=954565 2024-02-23T06:34:25.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.234+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=Y8BG7QW89VVG type=del 2024-02-23T06:34:25.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.236+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~B9R8JBC0IUWA.0 size=1048576 2024-02-23T06:34:25.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.237+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~B9R8JBC0IUWA.1 size=72604 2024-02-23T06:34:25.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.237+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=B9R8JBC0IUWA tag=LNM01WRFVV34 type=write size=2169756 2024-02-23T06:34:25.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.238+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=WVRG2XO5QS6W type=del 2024-02-23T06:34:25.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.239+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=CRF4YSY3XH2C type=write size=323409 2024-02-23T06:34:25.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.240+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=E3US75XUJ2BK type=write size=1025289 2024-02-23T06:34:25.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.242+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=QZZI5G1QWV3H type=del size=4155531 2024-02-23T06:34:25.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.243+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~OY7DF7I9C1G8.0 size=1031801 2024-02-23T06:34:25.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.245+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=OY7DF7I9C1G8 tag=81PFJBHK8EGA type=write size=2080377 2024-02-23T06:34:25.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.247+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=JZMOINIYY9VF type=del size=108462 2024-02-23T06:34:25.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.248+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~HQCUUCNSNBZ4.0 size=1048576 2024-02-23T06:34:25.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.249+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~HQCUUCNSNBZ4.1 size=1048576 2024-02-23T06:34:25.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.250+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~HQCUUCNSNBZ4.2 size=996426 2024-02-23T06:34:25.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.253+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=HQCUUCNSNBZ4 tag=1OP4JLU6MWPK type=write size=4142154 2024-02-23T06:34:25.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.254+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=RNA24CMEE3Z8 type=del size=3699098 2024-02-23T06:34:25.256 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.255+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=4V4PVFKBE97C type=del 2024-02-23T06:34:25.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.258+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~4KZ8RNXG5GF0.0 size=1048576 2024-02-23T06:34:25.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.259+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~4KZ8RNXG5GF0.1 size=1048576 2024-02-23T06:34:25.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.260+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~4KZ8RNXG5GF0.2 size=745787 2024-02-23T06:34:25.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.260+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=4KZ8RNXG5GF0 tag=7MOCLL3MG0KR type=write size=3891515 2024-02-23T06:34:25.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.262+0000 7f5e72834780 1 < suggested remove operation key=WK98HMHAZIUB tag=OT1C3TV43K5P type=write 2024-02-23T06:34:25.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.264+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=1D8BTB2MGYFW type=del size=1821728 2024-02-23T06:34:25.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.265+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~VWDTHL5DCZW1.0 size=1048576 2024-02-23T06:34:25.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.266+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~VWDTHL5DCZW1.1 size=1048576 2024-02-23T06:34:25.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.267+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~VWDTHL5DCZW1.2 size=439431 2024-02-23T06:34:25.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.269+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=VWDTHL5DCZW1 tag=TQ9P0SCQHYLF type=write size=3585159 2024-02-23T06:34:25.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.270+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=BDIFMHGI39HU type=write size=332213 2024-02-23T06:34:25.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.271+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=SDFJ0S3QCHF5 type=del 2024-02-23T06:34:25.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.273+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=OFIELLLQZJZX type=del size=3311093 2024-02-23T06:34:25.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.275+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=X3N1XYPZBJYN type=del 2024-02-23T06:34:25.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.277+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~96TEKBA7DQU9.0 size=1048576 2024-02-23T06:34:25.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.278+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~96TEKBA7DQU9.1 size=1048576 2024-02-23T06:34:25.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.279+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~96TEKBA7DQU9.2 size=320035 2024-02-23T06:34:25.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.279+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=96TEKBA7DQU9 tag=C8B8TVL91GZS type=write size=3465763 2024-02-23T06:34:25.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.280+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~37OJJ09ZKB15.0 size=1048576 2024-02-23T06:34:25.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.281+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~37OJJ09ZKB15.1 size=1048576 2024-02-23T06:34:25.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.282+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~37OJJ09ZKB15.2 size=906262 2024-02-23T06:34:25.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.284+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=37OJJ09ZKB15 tag=1X0G2YN26A9R type=write size=4051990 2024-02-23T06:34:25.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.285+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=K3L88AFPBXOO type=write size=170587 2024-02-23T06:34:25.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.287+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~0QQX04U6UW8T.0 size=1048576 2024-02-23T06:34:25.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.288+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~0QQX04U6UW8T.1 size=1048576 2024-02-23T06:34:25.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.289+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~0QQX04U6UW8T.2 size=549918 2024-02-23T06:34:25.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.291+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=0QQX04U6UW8T tag=RBSXP2FZSPGB type=write size=3695646 2024-02-23T06:34:25.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.293+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~D7LWXJ4QKDU3.0 size=296892 2024-02-23T06:34:25.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.293+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=D7LWXJ4QKDU3 tag=G3UPJGDQFT4Y type=write size=1345468 2024-02-23T06:34:25.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.294+0000 7f5e72834780 1 < completed write operation key=GACVVXC2Z1YO tag=SL4BD7JA5Y4C type=write size=178186 2024-02-23T06:34:25.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.295+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=4MMU3K9430VD type=del size=174059 2024-02-23T06:34:25.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.297+0000 7f5e72834780 1 < suggested update operation key=TPADM4812N0Z tag=GSX6IJC58C5M type=del size=1969692 2024-02-23T06:34:25.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.299+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~5200M3YRXU0E.0 size=226410 2024-02-23T06:34:25.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.299+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=5200M3YRXU0E tag=5N537JQ7O55K type=write size=1274986 2024-02-23T06:34:25.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.300+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~TQIMUPQ2MYZ5.0 size=1048576 2024-02-23T06:34:25.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.301+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~TQIMUPQ2MYZ5.1 size=1048576 2024-02-23T06:34:25.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.302+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~TQIMUPQ2MYZ5.2 size=131179 2024-02-23T06:34:25.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.304+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=TQIMUPQ2MYZ5 tag=6CEULPMCHDBP type=write size=3276907 2024-02-23T06:34:25.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.305+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=LJ4XRAOO4NVV type=write size=865899 2024-02-23T06:34:25.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.306+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=9EQYMO42EZS9 type=del 2024-02-23T06:34:25.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.307+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=I85FIDAPTIRZ type=del size=2016500 2024-02-23T06:34:25.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.308+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~B9R8JBC0IUWA.0 size=1048576 2024-02-23T06:34:25.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.309+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~B9R8JBC0IUWA.1 size=72604 2024-02-23T06:34:25.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.311+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=B9R8JBC0IUWA tag=LNM01WRFVV34 type=write size=2169756 2024-02-23T06:34:25.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.312+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=6NMG68SKWFUY type=del size=3500024 2024-02-23T06:34:25.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.314+0000 7f5e72834780 1 < completed write operation key=721UW0AGSKVR tag=CRF4YSY3XH2C type=write size=323409 2024-02-23T06:34:25.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.316+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NQDSLOUOUNU9.0 size=1048576 2024-02-23T06:34:25.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.317+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NQDSLOUOUNU9.1 size=1048576 2024-02-23T06:34:25.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.317+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NQDSLOUOUNU9.2 size=974836 2024-02-23T06:34:25.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.317+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=NQDSLOUOUNU9 tag=B0TXZNQ0AWO8 type=write size=4120564 2024-02-23T06:34:25.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.320+0000 7f5e72834780 1 < suggested remove operation key=GW6EKQ84FQ6L tag=QZZI5G1QWV3H type=del 2024-02-23T06:34:25.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.321+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=K7IQIJ52NGE2 type=del size=1743668 2024-02-23T06:34:25.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.322+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=JZMOINIYY9VF type=del 2024-02-23T06:34:25.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.324+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=B3CGKA30JV79 type=del size=2337742 2024-02-23T06:34:25.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.326+0000 7f5e72834780 1 < suggested remove operation key=0WLEPDK2O30W tag=RNA24CMEE3Z8 type=del 2024-02-23T06:34:25.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.328+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~2XJILICD4IQM.0 size=963164 2024-02-23T06:34:25.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.328+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=2XJILICD4IQM tag=OKL2NXOQ0N3H type=write size=2011740 2024-02-23T06:34:25.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.329+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~4KZ8RNXG5GF0.0 size=1048576 2024-02-23T06:34:25.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.329+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~4KZ8RNXG5GF0.1 size=1048576 2024-02-23T06:34:25.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.330+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~4KZ8RNXG5GF0.2 size=745787 2024-02-23T06:34:25.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.334+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=4KZ8RNXG5GF0 tag=7MOCLL3MG0KR type=write size=3891515 2024-02-23T06:34:25.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.335+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=L1U5G3EKXX6O type=del size=3887789 2024-02-23T06:34:25.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.336+0000 7f5e72834780 -1 < failed to complete operation key=GW6EKQ84FQ6L tag=1D8BTB2MGYFW type=del size=1821728: (22) Invalid argument 2024-02-23T06:34:25.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.338+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~YTAXM5BNQZDJ.0 size=1048576 2024-02-23T06:34:25.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.339+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~YTAXM5BNQZDJ.1 size=286079 2024-02-23T06:34:25.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.339+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=YTAXM5BNQZDJ tag=9CXZTQB3XHP9 type=write size=2383231 2024-02-23T06:34:25.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.341+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=BDIFMHGI39HU type=write size=332213 2024-02-23T06:34:25.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.342+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=O59LKDZK7C9C type=del size=435872 2024-02-23T06:34:25.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.344+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=OFIELLLQZJZX type=del size=3311093 2024-02-23T06:34:25.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.346+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~MO37FTGJLJD8.0 size=644135 2024-02-23T06:34:25.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.346+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=MO37FTGJLJD8 tag=OH3R7RJGMUTO type=write size=1692711 2024-02-23T06:34:25.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.347+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~96TEKBA7DQU9.0 size=1048576 2024-02-23T06:34:25.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.348+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~96TEKBA7DQU9.1 size=1048576 2024-02-23T06:34:25.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.349+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~96TEKBA7DQU9.2 size=320035 2024-02-23T06:34:25.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.350+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=96TEKBA7DQU9 tag=C8B8TVL91GZS type=write size=3465763 2024-02-23T06:34:25.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.351+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=43Z0RG9D32GK type=del size=456517 2024-02-23T06:34:25.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.353+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=K3L88AFPBXOO type=write size=170587 2024-02-23T06:34:25.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.354+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=8T1DEWGMMNTE type=del size=3572971 2024-02-23T06:34:25.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.355+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~D7LWXJ4QKDU3.0 size=296892 2024-02-23T06:34:25.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.356+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=D7LWXJ4QKDU3 tag=G3UPJGDQFT4Y type=write size=1345468 2024-02-23T06:34:25.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.358+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=IGG30APFZLPU type=del size=2103605 2024-02-23T06:34:25.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.359+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=4MMU3K9430VD type=del 2024-02-23T06:34:25.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.360+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=JY4B05O7W4M6 type=del size=3240922 2024-02-23T06:34:25.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.361+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~5200M3YRXU0E.0 size=226410 2024-02-23T06:34:25.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.363+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=5200M3YRXU0E tag=5N537JQ7O55K type=write size=1274986 2024-02-23T06:34:25.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.364+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=95B5CEP3P8EB type=del size=1382718 2024-02-23T06:34:25.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.365+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=LJ4XRAOO4NVV type=write size=865899 2024-02-23T06:34:25.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.367+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~1LFU5TKYC4P0.0 size=760319 2024-02-23T06:34:25.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.367+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=1LFU5TKYC4P0 tag=7N362GDN6DX6 type=write size=1808895 2024-02-23T06:34:25.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.369+0000 7f5e72834780 1 < suggested remove operation key=ZC75CQ2789VE tag=I85FIDAPTIRZ type=del 2024-02-23T06:34:25.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.370+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=LLTD8H9Y33VX type=del size=1255533 2024-02-23T06:34:25.373 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.372+0000 7f5e72834780 1 < suggested remove operation key=TPADM4812N0Z tag=6NMG68SKWFUY type=del 2024-02-23T06:34:25.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.374+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~T40YTU3783BO.0 size=1048576 2024-02-23T06:34:25.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.375+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~T40YTU3783BO.1 size=101535 2024-02-23T06:34:25.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.375+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=T40YTU3783BO tag=W1V1Q6LMTJX2 type=write size=2198687 2024-02-23T06:34:25.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.376+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NQDSLOUOUNU9.0 size=1048576 2024-02-23T06:34:25.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.377+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NQDSLOUOUNU9.1 size=1048576 2024-02-23T06:34:25.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.378+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NQDSLOUOUNU9.2 size=974836 2024-02-23T06:34:25.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.380+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=NQDSLOUOUNU9 tag=B0TXZNQ0AWO8 type=write size=4120564 2024-02-23T06:34:25.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.382+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=9EBXRSUWM26K type=del size=2200624 2024-02-23T06:34:25.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.383+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=K7IQIJ52NGE2 type=del 2024-02-23T06:34:25.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.386+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=LIXO2SVIVXDQ type=del size=2084761 2024-02-23T06:34:25.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.387+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=B3CGKA30JV79 type=del 2024-02-23T06:34:25.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.388+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=DYN3Q7IDD336 type=del size=931795 2024-02-23T06:34:25.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.389+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~2XJILICD4IQM.0 size=963164 2024-02-23T06:34:25.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.393+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=2XJILICD4IQM tag=OKL2NXOQ0N3H type=write size=2011740 2024-02-23T06:34:25.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.395+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~O7AZQMFRURWE.0 size=1048576 2024-02-23T06:34:25.397 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.396+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~O7AZQMFRURWE.1 size=1048576 2024-02-23T06:34:25.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.396+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~O7AZQMFRURWE.2 size=571101 2024-02-23T06:34:25.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.397+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=O7AZQMFRURWE tag=QW8VBHTVXYM1 type=write size=3716829 2024-02-23T06:34:25.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.398+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=L1U5G3EKXX6O type=del 2024-02-23T06:34:25.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.399+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=ZIUA0HNLQA70 type=del size=1527991 2024-02-23T06:34:25.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.400+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~YTAXM5BNQZDJ.0 size=1048576 2024-02-23T06:34:25.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.401+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~YTAXM5BNQZDJ.1 size=286079 2024-02-23T06:34:25.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.403+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=YTAXM5BNQZDJ tag=9CXZTQB3XHP9 type=write size=2383231 2024-02-23T06:34:25.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.404+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=VD71YDDBE0RN type=del size=133121 2024-02-23T06:34:25.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.405+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=O59LKDZK7C9C type=del 2024-02-23T06:34:25.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.407+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~TYC40VPH42HH.0 size=262851 2024-02-23T06:34:25.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.407+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=TYC40VPH42HH tag=1B87I9G40F9K type=write size=1311427 2024-02-23T06:34:25.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.408+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~MO37FTGJLJD8.0 size=644135 2024-02-23T06:34:25.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.410+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=MO37FTGJLJD8 tag=OH3R7RJGMUTO type=write size=1692711 2024-02-23T06:34:25.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.411+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=I65TJ8Z4MUW5 type=del size=3592957 2024-02-23T06:34:25.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.413+0000 7f5e72834780 1 < suggested remove operation key=4M7BT05YB0C3 tag=43Z0RG9D32GK type=del 2024-02-23T06:34:25.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.415+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~TKRQM2W1ONQW.0 size=1048576 2024-02-23T06:34:25.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.416+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~TKRQM2W1ONQW.1 size=950491 2024-02-23T06:34:25.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.416+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=TKRQM2W1ONQW tag=20Q7QNM9DDV1 type=write size=3047643 2024-02-23T06:34:25.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.418+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=8T1DEWGMMNTE type=del 2024-02-23T06:34:25.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.419+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=DYDLAWRFOWU3 type=write size=228618 2024-02-23T06:34:25.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.420+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=IGG30APFZLPU type=del 2024-02-23T06:34:25.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.421+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=IN31U5WHMJID type=write size=956666 2024-02-23T06:34:25.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.422+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=JY4B05O7W4M6 type=del 2024-02-23T06:34:25.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.425+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~ZOP9NBOHJ7HF.0 size=141551 2024-02-23T06:34:25.426 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.425+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=ZOP9NBOHJ7HF tag=LY530Y79WB5X type=write size=1190127 2024-02-23T06:34:25.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.426+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=95B5CEP3P8EB type=del 2024-02-23T06:34:25.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.427+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=RI3E68QPJFNG type=del size=3952408 2024-02-23T06:34:25.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.428+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~1LFU5TKYC4P0.0 size=760319 2024-02-23T06:34:25.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.430+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=1LFU5TKYC4P0 tag=7N362GDN6DX6 type=write size=1808895 2024-02-23T06:34:25.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.432+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~7XWXHO02BAW3.0 size=1048576 2024-02-23T06:34:25.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.433+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~7XWXHO02BAW3.1 size=240557 2024-02-23T06:34:25.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.433+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=7XWXHO02BAW3 tag=F9EO0WRNIQ8N type=write size=2337709 2024-02-23T06:34:25.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.436+0000 7f5e72834780 1 < suggested update operation key=N8RXOY8X71MO tag=LLTD8H9Y33VX type=del size=1255533 2024-02-23T06:34:25.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.437+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=FH5H7U79TH21 type=del size=747585 2024-02-23T06:34:25.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.438+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~T40YTU3783BO.0 size=1048576 2024-02-23T06:34:25.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.439+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~T40YTU3783BO.1 size=101535 2024-02-23T06:34:25.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.441+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=T40YTU3783BO tag=W1V1Q6LMTJX2 type=write size=2198687 2024-02-23T06:34:25.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.443+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~VPP1CM5GQ3ZK.0 size=409549 2024-02-23T06:34:25.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.443+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=VPP1CM5GQ3ZK tag=R7VYWR4JBNBP type=write size=1458125 2024-02-23T06:34:25.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.444+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=9EBXRSUWM26K type=del 2024-02-23T06:34:25.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.445+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=D21XAUMHDIW0 type=write size=509205 2024-02-23T06:34:25.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.446+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=LIXO2SVIVXDQ type=del 2024-02-23T06:34:25.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.448+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=1DK10BO050H6 type=del size=574169 2024-02-23T06:34:25.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.450+0000 7f5e72834780 1 < suggested remove operation key=9ZCNDGBEPWMN tag=DYN3Q7IDD336 type=del 2024-02-23T06:34:25.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.453+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~3AFBK7HDZLBC.0 size=1048576 2024-02-23T06:34:25.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.454+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~3AFBK7HDZLBC.1 size=1048576 2024-02-23T06:34:25.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.455+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~3AFBK7HDZLBC.2 size=897267 2024-02-23T06:34:25.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.455+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=3AFBK7HDZLBC tag=ZCX0GO04O4DT type=write size=4042995 2024-02-23T06:34:25.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.455+0000 7f5e72834780 1 < canceled part key=_multipart_9ZCNDGBEPWMN.2~O7AZQMFRURWE.0 size=1048576 2024-02-23T06:34:25.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.456+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~O7AZQMFRURWE.1 size=1048576 2024-02-23T06:34:25.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.457+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~O7AZQMFRURWE.2 size=571101 2024-02-23T06:34:25.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.459+0000 7f5e72834780 1 < canceled multipart upload key=9ZCNDGBEPWMN upload=O7AZQMFRURWE tag=QW8VBHTVXYM1 type=write size=3716829 2024-02-23T06:34:25.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.461+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=K4GH1EWQEEV4 type=del size=2073986 2024-02-23T06:34:25.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.462+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=ZIUA0HNLQA70 type=del 2024-02-23T06:34:25.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.463+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=F04OTNGJ7CPX type=del size=3576570 2024-02-23T06:34:25.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.464+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=VD71YDDBE0RN type=del 2024-02-23T06:34:25.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.467+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~K500MWCNCMNW.0 size=1048576 2024-02-23T06:34:25.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.468+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~K500MWCNCMNW.1 size=1048576 2024-02-23T06:34:25.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.469+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~K500MWCNCMNW.2 size=942972 2024-02-23T06:34:25.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.469+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=K500MWCNCMNW tag=HOUCFKKQA6RX type=write size=4088700 2024-02-23T06:34:25.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.470+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~TYC40VPH42HH.0 size=262851 2024-02-23T06:34:25.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.472+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=TYC40VPH42HH tag=1B87I9G40F9K type=write size=1311427 2024-02-23T06:34:25.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.473+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=9MFCO28QPDNQ type=write size=708033 2024-02-23T06:34:25.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.475+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=I65TJ8Z4MUW5 type=del 2024-02-23T06:34:25.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.476+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=I3L8FTZS62C2 type=del size=3481783 2024-02-23T06:34:25.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.477+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~TKRQM2W1ONQW.0 size=1048576 2024-02-23T06:34:25.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.478+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~TKRQM2W1ONQW.1 size=950491 2024-02-23T06:34:25.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.481+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=TKRQM2W1ONQW tag=20Q7QNM9DDV1 type=write size=3047643 2024-02-23T06:34:25.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.482+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=EZJE4US3Q0OF type=write size=216181 2024-02-23T06:34:25.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.484+0000 7f5e72834780 1 < completed write operation key=GW6EKQ84FQ6L tag=DYDLAWRFOWU3 type=write size=228618 2024-02-23T06:34:25.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.485+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=2ULQEHCX39X4 type=write size=785107 2024-02-23T06:34:25.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.487+0000 7f5e72834780 1 < completed write operation key=WK98HMHAZIUB tag=IN31U5WHMJID type=write size=956666 2024-02-23T06:34:25.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.489+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~ZK91N61IUZAH.0 size=1048576 2024-02-23T06:34:25.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.490+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~ZK91N61IUZAH.1 size=1048576 2024-02-23T06:34:25.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.491+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~ZK91N61IUZAH.2 size=24489 2024-02-23T06:34:25.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.491+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=ZK91N61IUZAH tag=WVD7DIQIZD1B type=write size=3170217 2024-02-23T06:34:25.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.492+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~ZOP9NBOHJ7HF.0 size=141551 2024-02-23T06:34:25.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.495+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=ZOP9NBOHJ7HF tag=LY530Y79WB5X type=write size=1190127 2024-02-23T06:34:25.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.496+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=MY6K11EDXURN type=del size=2502340 2024-02-23T06:34:25.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.498+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=RI3E68QPJFNG type=del 2024-02-23T06:34:25.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.501+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~O52ZNHF0AR6X.0 size=1048576 2024-02-23T06:34:25.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.503+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~O52ZNHF0AR6X.1 size=677964 2024-02-23T06:34:25.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.503+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=O52ZNHF0AR6X tag=07FCZ7Y470SJ type=write size=2775116 2024-02-23T06:34:25.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.504+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~7XWXHO02BAW3.0 size=1048576 2024-02-23T06:34:25.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.505+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~7XWXHO02BAW3.1 size=240557 2024-02-23T06:34:25.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.507+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=7XWXHO02BAW3 tag=F9EO0WRNIQ8N type=write size=2337709 2024-02-23T06:34:25.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.508+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=15MPR99GX08M type=del size=1897625 2024-02-23T06:34:25.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.511+0000 7f5e72834780 1 < suggested update operation key=TNH85ZWPALJN tag=FH5H7U79TH21 type=del size=747585 2024-02-23T06:34:25.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.513+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~WTTDP0TILF5V.0 size=1048576 2024-02-23T06:34:25.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.514+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~WTTDP0TILF5V.1 size=420288 2024-02-23T06:34:25.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.514+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=WTTDP0TILF5V tag=IHKWJZYQUXTK type=write size=2517440 2024-02-23T06:34:25.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.515+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~VPP1CM5GQ3ZK.0 size=409549 2024-02-23T06:34:25.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.518+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=VPP1CM5GQ3ZK tag=R7VYWR4JBNBP type=write size=1458125 2024-02-23T06:34:25.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.520+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~8NLR7N37OV8K.0 size=1048576 2024-02-23T06:34:25.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.521+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~8NLR7N37OV8K.1 size=1048576 2024-02-23T06:34:25.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.522+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~8NLR7N37OV8K.2 size=185270 2024-02-23T06:34:25.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.522+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=8NLR7N37OV8K tag=1ZNKVOMOU52L type=write size=3330998 2024-02-23T06:34:25.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.523+0000 7f5e72834780 1 < completed write operation key=721UW0AGSKVR tag=D21XAUMHDIW0 type=write size=509205 2024-02-23T06:34:25.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.525+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~L9M78CVRHDGW.0 size=1048576 2024-02-23T06:34:25.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.526+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~L9M78CVRHDGW.1 size=758723 2024-02-23T06:34:25.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.526+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=L9M78CVRHDGW tag=C6N1FEO7GK3B type=write size=2855875 2024-02-23T06:34:25.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.528+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=1DK10BO050H6 type=del 2024-02-23T06:34:25.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.530+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~918ZA9SRQATJ.0 size=1048576 2024-02-23T06:34:25.532 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.531+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~918ZA9SRQATJ.1 size=1048576 2024-02-23T06:34:25.532 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.531+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~918ZA9SRQATJ.2 size=1019027 2024-02-23T06:34:25.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.531+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=918ZA9SRQATJ tag=XO9B1ATZ91YM type=write size=4164755 2024-02-23T06:34:25.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.533+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~3AFBK7HDZLBC.0 size=1048576 2024-02-23T06:34:25.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.534+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~3AFBK7HDZLBC.1 size=1048576 2024-02-23T06:34:25.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.535+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~3AFBK7HDZLBC.2 size=897267 2024-02-23T06:34:25.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.537+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=3AFBK7HDZLBC tag=ZCX0GO04O4DT type=write size=4042995 2024-02-23T06:34:25.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.538+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~LCXP3XS2PUZS.0 size=1048576 2024-02-23T06:34:25.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.539+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~LCXP3XS2PUZS.1 size=1048576 2024-02-23T06:34:25.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.540+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~LCXP3XS2PUZS.2 size=746940 2024-02-23T06:34:25.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.540+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=LCXP3XS2PUZS tag=BS68VH7GSUU0 type=write size=3892668 2024-02-23T06:34:25.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.541+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=K4GH1EWQEEV4 type=del 2024-02-23T06:34:25.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.543+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~FUH2JFHFUJJG.0 size=1048576 2024-02-23T06:34:25.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.544+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~FUH2JFHFUJJG.1 size=940707 2024-02-23T06:34:25.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.544+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=FUH2JFHFUJJG tag=BZBCCC3MH8Y1 type=write size=3037859 2024-02-23T06:34:25.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.546+0000 7f5e72834780 1 < suggested remove operation key=ZC75CQ2789VE tag=F04OTNGJ7CPX type=del 2024-02-23T06:34:25.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.547+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=Y3ZVXRPP9DYC type=del size=1922559 2024-02-23T06:34:25.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.549+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~K500MWCNCMNW.0 size=1048576 2024-02-23T06:34:25.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.549+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~K500MWCNCMNW.1 size=1048576 2024-02-23T06:34:25.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.549+0000 7f5e72834780 1 < canceled part key=_multipart_GACVVXC2Z1YO.2~K500MWCNCMNW.2 size=942972 2024-02-23T06:34:25.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.551+0000 7f5e72834780 1 < canceled multipart upload key=GACVVXC2Z1YO upload=K500MWCNCMNW tag=HOUCFKKQA6RX type=write size=4088700 2024-02-23T06:34:25.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.552+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=J4R21TNOZKYC type=del size=1686978 2024-02-23T06:34:25.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.553+0000 7f5e72834780 1 < completed write operation key=IDTA5RV6IUF6 tag=9MFCO28QPDNQ type=write size=708033 2024-02-23T06:34:25.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.555+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=HT4RWF6ERWX0 type=del size=3184101 2024-02-23T06:34:25.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.556+0000 7f5e72834780 1 < canceled operation key=7N8OH7EETRN8 tag=I3L8FTZS62C2 type=del size=3481783 2024-02-23T06:34:25.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.557+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=O3E73A7Z7XRU type=del size=4051109 2024-02-23T06:34:25.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.558+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=EZJE4US3Q0OF type=write size=216181 2024-02-23T06:34:25.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.560+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=YNS23BU0NSUS type=del size=2886800 2024-02-23T06:34:25.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.562+0000 7f5e72834780 1 < suggested update operation key=721UW0AGSKVR tag=2ULQEHCX39X4 type=write size=785107 2024-02-23T06:34:25.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.563+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=BOG1RQ55OXZ0 type=del size=2283675 2024-02-23T06:34:25.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.563+0000 7f5e72834780 1 < canceled part key=_multipart_VER8U5YMTPS6.2~ZK91N61IUZAH.0 size=1048576 2024-02-23T06:34:25.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.564+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~ZK91N61IUZAH.1 size=1048576 2024-02-23T06:34:25.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.565+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~ZK91N61IUZAH.2 size=24489 2024-02-23T06:34:25.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.568+0000 7f5e72834780 1 < canceled multipart upload key=VER8U5YMTPS6 upload=ZK91N61IUZAH tag=WVD7DIQIZD1B type=write size=3170217 2024-02-23T06:34:25.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.570+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~L24H27UEEGJ7.0 size=1048576 2024-02-23T06:34:25.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.571+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~L24H27UEEGJ7.1 size=1048576 2024-02-23T06:34:25.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.572+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~L24H27UEEGJ7.2 size=636250 2024-02-23T06:34:25.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.572+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=L24H27UEEGJ7 tag=MYJSBZL2KXAE type=write size=3781978 2024-02-23T06:34:25.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.574+0000 7f5e72834780 1 < suggested update operation key=N8RXOY8X71MO tag=MY6K11EDXURN type=del size=2502340 2024-02-23T06:34:25.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.575+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=8M4N38T59E4S type=write size=275632 2024-02-23T06:34:25.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.577+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~O52ZNHF0AR6X.0 size=1048576 2024-02-23T06:34:25.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.578+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~O52ZNHF0AR6X.1 size=677964 2024-02-23T06:34:25.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.580+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=O52ZNHF0AR6X tag=07FCZ7Y470SJ type=write size=2775116 2024-02-23T06:34:25.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.582+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~KU3THIQ943B2.0 size=591217 2024-02-23T06:34:25.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.582+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=KU3THIQ943B2 tag=DR0FQ43B5SGX type=write size=1639793 2024-02-23T06:34:25.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.583+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=15MPR99GX08M type=del 2024-02-23T06:34:25.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.585+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~UL8Z9OGVTNUQ.0 size=1048576 2024-02-23T06:34:25.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.586+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~UL8Z9OGVTNUQ.1 size=1048576 2024-02-23T06:34:25.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.587+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~UL8Z9OGVTNUQ.2 size=949242 2024-02-23T06:34:25.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.587+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=UL8Z9OGVTNUQ tag=YCHIQA0736XG type=write size=4094970 2024-02-23T06:34:25.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.588+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~WTTDP0TILF5V.0 size=1048576 2024-02-23T06:34:25.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.589+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~WTTDP0TILF5V.1 size=420288 2024-02-23T06:34:25.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.591+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=WTTDP0TILF5V tag=IHKWJZYQUXTK type=write size=2517440 2024-02-23T06:34:25.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.592+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=MJZLIZ6ILQU4 type=del size=1850562 2024-02-23T06:34:25.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.593+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~8NLR7N37OV8K.0 size=1048576 2024-02-23T06:34:25.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.594+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~8NLR7N37OV8K.1 size=1048576 2024-02-23T06:34:25.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.595+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~8NLR7N37OV8K.2 size=185270 2024-02-23T06:34:25.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.597+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=8NLR7N37OV8K tag=1ZNKVOMOU52L type=write size=3330998 2024-02-23T06:34:25.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.599+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~3LI4NKY8Q4D0.0 size=557219 2024-02-23T06:34:25.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.599+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=3LI4NKY8Q4D0 tag=5PSNH5NR211T type=write size=1605795 2024-02-23T06:34:25.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.600+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~L9M78CVRHDGW.0 size=1048576 2024-02-23T06:34:25.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.601+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~L9M78CVRHDGW.1 size=758723 2024-02-23T06:34:25.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.603+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=L9M78CVRHDGW tag=C6N1FEO7GK3B type=write size=2855875 2024-02-23T06:34:25.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.604+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=LKZ24J1QUY6W type=del size=3396293 2024-02-23T06:34:25.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.605+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~918ZA9SRQATJ.0 size=1048576 2024-02-23T06:34:25.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.606+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~918ZA9SRQATJ.1 size=1048576 2024-02-23T06:34:25.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.607+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~918ZA9SRQATJ.2 size=1019027 2024-02-23T06:34:25.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.611+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=918ZA9SRQATJ tag=XO9B1ATZ91YM type=write size=4164755 2024-02-23T06:34:25.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.614+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=NYB6ILQDH23A type=write size=773208 2024-02-23T06:34:25.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.615+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~LCXP3XS2PUZS.0 size=1048576 2024-02-23T06:34:25.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.616+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~LCXP3XS2PUZS.1 size=1048576 2024-02-23T06:34:25.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.616+0000 7f5e72834780 1 < canceled part key=_multipart_883VBT1ADE6K.2~LCXP3XS2PUZS.2 size=746940 2024-02-23T06:34:25.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.618+0000 7f5e72834780 1 < canceled multipart upload key=883VBT1ADE6K upload=LCXP3XS2PUZS tag=BS68VH7GSUU0 type=write size=3892668 2024-02-23T06:34:25.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.619+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=RBI0CN4SYF1I type=del size=1935501 2024-02-23T06:34:25.622 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.621+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~FUH2JFHFUJJG.0 size=1048576 2024-02-23T06:34:25.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.622+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~FUH2JFHFUJJG.1 size=940707 2024-02-23T06:34:25.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.624+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=FUH2JFHFUJJG tag=BZBCCC3MH8Y1 type=write size=3037859 2024-02-23T06:34:25.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.626+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~C68MPDXPFIFK.0 size=1048576 2024-02-23T06:34:25.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.627+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~C68MPDXPFIFK.1 size=1048576 2024-02-23T06:34:25.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.628+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~C68MPDXPFIFK.2 size=317572 2024-02-23T06:34:25.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.628+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=C68MPDXPFIFK tag=CB4A5GF53D4A type=write size=3463300 2024-02-23T06:34:25.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.629+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=Y3ZVXRPP9DYC type=del 2024-02-23T06:34:25.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.631+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~ZHDPBEBNU9DP.0 size=828102 2024-02-23T06:34:25.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.631+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=ZHDPBEBNU9DP tag=Q4CQEG6GJ9PJ type=write size=1876678 2024-02-23T06:34:25.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.632+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=J4R21TNOZKYC type=del 2024-02-23T06:34:25.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.634+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~E789IKJ6EQIH.0 size=1048576 2024-02-23T06:34:25.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.635+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~E789IKJ6EQIH.1 size=1048576 2024-02-23T06:34:25.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.638+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~E789IKJ6EQIH.2 size=457358 2024-02-23T06:34:25.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.638+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=E789IKJ6EQIH tag=L5MT3MT4G63S type=write size=3603086 2024-02-23T06:34:25.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.639+0000 7f5e72834780 -1 < failed to complete operation key=N8RXOY8X71MO tag=HT4RWF6ERWX0 type=del size=3184101: (22) Invalid argument 2024-02-23T06:34:25.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.640+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=JZCX3D8LA8WB type=del size=1594123 2024-02-23T06:34:25.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.641+0000 7f5e72834780 -1 < failed to complete operation key=N8RXOY8X71MO tag=O3E73A7Z7XRU type=del size=4051109: (22) Invalid argument 2024-02-23T06:34:25.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.643+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=28WYY3Z3IR8M type=write size=134696 2024-02-23T06:34:25.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.644+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=YNS23BU0NSUS type=del 2024-02-23T06:34:25.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.646+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~V18IXOBAPIXG.0 size=1048576 2024-02-23T06:34:25.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.647+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~V18IXOBAPIXG.1 size=557336 2024-02-23T06:34:25.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.647+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=V18IXOBAPIXG tag=D3T9SGFZFPTO type=write size=2654488 2024-02-23T06:34:25.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.648+0000 7f5e72834780 1 < canceled operation key=VEJ6D2J3LZI8 tag=BOG1RQ55OXZ0 type=del size=2283675 2024-02-23T06:34:25.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.649+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=57X1LUU8RPOV type=del size=1493109 2024-02-23T06:34:25.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.650+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~L24H27UEEGJ7.0 size=1048576 2024-02-23T06:34:25.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.651+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~L24H27UEEGJ7.1 size=1048576 2024-02-23T06:34:25.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.652+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~L24H27UEEGJ7.2 size=636250 2024-02-23T06:34:25.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.654+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=L24H27UEEGJ7 tag=MYJSBZL2KXAE type=write size=3781978 2024-02-23T06:34:25.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.656+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~VKDP41JMXINU.0 size=1048576 2024-02-23T06:34:25.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.657+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~VKDP41JMXINU.1 size=1048576 2024-02-23T06:34:25.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.658+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~VKDP41JMXINU.2 size=146339 2024-02-23T06:34:25.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.658+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=VKDP41JMXINU tag=S2FUZ1226Z1H type=write size=3292067 2024-02-23T06:34:25.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.659+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=8M4N38T59E4S type=write size=275632 2024-02-23T06:34:25.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.660+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=2RTC2EWLWUEN type=del size=1490940 2024-02-23T06:34:25.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.661+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~KU3THIQ943B2.0 size=591217 2024-02-23T06:34:25.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.663+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=KU3THIQ943B2 tag=DR0FQ43B5SGX type=write size=1639793 2024-02-23T06:34:25.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.664+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=1D62TZLIYHA1 type=del size=3389350 2024-02-23T06:34:25.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.665+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~UL8Z9OGVTNUQ.0 size=1048576 2024-02-23T06:34:25.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.666+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~UL8Z9OGVTNUQ.1 size=1048576 2024-02-23T06:34:25.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.666+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~UL8Z9OGVTNUQ.2 size=949242 2024-02-23T06:34:25.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.668+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=UL8Z9OGVTNUQ tag=YCHIQA0736XG type=write size=4094970 2024-02-23T06:34:25.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.669+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=48GMB1MLB5GD type=del size=624191 2024-02-23T06:34:25.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.670+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=MJZLIZ6ILQU4 type=del 2024-02-23T06:34:25.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.672+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~XTD4M4W6QM01.0 size=1048576 2024-02-23T06:34:25.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.673+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~XTD4M4W6QM01.1 size=556585 2024-02-23T06:34:25.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.673+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=XTD4M4W6QM01 tag=KYTHXDUE0UQG type=write size=2653737 2024-02-23T06:34:25.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.673+0000 7f5e72834780 1 < canceled part key=_multipart_VER8U5YMTPS6.2~3LI4NKY8Q4D0.0 size=557219 2024-02-23T06:34:25.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.675+0000 7f5e72834780 1 < canceled multipart upload key=VER8U5YMTPS6 upload=3LI4NKY8Q4D0 tag=5PSNH5NR211T type=write size=1605795 2024-02-23T06:34:25.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.677+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~CADMUMPQYR2D.0 size=242745 2024-02-23T06:34:25.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.677+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=CADMUMPQYR2D tag=VWBBN9L341RI type=write size=1291321 2024-02-23T06:34:25.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.679+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=LKZ24J1QUY6W type=del 2024-02-23T06:34:25.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.680+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=TVDPGYEUVVU1 type=del size=3037445 2024-02-23T06:34:25.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.681+0000 7f5e72834780 1 < completed write operation key=721UW0AGSKVR tag=NYB6ILQDH23A type=write size=773208 2024-02-23T06:34:25.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.683+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~CEZJ8JVW10T2.0 size=1048576 2024-02-23T06:34:25.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.684+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~CEZJ8JVW10T2.1 size=1048576 2024-02-23T06:34:25.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.685+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~CEZJ8JVW10T2.2 size=638296 2024-02-23T06:34:25.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.685+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=CEZJ8JVW10T2 tag=02ZJEX6HEWKI type=write size=3784024 2024-02-23T06:34:25.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.687+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=RBI0CN4SYF1I type=del 2024-02-23T06:34:25.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.688+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=PMBTUOTCI5V7 type=del size=2632664 2024-02-23T06:34:25.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.689+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~C68MPDXPFIFK.0 size=1048576 2024-02-23T06:34:25.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.690+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~C68MPDXPFIFK.1 size=1048576 2024-02-23T06:34:25.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.691+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~C68MPDXPFIFK.2 size=317572 2024-02-23T06:34:25.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.693+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=C68MPDXPFIFK tag=CB4A5GF53D4A type=write size=3463300 2024-02-23T06:34:25.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.694+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=XJB0AE1YD7IQ type=del size=3160262 2024-02-23T06:34:25.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.695+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~ZHDPBEBNU9DP.0 size=828102 2024-02-23T06:34:25.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.697+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=ZHDPBEBNU9DP tag=Q4CQEG6GJ9PJ type=write size=1876678 2024-02-23T06:34:25.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.699+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~XIRWA7TBTGF3.0 size=870194 2024-02-23T06:34:25.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.699+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=XIRWA7TBTGF3 tag=ZOJ3SQFGC9H2 type=write size=1918770 2024-02-23T06:34:25.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.700+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~E789IKJ6EQIH.0 size=1048576 2024-02-23T06:34:25.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.701+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~E789IKJ6EQIH.1 size=1048576 2024-02-23T06:34:25.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.701+0000 7f5e72834780 1 < canceled part key=_multipart_9ZCNDGBEPWMN.2~E789IKJ6EQIH.2 size=457358 2024-02-23T06:34:25.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.703+0000 7f5e72834780 1 < canceled multipart upload key=9ZCNDGBEPWMN upload=E789IKJ6EQIH tag=L5MT3MT4G63S type=write size=3603086 2024-02-23T06:34:25.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.704+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=WLY30AHYH02C type=del size=891770 2024-02-23T06:34:25.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.706+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=JZCX3D8LA8WB type=del 2024-02-23T06:34:25.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.707+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=DA51K199B3FA type=del size=537183 2024-02-23T06:34:25.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.708+0000 7f5e72834780 1 < completed write operation key=TNH85ZWPALJN tag=28WYY3Z3IR8M type=write size=134696 2024-02-23T06:34:25.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.709+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=H70XC3F8CHB7 type=write size=927033 2024-02-23T06:34:25.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.710+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~V18IXOBAPIXG.0 size=1048576 2024-02-23T06:34:25.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.711+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~V18IXOBAPIXG.1 size=557336 2024-02-23T06:34:25.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.713+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=V18IXOBAPIXG tag=D3T9SGFZFPTO type=write size=2654488 2024-02-23T06:34:25.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.715+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~IS0F3MBS4YEK.0 size=1048576 2024-02-23T06:34:25.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.716+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~IS0F3MBS4YEK.1 size=866728 2024-02-23T06:34:25.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.716+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=IS0F3MBS4YEK tag=YHXAGAEB63V9 type=write size=2963880 2024-02-23T06:34:25.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.717+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=57X1LUU8RPOV type=del 2024-02-23T06:34:25.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.718+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=W3FTWR64MEBS type=del size=1895387 2024-02-23T06:34:25.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.721+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~VKDP41JMXINU.0 size=1048576 2024-02-23T06:34:25.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.722+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~VKDP41JMXINU.1 size=1048576 2024-02-23T06:34:25.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.723+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~VKDP41JMXINU.2 size=146339 2024-02-23T06:34:25.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.725+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=VKDP41JMXINU tag=S2FUZ1226Z1H type=write size=3292067 2024-02-23T06:34:25.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.727+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~W1VHQA2XAI2L.0 size=355880 2024-02-23T06:34:25.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.727+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=W1VHQA2XAI2L tag=VG8L7UZAIRWB type=write size=1404456 2024-02-23T06:34:25.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.728+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=2RTC2EWLWUEN type=del 2024-02-23T06:34:25.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.730+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~763S64A6VBGZ.0 size=1048576 2024-02-23T06:34:25.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.731+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~763S64A6VBGZ.1 size=422839 2024-02-23T06:34:25.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.731+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=763S64A6VBGZ tag=J6X050E0SPJ9 type=write size=2519991 2024-02-23T06:34:25.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.733+0000 7f5e72834780 1 < suggested update operation key=RS03NUABC1U2 tag=1D62TZLIYHA1 type=del size=3389350 2024-02-23T06:34:25.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.735+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~YE2SWV1OEX1Z.0 size=1048576 2024-02-23T06:34:25.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.736+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~YE2SWV1OEX1Z.1 size=929109 2024-02-23T06:34:25.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.736+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=YE2SWV1OEX1Z tag=67Y0HAUZYCWI type=write size=3026261 2024-02-23T06:34:25.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.738+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=48GMB1MLB5GD type=del 2024-02-23T06:34:25.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.740+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~WPBPM2IOB2EA.0 size=1048576 2024-02-23T06:34:25.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.741+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~WPBPM2IOB2EA.1 size=1048576 2024-02-23T06:34:25.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.742+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~WPBPM2IOB2EA.2 size=288192 2024-02-23T06:34:25.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.742+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=WPBPM2IOB2EA tag=7TPOFYSNQZD2 type=write size=3433920 2024-02-23T06:34:25.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.743+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~XTD4M4W6QM01.0 size=1048576 2024-02-23T06:34:25.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.743+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~XTD4M4W6QM01.1 size=556585 2024-02-23T06:34:25.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.745+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=XTD4M4W6QM01 tag=KYTHXDUE0UQG type=write size=2653737 2024-02-23T06:34:25.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.746+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=0GSAJY8W6PTB type=del size=3993742 2024-02-23T06:34:25.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.746+0000 7f5e72834780 1 < canceled part key=_multipart_VER8U5YMTPS6.2~CADMUMPQYR2D.0 size=242745 2024-02-23T06:34:25.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.748+0000 7f5e72834780 1 < canceled multipart upload key=VER8U5YMTPS6 upload=CADMUMPQYR2D tag=VWBBN9L341RI type=write size=1291321 2024-02-23T06:34:25.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.750+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~8JMGOVXFZY6N.0 size=1048576 2024-02-23T06:34:25.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.751+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~8JMGOVXFZY6N.1 size=1048576 2024-02-23T06:34:25.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.752+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~8JMGOVXFZY6N.2 size=562201 2024-02-23T06:34:25.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.752+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=8JMGOVXFZY6N tag=M0KYK2LQNGIL type=write size=3707929 2024-02-23T06:34:25.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.753+0000 7f5e72834780 1 < canceled operation key=4M7BT05YB0C3 tag=TVDPGYEUVVU1 type=del size=3037445 2024-02-23T06:34:25.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.755+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~KH6CQG71EFNK.0 size=1048576 2024-02-23T06:34:25.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.756+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~KH6CQG71EFNK.1 size=1048576 2024-02-23T06:34:25.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.756+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~KH6CQG71EFNK.2 size=147471 2024-02-23T06:34:25.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.756+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=KH6CQG71EFNK tag=KT0ZX6RDNJ3D type=write size=3293199 2024-02-23T06:34:25.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.758+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~CEZJ8JVW10T2.0 size=1048576 2024-02-23T06:34:25.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.758+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~CEZJ8JVW10T2.1 size=1048576 2024-02-23T06:34:25.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.759+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~CEZJ8JVW10T2.2 size=638296 2024-02-23T06:34:25.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.761+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=CEZJ8JVW10T2 tag=02ZJEX6HEWKI type=write size=3784024 2024-02-23T06:34:25.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.763+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~B3NFXSIG8XZB.0 size=317653 2024-02-23T06:34:25.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.763+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=B3NFXSIG8XZB tag=FA3Q02EKKFA3 type=write size=1366229 2024-02-23T06:34:25.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.764+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=PMBTUOTCI5V7 type=del 2024-02-23T06:34:25.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.765+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=Y9UH3JND5FH9 type=del size=1097060 2024-02-23T06:34:25.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.766+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=XJB0AE1YD7IQ type=del 2024-02-23T06:34:25.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.767+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=RC13NYS95AOO type=write size=851585 2024-02-23T06:34:25.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.769+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~XIRWA7TBTGF3.0 size=870194 2024-02-23T06:34:25.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.770+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=XIRWA7TBTGF3 tag=ZOJ3SQFGC9H2 type=write size=1918770 2024-02-23T06:34:25.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.771+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=DYCH84M1GF5X type=del size=3008149 2024-02-23T06:34:25.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.773+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=WLY30AHYH02C type=del 2024-02-23T06:34:25.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.774+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~UN6IR2YIS58V.0 size=1048576 2024-02-23T06:34:25.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.775+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~UN6IR2YIS58V.1 size=1048576 2024-02-23T06:34:25.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.776+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~UN6IR2YIS58V.2 size=566101 2024-02-23T06:34:25.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.776+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=UN6IR2YIS58V tag=S74FAEA8W80T type=write size=3711829 2024-02-23T06:34:25.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.777+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=DA51K199B3FA type=del 2024-02-23T06:34:25.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.779+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~QTMP6QU1D4WB.0 size=1048576 2024-02-23T06:34:25.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.780+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~QTMP6QU1D4WB.1 size=1048576 2024-02-23T06:34:25.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.781+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~QTMP6QU1D4WB.2 size=702855 2024-02-23T06:34:25.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.781+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=QTMP6QU1D4WB tag=7BJKZ356RL3B type=write size=3848583 2024-02-23T06:34:25.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.782+0000 7f5e72834780 1 < completed write operation key=TNH85ZWPALJN tag=H70XC3F8CHB7 type=write size=927033 2024-02-23T06:34:25.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.784+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=OHU4IO7Q5Z2T type=del size=3175897 2024-02-23T06:34:25.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.785+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~IS0F3MBS4YEK.0 size=1048576 2024-02-23T06:34:25.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.785+0000 7f5e72834780 1 < canceled part key=_multipart_GACVVXC2Z1YO.2~IS0F3MBS4YEK.1 size=866728 2024-02-23T06:34:25.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.787+0000 7f5e72834780 1 < canceled multipart upload key=GACVVXC2Z1YO upload=IS0F3MBS4YEK tag=YHXAGAEB63V9 type=write size=2963880 2024-02-23T06:34:25.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.788+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=B4711P3VF835 type=del size=1034580 2024-02-23T06:34:25.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.789+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=W3FTWR64MEBS type=del 2024-02-23T06:34:25.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.790+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=OWW1DPTCRPOR type=del size=1598465 2024-02-23T06:34:25.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.792+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~W1VHQA2XAI2L.0 size=355880 2024-02-23T06:34:25.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.793+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=W1VHQA2XAI2L tag=VG8L7UZAIRWB type=write size=1404456 2024-02-23T06:34:25.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.796+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~VL47JA2940XW.0 size=1048576 2024-02-23T06:34:25.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.797+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~VL47JA2940XW.1 size=1048576 2024-02-23T06:34:25.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.797+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~VL47JA2940XW.2 size=415164 2024-02-23T06:34:25.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.797+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=VL47JA2940XW tag=MA9QYJC56E0F type=write size=3560892 2024-02-23T06:34:25.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.799+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~763S64A6VBGZ.0 size=1048576 2024-02-23T06:34:25.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.800+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~763S64A6VBGZ.1 size=422839 2024-02-23T06:34:25.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.802+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=763S64A6VBGZ tag=J6X050E0SPJ9 type=write size=2519991 2024-02-23T06:34:25.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.803+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=EC13RSR9ZLCR type=del size=4151506 2024-02-23T06:34:25.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.803+0000 7f5e72834780 1 < canceled part key=_multipart_JV6FJONY04AW.2~YE2SWV1OEX1Z.0 size=1048576 2024-02-23T06:34:25.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.804+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~YE2SWV1OEX1Z.1 size=929109 2024-02-23T06:34:25.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.806+0000 7f5e72834780 1 < canceled multipart upload key=JV6FJONY04AW upload=YE2SWV1OEX1Z tag=67Y0HAUZYCWI type=write size=3026261 2024-02-23T06:34:25.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.808+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=3UNNJLPQ1T44 type=del size=1706241 2024-02-23T06:34:25.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.809+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~WPBPM2IOB2EA.0 size=1048576 2024-02-23T06:34:25.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.810+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~WPBPM2IOB2EA.1 size=1048576 2024-02-23T06:34:25.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.811+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~WPBPM2IOB2EA.2 size=288192 2024-02-23T06:34:25.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.813+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=WPBPM2IOB2EA tag=7TPOFYSNQZD2 type=write size=3433920 2024-02-23T06:34:25.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.814+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=T8XJYAXZ90YV type=del size=3648914 2024-02-23T06:34:25.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.815+0000 7f5e72834780 1 < canceled operation key=883VBT1ADE6K tag=0GSAJY8W6PTB type=del size=3993742 2024-02-23T06:34:25.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.818+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~09IDX56ON9AN.0 size=297511 2024-02-23T06:34:25.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.818+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=09IDX56ON9AN tag=1VPK4Z535M55 type=write size=1346087 2024-02-23T06:34:25.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.819+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~8JMGOVXFZY6N.0 size=1048576 2024-02-23T06:34:25.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.820+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~8JMGOVXFZY6N.1 size=1048576 2024-02-23T06:34:25.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.821+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~8JMGOVXFZY6N.2 size=562201 2024-02-23T06:34:25.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.823+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=8JMGOVXFZY6N tag=M0KYK2LQNGIL type=write size=3707929 2024-02-23T06:34:25.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.824+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=VASRMWR9F1S9 type=del size=2747252 2024-02-23T06:34:25.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.824+0000 7f5e72834780 1 < canceled part key=_multipart_883VBT1ADE6K.2~KH6CQG71EFNK.0 size=1048576 2024-02-23T06:34:25.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.826+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~KH6CQG71EFNK.1 size=1048576 2024-02-23T06:34:25.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.827+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~KH6CQG71EFNK.2 size=147471 2024-02-23T06:34:25.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.829+0000 7f5e72834780 1 < canceled multipart upload key=883VBT1ADE6K upload=KH6CQG71EFNK tag=KT0ZX6RDNJ3D type=write size=3293199 2024-02-23T06:34:25.831 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.830+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=KN73PDW0CP1L type=del size=1213599 2024-02-23T06:34:25.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.831+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~B3NFXSIG8XZB.0 size=317653 2024-02-23T06:34:25.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.833+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=B3NFXSIG8XZB tag=FA3Q02EKKFA3 type=write size=1366229 2024-02-23T06:34:25.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.837+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~ZO4F5L5WIF60.0 size=1048576 2024-02-23T06:34:25.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.838+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~ZO4F5L5WIF60.1 size=148435 2024-02-23T06:34:25.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.838+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=ZO4F5L5WIF60 tag=9LCNHTJIU3SX type=write size=2245587 2024-02-23T06:34:25.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.839+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=Y9UH3JND5FH9 type=del 2024-02-23T06:34:25.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.840+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=9DRHQRPHWB9E type=write size=804314 2024-02-23T06:34:25.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.842+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=RC13NYS95AOO type=write size=851585 2024-02-23T06:34:25.844 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.843+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=BOUC3RXOE15U type=write size=196773 2024-02-23T06:34:25.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.844+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=DYCH84M1GF5X type=del 2024-02-23T06:34:25.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.847+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~Z33VQOHHQUPH.0 size=755588 2024-02-23T06:34:25.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.847+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=Z33VQOHHQUPH tag=RPX69EKRDWNA type=write size=1804164 2024-02-23T06:34:25.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.848+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~UN6IR2YIS58V.0 size=1048576 2024-02-23T06:34:25.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.849+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~UN6IR2YIS58V.1 size=1048576 2024-02-23T06:34:25.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.850+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~UN6IR2YIS58V.2 size=566101 2024-02-23T06:34:25.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.852+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=UN6IR2YIS58V tag=S74FAEA8W80T type=write size=3711829 2024-02-23T06:34:25.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.854+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=YJ37RAXJMUFY type=del size=2591668 2024-02-23T06:34:25.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.855+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~QTMP6QU1D4WB.0 size=1048576 2024-02-23T06:34:25.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.856+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~QTMP6QU1D4WB.1 size=1048576 2024-02-23T06:34:25.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.857+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~QTMP6QU1D4WB.2 size=702855 2024-02-23T06:34:25.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.858+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=QTMP6QU1D4WB tag=7BJKZ356RL3B type=write size=3848583 2024-02-23T06:34:25.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.860+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~MT0C5F69LYUT.0 size=1048576 2024-02-23T06:34:25.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.861+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~MT0C5F69LYUT.1 size=699208 2024-02-23T06:34:25.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.861+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=MT0C5F69LYUT tag=2T36O0YD25L1 type=write size=2796360 2024-02-23T06:34:25.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.862+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=OHU4IO7Q5Z2T type=del 2024-02-23T06:34:25.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.864+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=U1ZKTYQLBDHP type=del size=1063745 2024-02-23T06:34:25.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.866+0000 7f5e72834780 1 < suggested remove operation key=ZC75CQ2789VE tag=B4711P3VF835 type=del 2024-02-23T06:34:25.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.867+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=5XFNQNKCMPH3 type=write size=614498 2024-02-23T06:34:25.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.868+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=OWW1DPTCRPOR type=del 2024-02-23T06:34:25.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.869+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=KSI0WG3O1HNZ type=del size=99929 2024-02-23T06:34:25.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.870+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~VL47JA2940XW.0 size=1048576 2024-02-23T06:34:25.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.871+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~VL47JA2940XW.1 size=1048576 2024-02-23T06:34:25.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.872+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~VL47JA2940XW.2 size=415164 2024-02-23T06:34:25.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.874+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=VL47JA2940XW tag=MA9QYJC56E0F type=write size=3560892 2024-02-23T06:34:25.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.875+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=24EVXUDLXFWM type=del size=4078768 2024-02-23T06:34:25.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.877+0000 7f5e72834780 1 < suggested update operation key=R3STDBS79MV0 tag=EC13RSR9ZLCR type=del size=4151506 2024-02-23T06:34:25.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.878+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=8ZMRURMCU504 type=del size=3678944 2024-02-23T06:34:25.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.880+0000 7f5e72834780 1 < suggested update operation key=GW6EKQ84FQ6L tag=3UNNJLPQ1T44 type=del size=1706241 2024-02-23T06:34:25.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.882+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~JA9MLCX6YQD5.0 size=1048576 2024-02-23T06:34:25.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.883+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~JA9MLCX6YQD5.1 size=563686 2024-02-23T06:34:25.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.883+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=JA9MLCX6YQD5 tag=L02GDRF6LMB4 type=write size=2660838 2024-02-23T06:34:25.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.884+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=T8XJYAXZ90YV type=del 2024-02-23T06:34:25.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.886+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~MQ3K68V6CKOV.0 size=509918 2024-02-23T06:34:25.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.886+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=MQ3K68V6CKOV tag=259X4GOKLJ4L type=write size=1558494 2024-02-23T06:34:25.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.888+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~09IDX56ON9AN.0 size=297511 2024-02-23T06:34:25.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.890+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=09IDX56ON9AN tag=1VPK4Z535M55 type=write size=1346087 2024-02-23T06:34:25.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.891+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=MFO30ENAIGLZ type=write size=470414 2024-02-23T06:34:25.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.892+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=VASRMWR9F1S9 type=del 2024-02-23T06:34:25.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.895+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~SEKG2X6VOA72.0 size=1048576 2024-02-23T06:34:25.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.895+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~SEKG2X6VOA72.1 size=1048576 2024-02-23T06:34:25.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.896+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~SEKG2X6VOA72.2 size=88763 2024-02-23T06:34:25.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.896+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=SEKG2X6VOA72 tag=BL0LM95DI3KH type=write size=3234491 2024-02-23T06:34:25.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.898+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=KN73PDW0CP1L type=del 2024-02-23T06:34:25.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.900+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~5BMBIKGPK4A4.0 size=1048576 2024-02-23T06:34:25.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.901+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~5BMBIKGPK4A4.1 size=340946 2024-02-23T06:34:25.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.901+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=5BMBIKGPK4A4 tag=QVZIPKY30YX1 type=write size=2438098 2024-02-23T06:34:25.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.902+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~ZO4F5L5WIF60.0 size=1048576 2024-02-23T06:34:25.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.903+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~ZO4F5L5WIF60.1 size=148435 2024-02-23T06:34:25.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.906+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=ZO4F5L5WIF60 tag=9LCNHTJIU3SX type=write size=2245587 2024-02-23T06:34:25.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.907+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=AS5WJ6EACWLI type=del size=2876952 2024-02-23T06:34:25.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.908+0000 7f5e72834780 1 < completed write operation key=N8RXOY8X71MO tag=9DRHQRPHWB9E type=write size=804314 2024-02-23T06:34:25.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.909+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=J0ELHJPP4AQ4 type=del size=1371132 2024-02-23T06:34:25.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.911+0000 7f5e72834780 1 < completed write operation key=VEJ6D2J3LZI8 tag=BOUC3RXOE15U type=write size=196773 2024-02-23T06:34:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.913+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~D1EDHUFN017F.0 size=1048576 2024-02-23T06:34:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.914+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~D1EDHUFN017F.1 size=1048576 2024-02-23T06:34:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.915+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~D1EDHUFN017F.2 size=780080 2024-02-23T06:34:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.915+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=D1EDHUFN017F tag=XHQSHGN6YD87 type=write size=3925808 2024-02-23T06:34:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.916+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~Z33VQOHHQUPH.0 size=755588 2024-02-23T06:34:25.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.918+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=Z33VQOHHQUPH tag=RPX69EKRDWNA type=write size=1804164 2024-02-23T06:34:25.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.920+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~6J7HZOMAVJKB.0 size=1048576 2024-02-23T06:34:25.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.921+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~6J7HZOMAVJKB.1 size=838105 2024-02-23T06:34:25.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.921+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=6J7HZOMAVJKB tag=4UQKLDWJGW5X type=write size=2935257 2024-02-23T06:34:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.922+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=YJ37RAXJMUFY type=del 2024-02-23T06:34:25.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.923+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=C888KRBO6OQJ type=del size=2382302 2024-02-23T06:34:25.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.924+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~MT0C5F69LYUT.0 size=1048576 2024-02-23T06:34:25.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.925+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~MT0C5F69LYUT.1 size=699208 2024-02-23T06:34:25.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.927+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=MT0C5F69LYUT tag=2T36O0YD25L1 type=write size=2796360 2024-02-23T06:34:25.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.928+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=MY2VSN371OM5 type=del size=3811208 2024-02-23T06:34:25.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.930+0000 7f5e72834780 1 < canceled operation key=0WLEPDK2O30W tag=U1ZKTYQLBDHP type=del size=1063745 2024-02-23T06:34:25.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.931+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=MMXGMRNMSKNJ type=del size=3008623 2024-02-23T06:34:25.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.932+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=5XFNQNKCMPH3 type=write size=614498 2024-02-23T06:34:25.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.934+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~NH46WBHKEGR5.0 size=1048576 2024-02-23T06:34:25.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.936+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~NH46WBHKEGR5.1 size=678523 2024-02-23T06:34:25.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.936+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=NH46WBHKEGR5 tag=TG9KEO4TI1Q9 type=write size=2775675 2024-02-23T06:34:25.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.938+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=KSI0WG3O1HNZ type=del 2024-02-23T06:34:25.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.940+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=NK6V53NB0XY6 type=del size=1793007 2024-02-23T06:34:25.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.942+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=24EVXUDLXFWM type=del 2024-02-23T06:34:25.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.944+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~P3MHB5CUAP19.0 size=778235 2024-02-23T06:34:25.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.944+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=P3MHB5CUAP19 tag=1KM2AT76DZJA type=write size=1826811 2024-02-23T06:34:25.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.945+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=8ZMRURMCU504 type=del 2024-02-23T06:34:25.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.947+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=Q9T4VTCLMP1Q type=del size=347040 2024-02-23T06:34:25.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.948+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~JA9MLCX6YQD5.0 size=1048576 2024-02-23T06:34:25.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.949+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~JA9MLCX6YQD5.1 size=563686 2024-02-23T06:34:25.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.951+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=JA9MLCX6YQD5 tag=L02GDRF6LMB4 type=write size=2660838 2024-02-23T06:34:25.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.952+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=SCNK3R7SJSL8 type=del size=1962052 2024-02-23T06:34:25.954 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.953+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~MQ3K68V6CKOV.0 size=509918 2024-02-23T06:34:25.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.955+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=MQ3K68V6CKOV tag=259X4GOKLJ4L type=write size=1558494 2024-02-23T06:34:25.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.957+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~LK34LOPOJX66.0 size=1048576 2024-02-23T06:34:25.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.958+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~LK34LOPOJX66.1 size=532652 2024-02-23T06:34:25.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.958+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=LK34LOPOJX66 tag=87S22EGERJB8 type=write size=2629804 2024-02-23T06:34:25.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.960+0000 7f5e72834780 1 < completed write operation key=9ZCNDGBEPWMN tag=MFO30ENAIGLZ type=write size=470414 2024-02-23T06:34:25.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.961+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=84L3QT4NNF70 type=del size=1389800 2024-02-23T06:34:25.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.962+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~SEKG2X6VOA72.0 size=1048576 2024-02-23T06:34:25.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.963+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~SEKG2X6VOA72.1 size=1048576 2024-02-23T06:34:25.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.964+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~SEKG2X6VOA72.2 size=88763 2024-02-23T06:34:25.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.966+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=SEKG2X6VOA72 tag=BL0LM95DI3KH type=write size=3234491 2024-02-23T06:34:25.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.967+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=O7KRCFDIMELX type=del size=932070 2024-02-23T06:34:25.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.968+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~5BMBIKGPK4A4.0 size=1048576 2024-02-23T06:34:25.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.968+0000 7f5e72834780 1 < canceled part key=_multipart_VER8U5YMTPS6.2~5BMBIKGPK4A4.1 size=340946 2024-02-23T06:34:25.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.970+0000 7f5e72834780 1 < canceled multipart upload key=VER8U5YMTPS6 upload=5BMBIKGPK4A4 tag=QVZIPKY30YX1 type=write size=2438098 2024-02-23T06:34:25.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.971+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=8ODV9ZG0JIBS type=del size=129047 2024-02-23T06:34:25.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.972+0000 7f5e72834780 1 < canceled operation key=LUERFL6AN6HF tag=AS5WJ6EACWLI type=del size=2876952 2024-02-23T06:34:25.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.974+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=QW6RRAVDGDYH type=del size=3294548 2024-02-23T06:34:25.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.975+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=J0ELHJPP4AQ4 type=del 2024-02-23T06:34:25.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.977+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~Q4RK13IBDQLH.0 size=1048576 2024-02-23T06:34:25.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.978+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~Q4RK13IBDQLH.1 size=1048576 2024-02-23T06:34:25.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.979+0000 7f5e72834780 1 > prepared part key=_multipart_9ZCNDGBEPWMN.2~Q4RK13IBDQLH.2 size=422073 2024-02-23T06:34:25.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.979+0000 7f5e72834780 1 > prepared multipart upload key=9ZCNDGBEPWMN upload=Q4RK13IBDQLH tag=E1FGR3013715 type=write size=3567801 2024-02-23T06:34:25.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.980+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~D1EDHUFN017F.0 size=1048576 2024-02-23T06:34:25.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.981+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~D1EDHUFN017F.1 size=1048576 2024-02-23T06:34:25.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.982+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~D1EDHUFN017F.2 size=780080 2024-02-23T06:34:25.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.983+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=D1EDHUFN017F tag=XHQSHGN6YD87 type=write size=3925808 2024-02-23T06:34:25.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.986+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~6UE4403PUOZ3.0 size=1048576 2024-02-23T06:34:25.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.986+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~6UE4403PUOZ3.1 size=547114 2024-02-23T06:34:25.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.986+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=6UE4403PUOZ3 tag=FGAOEQQQNJT8 type=write size=2644266 2024-02-23T06:34:25.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.988+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~6J7HZOMAVJKB.0 size=1048576 2024-02-23T06:34:25.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.988+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~6J7HZOMAVJKB.1 size=838105 2024-02-23T06:34:25.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.990+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=6J7HZOMAVJKB tag=4UQKLDWJGW5X type=write size=2935257 2024-02-23T06:34:25.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.991+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=0QB93WCQ78T3 type=del size=3874227 2024-02-23T06:34:25.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.993+0000 7f5e72834780 1 < canceled operation key=VER8U5YMTPS6 tag=C888KRBO6OQJ type=del size=2382302 2024-02-23T06:34:25.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.994+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=01RRAWZ6M946 type=del size=2220398 2024-02-23T06:34:25.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.995+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=MY2VSN371OM5 type=del 2024-02-23T06:34:25.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.996+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=86T840CIH5F6 type=del size=1527219 2024-02-23T06:34:25.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.997+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=MMXGMRNMSKNJ type=del 2024-02-23T06:34:25.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.998+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=HYEZ2NIKMTF7 type=del size=1766005 2024-02-23T06:34:26.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:25.999+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~NH46WBHKEGR5.0 size=1048576 2024-02-23T06:34:26.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.002+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~NH46WBHKEGR5.1 size=678523 2024-02-23T06:34:26.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.004+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=NH46WBHKEGR5 tag=TG9KEO4TI1Q9 type=write size=2775675 2024-02-23T06:34:26.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.005+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=IK1DAYZ1Q7EG type=write size=399742 2024-02-23T06:34:26.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.006+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=NK6V53NB0XY6 type=del 2024-02-23T06:34:26.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.008+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~4QMDFOA19TOV.0 size=1048576 2024-02-23T06:34:26.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.009+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~4QMDFOA19TOV.1 size=1048576 2024-02-23T06:34:26.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.010+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~4QMDFOA19TOV.2 size=383331 2024-02-23T06:34:26.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.010+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=4QMDFOA19TOV tag=Y0BP63LBIV1A type=write size=3529059 2024-02-23T06:34:26.012 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.011+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~P3MHB5CUAP19.0 size=778235 2024-02-23T06:34:26.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.013+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=P3MHB5CUAP19 tag=1KM2AT76DZJA type=write size=1826811 2024-02-23T06:34:26.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.015+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~KD3F7FK6P2IV.0 size=188792 2024-02-23T06:34:26.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.015+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=KD3F7FK6P2IV tag=B0D9U0OV2QAB type=write size=1237368 2024-02-23T06:34:26.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.016+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=Q9T4VTCLMP1Q type=del 2024-02-23T06:34:26.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.017+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=K20JZP3I8BBV type=write size=180232 2024-02-23T06:34:26.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.018+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=SCNK3R7SJSL8 type=del 2024-02-23T06:34:26.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.020+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=V3UGAYGB719B type=del size=1967627 2024-02-23T06:34:26.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.020+0000 7f5e72834780 1 < canceled part key=_multipart_QGGULCYZ0ZSA.2~LK34LOPOJX66.0 size=1048576 2024-02-23T06:34:26.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.021+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~LK34LOPOJX66.1 size=532652 2024-02-23T06:34:26.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.023+0000 7f5e72834780 1 < canceled multipart upload key=QGGULCYZ0ZSA upload=LK34LOPOJX66 tag=87S22EGERJB8 type=write size=2629804 2024-02-23T06:34:26.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.024+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=IBQMI7C16UJQ type=del size=1804665 2024-02-23T06:34:26.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.025+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=84L3QT4NNF70 type=del 2024-02-23T06:34:26.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.026+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=V2YEXU69SJBX type=write size=351988 2024-02-23T06:34:26.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.027+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=O7KRCFDIMELX type=del 2024-02-23T06:34:26.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.028+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=Q6NOLX9MMHEJ type=del size=3804051 2024-02-23T06:34:26.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.030+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=8ODV9ZG0JIBS type=del 2024-02-23T06:34:26.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.031+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=97XL4SL3JFSH type=write size=445602 2024-02-23T06:34:26.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.032+0000 7f5e72834780 1 < canceled operation key=IDTA5RV6IUF6 tag=QW6RRAVDGDYH type=del size=3294548 2024-02-23T06:34:26.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.034+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~UQ8HP5O3RFWI.0 size=1048576 2024-02-23T06:34:26.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.035+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~UQ8HP5O3RFWI.1 size=408967 2024-02-23T06:34:26.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.035+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=UQ8HP5O3RFWI tag=DUS5B1392IQY type=write size=2506119 2024-02-23T06:34:26.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.036+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~Q4RK13IBDQLH.0 size=1048576 2024-02-23T06:34:26.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.037+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~Q4RK13IBDQLH.1 size=1048576 2024-02-23T06:34:26.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.038+0000 7f5e72834780 1 < completed part key=_multipart_9ZCNDGBEPWMN.2~Q4RK13IBDQLH.2 size=422073 2024-02-23T06:34:26.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.040+0000 7f5e72834780 1 < completed multipart upload key=9ZCNDGBEPWMN upload=Q4RK13IBDQLH tag=E1FGR3013715 type=write size=3567801 2024-02-23T06:34:26.043 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.042+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~DPTNV29QCUUK.0 size=1048576 2024-02-23T06:34:26.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.043+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~DPTNV29QCUUK.1 size=249766 2024-02-23T06:34:26.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.043+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=DPTNV29QCUUK tag=3RSXGKNKYMAV type=write size=2346918 2024-02-23T06:34:26.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.044+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~6UE4403PUOZ3.0 size=1048576 2024-02-23T06:34:26.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.045+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~6UE4403PUOZ3.1 size=547114 2024-02-23T06:34:26.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.048+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=6UE4403PUOZ3 tag=FGAOEQQQNJT8 type=write size=2644266 2024-02-23T06:34:26.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.051+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~VIV3IV9RJ8CM.0 size=1048576 2024-02-23T06:34:26.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.051+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~VIV3IV9RJ8CM.1 size=73069 2024-02-23T06:34:26.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.051+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=VIV3IV9RJ8CM tag=U6FZY4MXFZ01 type=write size=2170221 2024-02-23T06:34:26.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.053+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=0QB93WCQ78T3 type=del 2024-02-23T06:34:26.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.054+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=OV5FO5IE4SHN type=del size=1649560 2024-02-23T06:34:26.056 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.055+0000 7f5e72834780 1 < canceled operation key=VEJ6D2J3LZI8 tag=01RRAWZ6M946 type=del size=2220398 2024-02-23T06:34:26.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.056+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=81NK2S1JHSXS type=del size=567532 2024-02-23T06:34:26.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.057+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=86T840CIH5F6 type=del 2024-02-23T06:34:26.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.059+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~A60JZ4N29G8W.0 size=1048576 2024-02-23T06:34:26.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.060+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~A60JZ4N29G8W.1 size=1048576 2024-02-23T06:34:26.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.061+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~A60JZ4N29G8W.2 size=656021 2024-02-23T06:34:26.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.061+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=A60JZ4N29G8W tag=RUWRS4ZHSFND type=write size=3801749 2024-02-23T06:34:26.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.063+0000 7f5e72834780 1 < suggested remove operation key=GWTK3YV0RY21 tag=HYEZ2NIKMTF7 type=del 2024-02-23T06:34:26.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.065+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~QGG2CE704S8J.0 size=413657 2024-02-23T06:34:26.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.065+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=QGG2CE704S8J tag=C78301C7M9GF type=write size=1462233 2024-02-23T06:34:26.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.066+0000 7f5e72834780 1 < completed write operation key=8Q6WC7B9BY5Q tag=IK1DAYZ1Q7EG type=write size=399742 2024-02-23T06:34:26.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.067+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=P3SZ8AMOJSXT type=write size=966584 2024-02-23T06:34:26.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.068+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~4QMDFOA19TOV.0 size=1048576 2024-02-23T06:34:26.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.069+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~4QMDFOA19TOV.1 size=1048576 2024-02-23T06:34:26.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.070+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~4QMDFOA19TOV.2 size=383331 2024-02-23T06:34:26.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.072+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=4QMDFOA19TOV tag=Y0BP63LBIV1A type=write size=3529059 2024-02-23T06:34:26.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.074+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~4N2HV5HLR582.0 size=397936 2024-02-23T06:34:26.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.074+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=4N2HV5HLR582 tag=WKPVONES04C3 type=write size=1446512 2024-02-23T06:34:26.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.075+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~KD3F7FK6P2IV.0 size=188792 2024-02-23T06:34:26.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.077+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=KD3F7FK6P2IV tag=B0D9U0OV2QAB type=write size=1237368 2024-02-23T06:34:26.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.078+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=TXPV63U3JZHA type=write size=805954 2024-02-23T06:34:26.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.081+0000 7f5e72834780 1 < suggested remove operation key=QZLNM2RQ9SDC tag=K20JZP3I8BBV type=write 2024-02-23T06:34:26.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.082+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=IQQWYYD14JD6 type=del size=2404655 2024-02-23T06:34:26.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.083+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=V3UGAYGB719B type=del 2024-02-23T06:34:26.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.084+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=VFI62O1PWDAZ type=del size=1048437 2024-02-23T06:34:26.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.085+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=IBQMI7C16UJQ type=del 2024-02-23T06:34:26.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.087+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=NEP3JVZOQ83Q type=del size=102540 2024-02-23T06:34:26.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.088+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=V2YEXU69SJBX type=write size=351988 2024-02-23T06:34:26.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.089+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=VZIU6H12JN2R type=del size=2821903 2024-02-23T06:34:26.091 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.090+0000 7f5e72834780 -1 < failed to complete operation key=GWTK3YV0RY21 tag=Q6NOLX9MMHEJ type=del size=3804051: (22) Invalid argument 2024-02-23T06:34:26.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.091+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=4V01W3VVVLQZ type=del size=2607501 2024-02-23T06:34:26.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.092+0000 7f5e72834780 -1 < no bi entry to suggest for operation key=QZLNM2RQ9SDC tag=97XL4SL3JFSH type=write size=445602: (2) No such file or directory 2024-02-23T06:34:26.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.094+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~YEWWDORLWFQP.0 size=893196 2024-02-23T06:34:26.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.094+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=YEWWDORLWFQP tag=WGSV0NA4BXRG type=write size=1941772 2024-02-23T06:34:26.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.095+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~UQ8HP5O3RFWI.0 size=1048576 2024-02-23T06:34:26.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.096+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~UQ8HP5O3RFWI.1 size=408967 2024-02-23T06:34:26.099 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.098+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=UQ8HP5O3RFWI tag=DUS5B1392IQY type=write size=2506119 2024-02-23T06:34:26.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.100+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=DQY5N2EHX71E type=del size=992166 2024-02-23T06:34:26.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.101+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~DPTNV29QCUUK.0 size=1048576 2024-02-23T06:34:26.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.102+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~DPTNV29QCUUK.1 size=249766 2024-02-23T06:34:26.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.104+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=DPTNV29QCUUK tag=3RSXGKNKYMAV type=write size=2346918 2024-02-23T06:34:26.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.105+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=DDTE35LSKZW3 type=write size=334281 2024-02-23T06:34:26.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.107+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~VIV3IV9RJ8CM.0 size=1048576 2024-02-23T06:34:26.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.108+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~VIV3IV9RJ8CM.1 size=73069 2024-02-23T06:34:26.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.110+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=VIV3IV9RJ8CM tag=U6FZY4MXFZ01 type=write size=2170221 2024-02-23T06:34:26.112 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.111+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=1YKDGIPAO8BW type=del size=327173 2024-02-23T06:34:26.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.112+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=OV5FO5IE4SHN type=del 2024-02-23T06:34:26.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.115+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~X0Y3LA41FJFN.0 size=493388 2024-02-23T06:34:26.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.115+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=X0Y3LA41FJFN tag=BEUCJ2SZMG5S type=write size=1541964 2024-02-23T06:34:26.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.116+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=81NK2S1JHSXS type=del 2024-02-23T06:34:26.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.118+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~QQ108N4ZXQQY.0 size=299014 2024-02-23T06:34:26.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.118+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=QQ108N4ZXQQY tag=UHNOVU7W5E59 type=write size=1347590 2024-02-23T06:34:26.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.120+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~A60JZ4N29G8W.0 size=1048576 2024-02-23T06:34:26.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.121+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~A60JZ4N29G8W.1 size=1048576 2024-02-23T06:34:26.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.122+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~A60JZ4N29G8W.2 size=656021 2024-02-23T06:34:26.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.124+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=A60JZ4N29G8W tag=RUWRS4ZHSFND type=write size=3801749 2024-02-23T06:34:26.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.126+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~PEERP6Q0A4TQ.0 size=1048576 2024-02-23T06:34:26.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.127+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~PEERP6Q0A4TQ.1 size=148963 2024-02-23T06:34:26.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.127+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=PEERP6Q0A4TQ tag=OC4N7Z6F47DN type=write size=2246115 2024-02-23T06:34:26.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.128+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~QGG2CE704S8J.0 size=413657 2024-02-23T06:34:26.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.131+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=QGG2CE704S8J tag=C78301C7M9GF type=write size=1462233 2024-02-23T06:34:26.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.132+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=AM5MTDKMMAMO type=del size=3209128 2024-02-23T06:34:26.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.135+0000 7f5e72834780 1 < suggested update operation key=TNH85ZWPALJN tag=P3SZ8AMOJSXT type=write size=966584 2024-02-23T06:34:26.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.136+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=GHQ8LYQ1XU9W type=write size=492203 2024-02-23T06:34:26.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.137+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~4N2HV5HLR582.0 size=397936 2024-02-23T06:34:26.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.139+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=4N2HV5HLR582 tag=WKPVONES04C3 type=write size=1446512 2024-02-23T06:34:26.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.140+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=HXXTTG7Z6TMG type=del size=3919249 2024-02-23T06:34:26.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.143+0000 7f5e72834780 1 < suggested update operation key=ZC75CQ2789VE tag=TXPV63U3JZHA type=write size=805954 2024-02-23T06:34:26.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.144+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=C5DH391JPN6X type=del size=1761545 2024-02-23T06:34:26.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.146+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=IQQWYYD14JD6 type=del 2024-02-23T06:34:26.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.147+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=VWPL3RXGDSQ9 type=write size=631140 2024-02-23T06:34:26.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.149+0000 7f5e72834780 1 < suggested update operation key=MB8BZ2BXZE9M tag=VFI62O1PWDAZ type=del size=1048437 2024-02-23T06:34:26.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.150+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=NJNWKGVZ98PB type=del size=3896554 2024-02-23T06:34:26.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.151+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=NEP3JVZOQ83Q type=del 2024-02-23T06:34:26.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.153+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~Z652O9Q2O344.0 size=1048576 2024-02-23T06:34:26.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.154+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~Z652O9Q2O344.1 size=1048576 2024-02-23T06:34:26.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.155+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~Z652O9Q2O344.2 size=760723 2024-02-23T06:34:26.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.155+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=Z652O9Q2O344 tag=QRR51WRJC3LJ type=write size=3906451 2024-02-23T06:34:26.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.156+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=VZIU6H12JN2R type=del 2024-02-23T06:34:26.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.157+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=YT3C0GB9VQUU type=del size=4049892 2024-02-23T06:34:26.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.159+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=4V01W3VVVLQZ type=del 2024-02-23T06:34:26.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.162+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~MSL15631G5D6.0 size=1048576 2024-02-23T06:34:26.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.163+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~MSL15631G5D6.1 size=792010 2024-02-23T06:34:26.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.163+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=MSL15631G5D6 tag=2TXFDM9URID8 type=write size=2889162 2024-02-23T06:34:26.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.164+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~YEWWDORLWFQP.0 size=893196 2024-02-23T06:34:26.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.166+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=YEWWDORLWFQP tag=WGSV0NA4BXRG type=write size=1941772 2024-02-23T06:34:26.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.167+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=SWMA84W0I3UD type=del size=1852668 2024-02-23T06:34:26.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.168+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=DQY5N2EHX71E type=del 2024-02-23T06:34:26.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.169+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=3JS7DLJBALEU type=del size=23996 2024-02-23T06:34:26.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.170+0000 7f5e72834780 1 < completed write operation key=ZM1YKZOUFSCY tag=DDTE35LSKZW3 type=write size=334281 2024-02-23T06:34:26.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.171+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=X4VI8IGYA7DT type=write size=536782 2024-02-23T06:34:26.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.172+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=1YKDGIPAO8BW type=del 2024-02-23T06:34:26.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.174+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~0QF7E7XW16OX.0 size=1048576 2024-02-23T06:34:26.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.175+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~0QF7E7XW16OX.1 size=513806 2024-02-23T06:34:26.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.175+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=0QF7E7XW16OX tag=PYN595ACD7NQ type=write size=2610958 2024-02-23T06:34:26.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.176+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~X0Y3LA41FJFN.0 size=493388 2024-02-23T06:34:26.179 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.178+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=X0Y3LA41FJFN tag=BEUCJ2SZMG5S type=write size=1541964 2024-02-23T06:34:26.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.179+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=GQ46JVO19LKZ type=write size=453176 2024-02-23T06:34:26.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.180+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~QQ108N4ZXQQY.0 size=299014 2024-02-23T06:34:26.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.182+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=QQ108N4ZXQQY tag=UHNOVU7W5E59 type=write size=1347590 2024-02-23T06:34:26.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.183+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=S25VDWQ7NB4K type=del size=119568 2024-02-23T06:34:26.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.185+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~PEERP6Q0A4TQ.0 size=1048576 2024-02-23T06:34:26.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.185+0000 7f5e72834780 1 < completed part key=_multipart_R3STDBS79MV0.2~PEERP6Q0A4TQ.1 size=148963 2024-02-23T06:34:26.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.188+0000 7f5e72834780 1 < completed multipart upload key=R3STDBS79MV0 upload=PEERP6Q0A4TQ tag=OC4N7Z6F47DN type=write size=2246115 2024-02-23T06:34:26.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.190+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~HCPS6FJ92ZYP.0 size=697858 2024-02-23T06:34:26.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.190+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=HCPS6FJ92ZYP tag=408MGN4R06L6 type=write size=1746434 2024-02-23T06:34:26.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.191+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=AM5MTDKMMAMO type=del 2024-02-23T06:34:26.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.193+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~UHXU0NBFRJAI.0 size=1048576 2024-02-23T06:34:26.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.194+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~UHXU0NBFRJAI.1 size=1048576 2024-02-23T06:34:26.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.195+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~UHXU0NBFRJAI.2 size=192697 2024-02-23T06:34:26.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.195+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=UHXU0NBFRJAI tag=MT1NPRTF64YR type=write size=3338425 2024-02-23T06:34:26.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.197+0000 7f5e72834780 1 < suggested remove operation key=VER8U5YMTPS6 tag=GHQ8LYQ1XU9W type=write 2024-02-23T06:34:26.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.198+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=9R251NKUVX21 type=del size=2932462 2024-02-23T06:34:26.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.199+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=HXXTTG7Z6TMG type=del 2024-02-23T06:34:26.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.202+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~0VDRYLMT8IG3.0 size=1048576 2024-02-23T06:34:26.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.202+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~0VDRYLMT8IG3.1 size=168981 2024-02-23T06:34:26.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.202+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=0VDRYLMT8IG3 tag=FAF2LR0FCG3K type=write size=2266133 2024-02-23T06:34:26.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.204+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=C5DH391JPN6X type=del 2024-02-23T06:34:26.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.205+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=OAGKDI10R63T type=del size=1710328 2024-02-23T06:34:26.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.206+0000 7f5e72834780 1 < canceled operation key=R3STDBS79MV0 tag=VWPL3RXGDSQ9 type=write size=631140 2024-02-23T06:34:26.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.207+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=FNFU9XUNUMFE type=del size=2892727 2024-02-23T06:34:26.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.208+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=NJNWKGVZ98PB type=del 2024-02-23T06:34:26.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.210+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~RPG1HTJWY710.0 size=1048576 2024-02-23T06:34:26.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.211+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~RPG1HTJWY710.1 size=728145 2024-02-23T06:34:26.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.211+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=RPG1HTJWY710 tag=PYN94U66X2JL type=write size=2825297 2024-02-23T06:34:26.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.212+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~Z652O9Q2O344.0 size=1048576 2024-02-23T06:34:26.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.213+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~Z652O9Q2O344.1 size=1048576 2024-02-23T06:34:26.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.214+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~Z652O9Q2O344.2 size=760723 2024-02-23T06:34:26.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.216+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=Z652O9Q2O344 tag=QRR51WRJC3LJ type=write size=3906451 2024-02-23T06:34:26.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.217+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=0ERV5000GS68 type=del size=1630473 2024-02-23T06:34:26.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.218+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=YT3C0GB9VQUU type=del 2024-02-23T06:34:26.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.220+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~CC81ZO1AY3M6.0 size=1048576 2024-02-23T06:34:26.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.221+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~CC81ZO1AY3M6.1 size=1048576 2024-02-23T06:34:26.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.222+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~CC81ZO1AY3M6.2 size=673793 2024-02-23T06:34:26.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.222+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=CC81ZO1AY3M6 tag=3JTQ2GC1C93E type=write size=3819521 2024-02-23T06:34:26.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.224+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~MSL15631G5D6.0 size=1048576 2024-02-23T06:34:26.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.225+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~MSL15631G5D6.1 size=792010 2024-02-23T06:34:26.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.227+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=MSL15631G5D6 tag=2TXFDM9URID8 type=write size=2889162 2024-02-23T06:34:26.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.228+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=PLVYUBZ6ZWZO type=write size=644175 2024-02-23T06:34:26.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.230+0000 7f5e72834780 1 < suggested remove operation key=TPADM4812N0Z tag=SWMA84W0I3UD type=del 2024-02-23T06:34:26.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.232+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~63V94HANXFNX.0 size=1048576 2024-02-23T06:34:26.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.233+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~63V94HANXFNX.1 size=955467 2024-02-23T06:34:26.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.233+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=63V94HANXFNX tag=33YHTBVM8Z4E type=write size=3052619 2024-02-23T06:34:26.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.236+0000 7f5e72834780 1 < suggested remove operation key=4M7BT05YB0C3 tag=3JS7DLJBALEU type=del 2024-02-23T06:34:26.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.238+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~CQCUS70XU9EH.0 size=315876 2024-02-23T06:34:26.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.238+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=CQCUS70XU9EH tag=88W3PC3LCH36 type=write size=1364452 2024-02-23T06:34:26.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.239+0000 7f5e72834780 1 < completed write operation key=9AQCXLBZW3EV tag=X4VI8IGYA7DT type=write size=536782 2024-02-23T06:34:26.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.241+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~J4P7IQEN9J2O.0 size=1048576 2024-02-23T06:34:26.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.242+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~J4P7IQEN9J2O.1 size=496349 2024-02-23T06:34:26.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.242+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=J4P7IQEN9J2O tag=23PG67O54VEQ type=write size=2593501 2024-02-23T06:34:26.245 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.243+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~0QF7E7XW16OX.0 size=1048576 2024-02-23T06:34:26.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.245+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~0QF7E7XW16OX.1 size=513806 2024-02-23T06:34:26.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.246+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=0QF7E7XW16OX tag=PYN595ACD7NQ type=write size=2610958 2024-02-23T06:34:26.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.249+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~YZZ302CJHIU6.0 size=1048576 2024-02-23T06:34:26.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.249+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~YZZ302CJHIU6.1 size=551953 2024-02-23T06:34:26.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.249+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=YZZ302CJHIU6 tag=EUUI1GF9YX65 type=write size=2649105 2024-02-23T06:34:26.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.251+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=GQ46JVO19LKZ type=write size=453176 2024-02-23T06:34:26.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.253+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~4WJENPOO264C.0 size=761613 2024-02-23T06:34:26.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.253+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=4WJENPOO264C tag=EI0TOLY58EIC type=write size=1810189 2024-02-23T06:34:26.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.254+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=S25VDWQ7NB4K type=del 2024-02-23T06:34:26.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.256+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~XU9IH21G7N7H.0 size=1048576 2024-02-23T06:34:26.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.257+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~XU9IH21G7N7H.1 size=1048576 2024-02-23T06:34:26.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.257+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~XU9IH21G7N7H.2 size=764498 2024-02-23T06:34:26.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.257+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=XU9IH21G7N7H tag=GDHOLRWHNUYB type=write size=3910226 2024-02-23T06:34:26.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.258+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~HCPS6FJ92ZYP.0 size=697858 2024-02-23T06:34:26.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.260+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=HCPS6FJ92ZYP tag=408MGN4R06L6 type=write size=1746434 2024-02-23T06:34:26.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.261+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=RUXX9MYO1J96 type=del size=2439574 2024-02-23T06:34:26.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.262+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~UHXU0NBFRJAI.0 size=1048576 2024-02-23T06:34:26.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.263+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~UHXU0NBFRJAI.1 size=1048576 2024-02-23T06:34:26.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.264+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~UHXU0NBFRJAI.2 size=192697 2024-02-23T06:34:26.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.266+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=UHXU0NBFRJAI tag=MT1NPRTF64YR type=write size=3338425 2024-02-23T06:34:26.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.268+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~E6CTK2C6S10R.0 size=80453 2024-02-23T06:34:26.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.268+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=E6CTK2C6S10R tag=D4JQD9XZIGMV type=write size=1129029 2024-02-23T06:34:26.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.271+0000 7f5e72834780 1 < suggested remove operation key=RS03NUABC1U2 tag=9R251NKUVX21 type=del 2024-02-23T06:34:26.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.273+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~R5J04LMNQU0N.0 size=877383 2024-02-23T06:34:26.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.273+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=R5J04LMNQU0N tag=Y28XVYH70XKZ type=write size=1925959 2024-02-23T06:34:26.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.274+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~0VDRYLMT8IG3.0 size=1048576 2024-02-23T06:34:26.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.275+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~0VDRYLMT8IG3.1 size=168981 2024-02-23T06:34:26.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.277+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=0VDRYLMT8IG3 tag=FAF2LR0FCG3K type=write size=2266133 2024-02-23T06:34:26.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.278+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=XBIBH3DMKAZA type=del size=3514635 2024-02-23T06:34:26.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.279+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=OAGKDI10R63T type=del 2024-02-23T06:34:26.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.280+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=BNLHQFDUSO5M type=del size=4082394 2024-02-23T06:34:26.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.281+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=FNFU9XUNUMFE type=del 2024-02-23T06:34:26.284 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.283+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=L4CJ0XPC0CFC type=write size=842971 2024-02-23T06:34:26.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.284+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~RPG1HTJWY710.0 size=1048576 2024-02-23T06:34:26.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.285+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~RPG1HTJWY710.1 size=728145 2024-02-23T06:34:26.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.287+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=RPG1HTJWY710 tag=PYN94U66X2JL type=write size=2825297 2024-02-23T06:34:26.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.288+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=IP965JBLYV2F type=del size=969993 2024-02-23T06:34:26.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.290+0000 7f5e72834780 1 < suggested remove operation key=GACVVXC2Z1YO tag=0ERV5000GS68 type=del 2024-02-23T06:34:26.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.291+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=E0Q9ICHLS07B type=del size=181851 2024-02-23T06:34:26.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.293+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~CC81ZO1AY3M6.0 size=1048576 2024-02-23T06:34:26.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.294+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~CC81ZO1AY3M6.1 size=1048576 2024-02-23T06:34:26.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.294+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~CC81ZO1AY3M6.2 size=673793 2024-02-23T06:34:26.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.296+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=CC81ZO1AY3M6 tag=3JTQ2GC1C93E type=write size=3819521 2024-02-23T06:34:26.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.298+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~93ERZ6HTFODV.0 size=1048576 2024-02-23T06:34:26.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.299+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~93ERZ6HTFODV.1 size=46252 2024-02-23T06:34:26.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.299+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=93ERZ6HTFODV tag=3W3QD9I93V58 type=write size=2143404 2024-02-23T06:34:26.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.300+0000 7f5e72834780 -1 < failed to complete operation key=GACVVXC2Z1YO tag=PLVYUBZ6ZWZO type=write size=644175: (22) Invalid argument 2024-02-23T06:34:26.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.301+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=XRKAF60R0MF9 type=del size=3103175 2024-02-23T06:34:26.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.303+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~63V94HANXFNX.0 size=1048576 2024-02-23T06:34:26.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.304+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~63V94HANXFNX.1 size=955467 2024-02-23T06:34:26.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.306+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=63V94HANXFNX tag=33YHTBVM8Z4E type=write size=3052619 2024-02-23T06:34:26.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.307+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=J7YBPOL62W5C type=write size=968319 2024-02-23T06:34:26.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.308+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~CQCUS70XU9EH.0 size=315876 2024-02-23T06:34:26.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.309+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=CQCUS70XU9EH tag=88W3PC3LCH36 type=write size=1364452 2024-02-23T06:34:26.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.310+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=VWE1EJ5ZLVME type=write size=814504 2024-02-23T06:34:26.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.312+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~J4P7IQEN9J2O.0 size=1048576 2024-02-23T06:34:26.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.312+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~J4P7IQEN9J2O.1 size=496349 2024-02-23T06:34:26.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.314+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=J4P7IQEN9J2O tag=23PG67O54VEQ type=write size=2593501 2024-02-23T06:34:26.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.315+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=LFQ8L7JZJUF6 type=del size=857329 2024-02-23T06:34:26.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.316+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~YZZ302CJHIU6.0 size=1048576 2024-02-23T06:34:26.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.317+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~YZZ302CJHIU6.1 size=551953 2024-02-23T06:34:26.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.319+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=YZZ302CJHIU6 tag=EUUI1GF9YX65 type=write size=2649105 2024-02-23T06:34:26.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.321+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~RE06AV0N727S.0 size=1048576 2024-02-23T06:34:26.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.322+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~RE06AV0N727S.1 size=1048576 2024-02-23T06:34:26.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.323+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~RE06AV0N727S.2 size=430640 2024-02-23T06:34:26.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.323+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=RE06AV0N727S tag=XMO1O0VPXDSC type=write size=3576368 2024-02-23T06:34:26.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.324+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~4WJENPOO264C.0 size=761613 2024-02-23T06:34:26.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.326+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=4WJENPOO264C tag=EI0TOLY58EIC type=write size=1810189 2024-02-23T06:34:26.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.327+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=7PQ6DM3BF5S4 type=del size=2560034 2024-02-23T06:34:26.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.328+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~XU9IH21G7N7H.0 size=1048576 2024-02-23T06:34:26.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.329+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~XU9IH21G7N7H.1 size=1048576 2024-02-23T06:34:26.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.330+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~XU9IH21G7N7H.2 size=764498 2024-02-23T06:34:26.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.332+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=XU9IH21G7N7H tag=GDHOLRWHNUYB type=write size=3910226 2024-02-23T06:34:26.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.335+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~NR9A2OIXQ4IC.0 size=1048576 2024-02-23T06:34:26.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.336+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~NR9A2OIXQ4IC.1 size=1048576 2024-02-23T06:34:26.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.337+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~NR9A2OIXQ4IC.2 size=587302 2024-02-23T06:34:26.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.337+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=NR9A2OIXQ4IC tag=SEEP0CUJDKHP type=write size=3733030 2024-02-23T06:34:26.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.338+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=RUXX9MYO1J96 type=del 2024-02-23T06:34:26.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.340+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~262AV7VCRNN6.0 size=1048576 2024-02-23T06:34:26.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.341+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~262AV7VCRNN6.1 size=1048576 2024-02-23T06:34:26.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.342+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~262AV7VCRNN6.2 size=1033505 2024-02-23T06:34:26.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.342+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=262AV7VCRNN6 tag=VQNP0ZYQKLXF type=write size=4179233 2024-02-23T06:34:26.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.343+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~E6CTK2C6S10R.0 size=80453 2024-02-23T06:34:26.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.346+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=E6CTK2C6S10R tag=D4JQD9XZIGMV type=write size=1129029 2024-02-23T06:34:26.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.347+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=GF0COQMXY15B type=del size=4880 2024-02-23T06:34:26.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.348+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~R5J04LMNQU0N.0 size=877383 2024-02-23T06:34:26.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.350+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=R5J04LMNQU0N tag=Y28XVYH70XKZ type=write size=1925959 2024-02-23T06:34:26.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.352+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~VI723HVKGQ9K.0 size=1048576 2024-02-23T06:34:26.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.353+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~VI723HVKGQ9K.1 size=992268 2024-02-23T06:34:26.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.353+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=VI723HVKGQ9K tag=9AN64WFVURKF type=write size=3089420 2024-02-23T06:34:26.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.354+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=XBIBH3DMKAZA type=del 2024-02-23T06:34:26.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.356+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=MUMOXQIC0MU3 type=write size=582733 2024-02-23T06:34:26.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.357+0000 7f5e72834780 -1 < failed to complete operation key=GACVVXC2Z1YO tag=BNLHQFDUSO5M type=del size=4082394: (22) Invalid argument 2024-02-23T06:34:26.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.359+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~FO9TDGKSUOZH.0 size=1048576 2024-02-23T06:34:26.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.360+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~FO9TDGKSUOZH.1 size=210523 2024-02-23T06:34:26.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.360+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=FO9TDGKSUOZH tag=7RK1Z7AMNQLB type=write size=2307675 2024-02-23T06:34:26.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.361+0000 7f5e72834780 1 < canceled operation key=4M7BT05YB0C3 tag=L4CJ0XPC0CFC type=write size=842971 2024-02-23T06:34:26.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.362+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=6RE4QWT0JQTG type=del size=444036 2024-02-23T06:34:26.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.363+0000 7f5e72834780 -1 < failed to complete operation key=GACVVXC2Z1YO tag=IP965JBLYV2F type=del size=969993: (22) Invalid argument 2024-02-23T06:34:26.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.365+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=MSHG2BF8OM1J type=del size=2659863 2024-02-23T06:34:26.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.366+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=E0Q9ICHLS07B type=del 2024-02-23T06:34:26.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.367+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=BOGFBTRL406N type=write size=801489 2024-02-23T06:34:26.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.368+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~93ERZ6HTFODV.0 size=1048576 2024-02-23T06:34:26.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.369+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~93ERZ6HTFODV.1 size=46252 2024-02-23T06:34:26.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.371+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=93ERZ6HTFODV tag=3W3QD9I93V58 type=write size=2143404 2024-02-23T06:34:26.373 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.372+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=06ICPV18ZTQ5 type=del size=3380417 2024-02-23T06:34:26.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.376+0000 7f5e72834780 1 < suggested remove operation key=ZM1YKZOUFSCY tag=XRKAF60R0MF9 type=del 2024-02-23T06:34:26.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.377+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=P3OM719IDM19 type=write size=609223 2024-02-23T06:34:26.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.378+0000 7f5e72834780 1 < completed write operation key=4M7BT05YB0C3 tag=J7YBPOL62W5C type=write size=968319 2024-02-23T06:34:26.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.380+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~S3JK8M42WWQT.0 size=689197 2024-02-23T06:34:26.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.380+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=S3JK8M42WWQT tag=J7HXD64M31HM type=write size=1737773 2024-02-23T06:34:26.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.381+0000 7f5e72834780 1 < completed write operation key=03P6IEKSHB17 tag=VWE1EJ5ZLVME type=write size=814504 2024-02-23T06:34:26.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.383+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~KHX2NJXSX9DG.0 size=1048576 2024-02-23T06:34:26.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.384+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~KHX2NJXSX9DG.1 size=1048576 2024-02-23T06:34:26.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.385+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~KHX2NJXSX9DG.2 size=186400 2024-02-23T06:34:26.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.385+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=KHX2NJXSX9DG tag=K5CKG741J1P2 type=write size=3332128 2024-02-23T06:34:26.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.386+0000 7f5e72834780 1 < canceled operation key=RS03NUABC1U2 tag=LFQ8L7JZJUF6 type=del size=857329 2024-02-23T06:34:26.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.388+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~NT0XOP7675YR.0 size=1048576 2024-02-23T06:34:26.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.388+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~NT0XOP7675YR.1 size=407830 2024-02-23T06:34:26.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.388+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=NT0XOP7675YR tag=RVG6866XPT6G type=write size=2504982 2024-02-23T06:34:26.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.390+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~RE06AV0N727S.0 size=1048576 2024-02-23T06:34:26.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.390+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~RE06AV0N727S.1 size=1048576 2024-02-23T06:34:26.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.391+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~RE06AV0N727S.2 size=430640 2024-02-23T06:34:26.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.393+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=RE06AV0N727S tag=XMO1O0VPXDSC type=write size=3576368 2024-02-23T06:34:26.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.394+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=4OZCGO31JTCC type=del size=3703335 2024-02-23T06:34:26.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.395+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=7PQ6DM3BF5S4 type=del 2024-02-23T06:34:26.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.397+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~CJPEHUNAMTSP.0 size=1048576 2024-02-23T06:34:26.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.398+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~CJPEHUNAMTSP.1 size=1048576 2024-02-23T06:34:26.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.399+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~CJPEHUNAMTSP.2 size=1007289 2024-02-23T06:34:26.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.399+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=CJPEHUNAMTSP tag=DHYIQML0LFU7 type=write size=4153017 2024-02-23T06:34:26.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.399+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~NR9A2OIXQ4IC.0 size=1048576 2024-02-23T06:34:26.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.400+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~NR9A2OIXQ4IC.1 size=1048576 2024-02-23T06:34:26.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.401+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~NR9A2OIXQ4IC.2 size=587302 2024-02-23T06:34:26.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.403+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=NR9A2OIXQ4IC tag=SEEP0CUJDKHP type=write size=3733030 2024-02-23T06:34:26.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.404+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=XX988D086I57 type=write size=691709 2024-02-23T06:34:26.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.405+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~262AV7VCRNN6.0 size=1048576 2024-02-23T06:34:26.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.406+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~262AV7VCRNN6.1 size=1048576 2024-02-23T06:34:26.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.407+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~262AV7VCRNN6.2 size=1033505 2024-02-23T06:34:26.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.409+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=262AV7VCRNN6 tag=VQNP0ZYQKLXF type=write size=4179233 2024-02-23T06:34:26.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.411+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=752HX5UBRYZ8 type=del size=2187725 2024-02-23T06:34:26.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.412+0000 7f5e72834780 -1 < failed to complete operation key=ZM1YKZOUFSCY tag=GF0COQMXY15B type=del size=4880: (22) Invalid argument 2024-02-23T06:34:26.414 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.413+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=QV4AH8HUU30F type=write size=259153 2024-02-23T06:34:26.415 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.414+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~VI723HVKGQ9K.0 size=1048576 2024-02-23T06:34:26.416 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.415+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~VI723HVKGQ9K.1 size=992268 2024-02-23T06:34:26.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.417+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=VI723HVKGQ9K tag=9AN64WFVURKF type=write size=3089420 2024-02-23T06:34:26.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.418+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=XGF3GLTB9BWE type=del size=2717274 2024-02-23T06:34:26.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.420+0000 7f5e72834780 1 < suggested update operation key=VER8U5YMTPS6 tag=MUMOXQIC0MU3 type=write size=582733 2024-02-23T06:34:26.423 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.421+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=EU36I2EMWTRL type=del size=3254521 2024-02-23T06:34:26.424 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.423+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~FO9TDGKSUOZH.0 size=1048576 2024-02-23T06:34:26.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.423+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~FO9TDGKSUOZH.1 size=210523 2024-02-23T06:34:26.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.425+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=FO9TDGKSUOZH tag=7RK1Z7AMNQLB type=write size=2307675 2024-02-23T06:34:26.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.427+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~1RRKPNYL3PG6.0 size=1048576 2024-02-23T06:34:26.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.428+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~1RRKPNYL3PG6.1 size=1048576 2024-02-23T06:34:26.430 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.429+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~1RRKPNYL3PG6.2 size=970020 2024-02-23T06:34:26.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.429+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=1RRKPNYL3PG6 tag=77PMNC01HG4V type=write size=4115748 2024-02-23T06:34:26.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.430+0000 7f5e72834780 1 < canceled operation key=GWTK3YV0RY21 tag=6RE4QWT0JQTG type=del size=444036 2024-02-23T06:34:26.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.432+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=6MNH2BOPL34V type=del size=1185039 2024-02-23T06:34:26.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.434+0000 7f5e72834780 1 < suggested remove operation key=GW6EKQ84FQ6L tag=MSHG2BF8OM1J type=del 2024-02-23T06:34:26.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.435+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=X736NUW8D3M7 type=write size=871031 2024-02-23T06:34:26.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.436+0000 7f5e72834780 -1 < failed to complete operation key=ZM1YKZOUFSCY tag=BOGFBTRL406N type=write size=801489: (22) Invalid argument 2024-02-23T06:34:26.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.437+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=SFH1EC4ON4PB type=write size=1043572 2024-02-23T06:34:26.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.438+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=06ICPV18ZTQ5 type=del 2024-02-23T06:34:26.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.440+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=IL1A07PQKS5A type=del size=1197856 2024-02-23T06:34:26.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.441+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=P3OM719IDM19 type=write size=609223 2024-02-23T06:34:26.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.443+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~F98B3G9G9ZJS.0 size=1048576 2024-02-23T06:34:26.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.444+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~F98B3G9G9ZJS.1 size=198326 2024-02-23T06:34:26.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.444+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=F98B3G9G9ZJS tag=B9FKKY0PWG1E type=write size=2295478 2024-02-23T06:34:26.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.445+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~S3JK8M42WWQT.0 size=689197 2024-02-23T06:34:26.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.447+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=S3JK8M42WWQT tag=J7HXD64M31HM type=write size=1737773 2024-02-23T06:34:26.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.448+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=0QC4VYNELRCH type=del size=3448213 2024-02-23T06:34:26.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.450+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~KHX2NJXSX9DG.0 size=1048576 2024-02-23T06:34:26.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.450+0000 7f5e72834780 1 < canceled part key=_multipart_M5LH10WTDP0P.2~KHX2NJXSX9DG.1 size=1048576 2024-02-23T06:34:26.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.451+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~KHX2NJXSX9DG.2 size=186400 2024-02-23T06:34:26.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.453+0000 7f5e72834780 1 < canceled multipart upload key=M5LH10WTDP0P upload=KHX2NJXSX9DG tag=K5CKG741J1P2 type=write size=3332128 2024-02-23T06:34:26.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.455+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~S88ZEHUL5U9J.0 size=1048576 2024-02-23T06:34:26.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.456+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~S88ZEHUL5U9J.1 size=949017 2024-02-23T06:34:26.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.456+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=S88ZEHUL5U9J tag=GIRHSEV8ABDY type=write size=3046169 2024-02-23T06:34:26.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.457+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~NT0XOP7675YR.0 size=1048576 2024-02-23T06:34:26.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.458+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~NT0XOP7675YR.1 size=407830 2024-02-23T06:34:26.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.460+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=NT0XOP7675YR tag=RVG6866XPT6G type=write size=2504982 2024-02-23T06:34:26.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.462+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~8C1OQ92ET6ZA.0 size=1048576 2024-02-23T06:34:26.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.463+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~8C1OQ92ET6ZA.1 size=1048576 2024-02-23T06:34:26.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.464+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~8C1OQ92ET6ZA.2 size=88662 2024-02-23T06:34:26.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.464+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=8C1OQ92ET6ZA tag=XG00UAOAX1Z1 type=write size=3234390 2024-02-23T06:34:26.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.466+0000 7f5e72834780 1 < suggested remove operation key=JV6FJONY04AW tag=4OZCGO31JTCC type=del 2024-02-23T06:34:26.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.468+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~TIPPF649XVFM.0 size=1048576 2024-02-23T06:34:26.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.471+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~TIPPF649XVFM.1 size=1048576 2024-02-23T06:34:26.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.472+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~TIPPF649XVFM.2 size=431426 2024-02-23T06:34:26.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.472+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=TIPPF649XVFM tag=VCE791TF8CJ0 type=write size=3577154 2024-02-23T06:34:26.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.472+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~CJPEHUNAMTSP.0 size=1048576 2024-02-23T06:34:26.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.473+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~CJPEHUNAMTSP.1 size=1048576 2024-02-23T06:34:26.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.474+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~CJPEHUNAMTSP.2 size=1007289 2024-02-23T06:34:26.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.476+0000 7f5e72834780 1 < canceled multipart upload key=ZC75CQ2789VE upload=CJPEHUNAMTSP tag=DHYIQML0LFU7 type=write size=4153017 2024-02-23T06:34:26.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.478+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=YIQ7ENFDHFZP type=del size=1134424 2024-02-23T06:34:26.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.479+0000 7f5e72834780 -1 < failed to complete operation key=GW6EKQ84FQ6L tag=XX988D086I57 type=write size=691709: (22) Invalid argument 2024-02-23T06:34:26.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.480+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=F8T4YITX8THT type=del size=1988799 2024-02-23T06:34:26.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.482+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=752HX5UBRYZ8 type=del 2024-02-23T06:34:26.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.483+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=8O3W6V6TGPSM type=write size=84286 2024-02-23T06:34:26.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.485+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=QV4AH8HUU30F type=write size=259153 2024-02-23T06:34:26.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.486+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=2FQY9CDDR3PR type=del size=3794716 2024-02-23T06:34:26.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.488+0000 7f5e72834780 1 < suggested update operation key=WETP4ONTU3HL tag=XGF3GLTB9BWE type=del size=2717274 2024-02-23T06:34:26.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.490+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~GJAGU2O58D6L.0 size=1048576 2024-02-23T06:34:26.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.491+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~GJAGU2O58D6L.1 size=1048576 2024-02-23T06:34:26.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.492+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~GJAGU2O58D6L.2 size=925190 2024-02-23T06:34:26.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.492+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=GJAGU2O58D6L tag=TZEAFR3HC6PD type=write size=4070918 2024-02-23T06:34:26.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.493+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=EU36I2EMWTRL type=del 2024-02-23T06:34:26.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.494+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=IIN850323JXU type=del size=1324279 2024-02-23T06:34:26.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.495+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~1RRKPNYL3PG6.0 size=1048576 2024-02-23T06:34:26.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.495+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~1RRKPNYL3PG6.1 size=1048576 2024-02-23T06:34:26.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.496+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~1RRKPNYL3PG6.2 size=970020 2024-02-23T06:34:26.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.498+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=1RRKPNYL3PG6 tag=77PMNC01HG4V type=write size=4115748 2024-02-23T06:34:26.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.499+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=KNHDEDHQ8Y9Y type=write size=686769 2024-02-23T06:34:26.501 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.500+0000 7f5e72834780 1 < completed delete operation key=8Q6WC7B9BY5Q tag=6MNH2BOPL34V type=del 2024-02-23T06:34:26.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.501+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=IU6U06G5CQYP type=del size=2399852 2024-02-23T06:34:26.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.502+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=X736NUW8D3M7 type=write size=871031 2024-02-23T06:34:26.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.504+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~UT8S11K85OJM.0 size=1048576 2024-02-23T06:34:26.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.505+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~UT8S11K85OJM.1 size=1048576 2024-02-23T06:34:26.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.506+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~UT8S11K85OJM.2 size=827827 2024-02-23T06:34:26.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.506+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=UT8S11K85OJM tag=IMVIBORZ218R type=write size=3973555 2024-02-23T06:34:26.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.507+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=SFH1EC4ON4PB type=write size=1043572 2024-02-23T06:34:26.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.508+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=2HAWP2EU1RR1 type=del size=2257702 2024-02-23T06:34:26.511 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.510+0000 7f5e72834780 1 < suggested update operation key=WETP4ONTU3HL tag=IL1A07PQKS5A type=del size=1197856 2024-02-23T06:34:26.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.511+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=KUAUK23JUXM4 type=del size=87422 2024-02-23T06:34:26.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.512+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~F98B3G9G9ZJS.0 size=1048576 2024-02-23T06:34:26.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.513+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~F98B3G9G9ZJS.1 size=198326 2024-02-23T06:34:26.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.515+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=F98B3G9G9ZJS tag=B9FKKY0PWG1E type=write size=2295478 2024-02-23T06:34:26.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.516+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=G51MCXR5J86U type=del size=813667 2024-02-23T06:34:26.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.517+0000 7f5e72834780 1 < canceled operation key=9AQCXLBZW3EV tag=0QC4VYNELRCH type=del size=3448213 2024-02-23T06:34:26.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.518+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=QF7RPRDN7OAS type=del size=1294939 2024-02-23T06:34:26.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.519+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~S88ZEHUL5U9J.0 size=1048576 2024-02-23T06:34:26.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.520+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~S88ZEHUL5U9J.1 size=949017 2024-02-23T06:34:26.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.522+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=S88ZEHUL5U9J tag=GIRHSEV8ABDY type=write size=3046169 2024-02-23T06:34:26.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.524+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~YCU2X05N7JEL.0 size=1048576 2024-02-23T06:34:26.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.525+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~YCU2X05N7JEL.1 size=1004524 2024-02-23T06:34:26.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.525+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=YCU2X05N7JEL tag=S6AYYPC7N4Z0 type=write size=3101676 2024-02-23T06:34:26.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.526+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~8C1OQ92ET6ZA.0 size=1048576 2024-02-23T06:34:26.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.527+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~8C1OQ92ET6ZA.1 size=1048576 2024-02-23T06:34:26.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.528+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~8C1OQ92ET6ZA.2 size=88662 2024-02-23T06:34:26.532 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.531+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=8C1OQ92ET6ZA tag=XG00UAOAX1Z1 type=write size=3234390 2024-02-23T06:34:26.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.532+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=ZU7CGAACEGCG type=del size=1292871 2024-02-23T06:34:26.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.533+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~TIPPF649XVFM.0 size=1048576 2024-02-23T06:34:26.535 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.534+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~TIPPF649XVFM.1 size=1048576 2024-02-23T06:34:26.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.535+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~TIPPF649XVFM.2 size=431426 2024-02-23T06:34:26.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.537+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=TIPPF649XVFM tag=VCE791TF8CJ0 type=write size=3577154 2024-02-23T06:34:26.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.538+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=TIRDTN75T78B type=write size=343050 2024-02-23T06:34:26.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.539+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=YIQ7ENFDHFZP type=del 2024-02-23T06:34:26.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.540+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=K8RB4AIPTIDO type=del size=2653918 2024-02-23T06:34:26.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.541+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=F8T4YITX8THT type=del 2024-02-23T06:34:26.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.542+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=I3ZYX5YIJSAR type=del size=2307392 2024-02-23T06:34:26.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.543+0000 7f5e72834780 1 < completed write operation key=IDTA5RV6IUF6 tag=8O3W6V6TGPSM type=write size=84286 2024-02-23T06:34:26.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.545+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=6JC9WI1Y4GVY type=del size=2738334 2024-02-23T06:34:26.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.546+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=2FQY9CDDR3PR type=del 2024-02-23T06:34:26.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.547+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=V14DMUMVMGV2 type=write size=459027 2024-02-23T06:34:26.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.548+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~GJAGU2O58D6L.0 size=1048576 2024-02-23T06:34:26.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.548+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~GJAGU2O58D6L.1 size=1048576 2024-02-23T06:34:26.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.549+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~GJAGU2O58D6L.2 size=925190 2024-02-23T06:34:26.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.551+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=GJAGU2O58D6L tag=TZEAFR3HC6PD type=write size=4070918 2024-02-23T06:34:26.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.552+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=452NUJBL8BMK type=del size=3238427 2024-02-23T06:34:26.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.553+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=IIN850323JXU type=del 2024-02-23T06:34:26.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.555+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~KZ8SBZA9G9U3.0 size=1048576 2024-02-23T06:34:26.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.556+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~KZ8SBZA9G9U3.1 size=510235 2024-02-23T06:34:26.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.556+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=KZ8SBZA9G9U3 tag=7ZBWOJXI31FB type=write size=2607387 2024-02-23T06:34:26.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.557+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=KNHDEDHQ8Y9Y type=write size=686769 2024-02-23T06:34:26.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.558+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=GTHX5GXH2UUN type=del size=380172 2024-02-23T06:34:26.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.560+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=IU6U06G5CQYP type=del 2024-02-23T06:34:26.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.562+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~W95ALJCP1M90.0 size=1048576 2024-02-23T06:34:26.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.563+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~W95ALJCP1M90.1 size=1048576 2024-02-23T06:34:26.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.564+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~W95ALJCP1M90.2 size=617750 2024-02-23T06:34:26.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.564+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=W95ALJCP1M90 tag=SBC5TDOXDARB type=write size=3763478 2024-02-23T06:34:26.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.565+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~UT8S11K85OJM.0 size=1048576 2024-02-23T06:34:26.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.566+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~UT8S11K85OJM.1 size=1048576 2024-02-23T06:34:26.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.567+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~UT8S11K85OJM.2 size=827827 2024-02-23T06:34:26.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.569+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=UT8S11K85OJM tag=IMVIBORZ218R type=write size=3973555 2024-02-23T06:34:26.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.570+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=IN52SO9ADJ0Z type=del size=1932453 2024-02-23T06:34:26.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.572+0000 7f5e72834780 1 < completed delete operation key=RS03NUABC1U2 tag=2HAWP2EU1RR1 type=del 2024-02-23T06:34:26.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.573+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=V305YV4Y708N type=del size=1854370 2024-02-23T06:34:26.577 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.576+0000 7f5e72834780 1 < suggested update operation key=9ZCNDGBEPWMN tag=KUAUK23JUXM4 type=del size=87422 2024-02-23T06:34:26.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.577+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=WPSU4ID6XGBU type=del size=3488502 2024-02-23T06:34:26.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.578+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=G51MCXR5J86U type=del 2024-02-23T06:34:26.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.579+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=AO2ZZE5I7Z84 type=del size=2544380 2024-02-23T06:34:26.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.581+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=QF7RPRDN7OAS type=del 2024-02-23T06:34:26.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.582+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=CG5M8M2E3TZL type=del size=1412649 2024-02-23T06:34:26.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.583+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~YCU2X05N7JEL.0 size=1048576 2024-02-23T06:34:26.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.584+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~YCU2X05N7JEL.1 size=1004524 2024-02-23T06:34:26.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.586+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=YCU2X05N7JEL tag=S6AYYPC7N4Z0 type=write size=3101676 2024-02-23T06:34:26.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.588+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~74DN738CAPJ8.0 size=1048576 2024-02-23T06:34:26.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.591+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~74DN738CAPJ8.1 size=41309 2024-02-23T06:34:26.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.591+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=74DN738CAPJ8 tag=PSDQ5UUI3LVL type=write size=2138461 2024-02-23T06:34:26.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.593+0000 7f5e72834780 1 < suggested remove operation key=GW6EKQ84FQ6L tag=ZU7CGAACEGCG type=del 2024-02-23T06:34:26.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.595+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~Q8ORFV79OC76.0 size=1048576 2024-02-23T06:34:26.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.596+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~Q8ORFV79OC76.1 size=1048576 2024-02-23T06:34:26.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.597+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~Q8ORFV79OC76.2 size=433315 2024-02-23T06:34:26.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.597+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=Q8ORFV79OC76 tag=S2UN8RVLMCPZ type=write size=3579043 2024-02-23T06:34:26.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.598+0000 7f5e72834780 1 < completed write operation key=721UW0AGSKVR tag=TIRDTN75T78B type=write size=343050 2024-02-23T06:34:26.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.599+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=VVK33G3ZE3R0 type=del size=1904103 2024-02-23T06:34:26.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.600+0000 7f5e72834780 -1 < failed to complete operation key=GW6EKQ84FQ6L tag=K8RB4AIPTIDO type=del size=2653918: (22) Invalid argument 2024-02-23T06:34:26.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.602+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~GWBLIL4THGVF.0 size=1014920 2024-02-23T06:34:26.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.602+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=GWBLIL4THGVF tag=4MVCH4KPVFAP type=write size=2063496 2024-02-23T06:34:26.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.605+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=I3ZYX5YIJSAR type=del 2024-02-23T06:34:26.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.606+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=SNTQMPHNLXL6 type=del size=3475269 2024-02-23T06:34:26.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.607+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=6JC9WI1Y4GVY type=del 2024-02-23T06:34:26.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.608+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=LQ5L2QMCOF5L type=write size=1008208 2024-02-23T06:34:26.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.609+0000 7f5e72834780 1 < canceled operation key=WETP4ONTU3HL tag=V14DMUMVMGV2 type=write size=459027 2024-02-23T06:34:26.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.610+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=Z13PY0YDLE9U type=del size=1069029 2024-02-23T06:34:26.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.612+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=452NUJBL8BMK type=del 2024-02-23T06:34:26.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.613+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=YTCMN2IBCJF3 type=write size=441506 2024-02-23T06:34:26.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.614+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~KZ8SBZA9G9U3.0 size=1048576 2024-02-23T06:34:26.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.615+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~KZ8SBZA9G9U3.1 size=510235 2024-02-23T06:34:26.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.617+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=KZ8SBZA9G9U3 tag=7ZBWOJXI31FB type=write size=2607387 2024-02-23T06:34:26.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.618+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=R3XFYKSWA240 type=del size=128839 2024-02-23T06:34:26.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.620+0000 7f5e72834780 1 < suggested remove operation key=TNH85ZWPALJN tag=GTHX5GXH2UUN type=del 2024-02-23T06:34:26.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.622+0000 7f5e72834780 1 > prepared part key=_multipart_QZLNM2RQ9SDC.2~L30N3CX3BPDU.0 size=709961 2024-02-23T06:34:26.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.622+0000 7f5e72834780 1 > prepared multipart upload key=QZLNM2RQ9SDC upload=L30N3CX3BPDU tag=72SM5IQSAP98 type=write size=1758537 2024-02-23T06:34:26.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.624+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~W95ALJCP1M90.0 size=1048576 2024-02-23T06:34:26.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.624+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~W95ALJCP1M90.1 size=1048576 2024-02-23T06:34:26.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.626+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~W95ALJCP1M90.2 size=617750 2024-02-23T06:34:26.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.628+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=W95ALJCP1M90 tag=SBC5TDOXDARB type=write size=3763478 2024-02-23T06:34:26.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.631+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~5P9N5RCCVLT2.0 size=1048576 2024-02-23T06:34:26.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.631+0000 7f5e72834780 1 > prepared part key=_multipart_QGGULCYZ0ZSA.2~5P9N5RCCVLT2.1 size=383982 2024-02-23T06:34:26.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.631+0000 7f5e72834780 1 > prepared multipart upload key=QGGULCYZ0ZSA upload=5P9N5RCCVLT2 tag=9C0MY4D7GQI9 type=write size=2481134 2024-02-23T06:34:26.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.633+0000 7f5e72834780 -1 < failed to complete operation key=GW6EKQ84FQ6L tag=IN52SO9ADJ0Z type=del size=1932453: (22) Invalid argument 2024-02-23T06:34:26.635 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.634+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=6SLVSPT02062 type=write size=767222 2024-02-23T06:34:26.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.635+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=V305YV4Y708N type=del 2024-02-23T06:34:26.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.636+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=R3ND5BJVHKMC type=del size=3551566 2024-02-23T06:34:26.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.637+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=WPSU4ID6XGBU type=del 2024-02-23T06:34:26.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.638+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=D59M5W8FHP70 type=del size=2103936 2024-02-23T06:34:26.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.639+0000 7f5e72834780 -1 < no bi entry to suggest for operation key=GW6EKQ84FQ6L tag=AO2ZZE5I7Z84 type=del size=2544380: (2) No such file or directory 2024-02-23T06:34:26.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.640+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=2O1WACVKJ838 type=write size=812640 2024-02-23T06:34:26.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.641+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=CG5M8M2E3TZL type=del 2024-02-23T06:34:26.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.642+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=EZTBTU2DL1H4 type=del size=2765571 2024-02-23T06:34:26.645 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.644+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~74DN738CAPJ8.0 size=1048576 2024-02-23T06:34:26.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.645+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~74DN738CAPJ8.1 size=41309 2024-02-23T06:34:26.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.646+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=74DN738CAPJ8 tag=PSDQ5UUI3LVL type=write size=2138461 2024-02-23T06:34:26.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.648+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=Q73DQ2MJ9P4Z type=del size=2350717 2024-02-23T06:34:26.650 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.649+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~Q8ORFV79OC76.0 size=1048576 2024-02-23T06:34:26.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.650+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~Q8ORFV79OC76.1 size=1048576 2024-02-23T06:34:26.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.651+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~Q8ORFV79OC76.2 size=433315 2024-02-23T06:34:26.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.652+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=Q8ORFV79OC76 tag=S2UN8RVLMCPZ type=write size=3579043 2024-02-23T06:34:26.655 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.654+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=VYMRSR9BU15N type=del size=1584082 2024-02-23T06:34:26.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.656+0000 7f5e72834780 1 < suggested update operation key=MB8BZ2BXZE9M tag=VVK33G3ZE3R0 type=del size=1904103 2024-02-23T06:34:26.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.657+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=2QERATOSM1BX type=del size=3930099 2024-02-23T06:34:26.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.658+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~GWBLIL4THGVF.0 size=1014920 2024-02-23T06:34:26.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.662+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=GWBLIL4THGVF tag=4MVCH4KPVFAP type=write size=2063496 2024-02-23T06:34:26.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.663+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=XYXFOQ067X8G type=del size=2279170 2024-02-23T06:34:26.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.665+0000 7f5e72834780 1 < canceled operation key=GACVVXC2Z1YO tag=SNTQMPHNLXL6 type=del size=3475269 2024-02-23T06:34:26.668 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.667+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~FHRXW2DWSZ9G.0 size=1048576 2024-02-23T06:34:26.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.668+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~FHRXW2DWSZ9G.1 size=1048576 2024-02-23T06:34:26.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.668+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~FHRXW2DWSZ9G.2 size=356996 2024-02-23T06:34:26.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.668+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=FHRXW2DWSZ9G tag=Z1IPDOC493XM type=write size=3502724 2024-02-23T06:34:26.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.670+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=LQ5L2QMCOF5L type=write size=1008208 2024-02-23T06:34:26.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.671+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=HXTCNX9VAIUP type=write size=293814 2024-02-23T06:34:26.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.672+0000 7f5e72834780 1 < canceled operation key=WK98HMHAZIUB tag=Z13PY0YDLE9U type=del size=1069029 2024-02-23T06:34:26.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.673+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=IKYLZ0NPQRNN type=del size=1446205 2024-02-23T06:34:26.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.675+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=YTCMN2IBCJF3 type=write size=441506 2024-02-23T06:34:26.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.676+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~JG0EVWTNJ8IZ.0 size=257055 2024-02-23T06:34:26.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.676+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=JG0EVWTNJ8IZ tag=YMPG2HIA7JNU type=write size=1305631 2024-02-23T06:34:26.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.678+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=R3XFYKSWA240 type=del 2024-02-23T06:34:26.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.679+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NHA31N79FJC6.0 size=1048576 2024-02-23T06:34:26.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.682+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NHA31N79FJC6.1 size=1048576 2024-02-23T06:34:26.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.683+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~NHA31N79FJC6.2 size=390556 2024-02-23T06:34:26.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.683+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=NHA31N79FJC6 tag=DZND72G08R63 type=write size=3536284 2024-02-23T06:34:26.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.684+0000 7f5e72834780 1 < completed part key=_multipart_QZLNM2RQ9SDC.2~L30N3CX3BPDU.0 size=709961 2024-02-23T06:34:26.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.686+0000 7f5e72834780 1 < completed multipart upload key=QZLNM2RQ9SDC upload=L30N3CX3BPDU tag=72SM5IQSAP98 type=write size=1758537 2024-02-23T06:34:26.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.687+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=TPXTW4J2I38G type=del size=1876463 2024-02-23T06:34:26.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.688+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~5P9N5RCCVLT2.0 size=1048576 2024-02-23T06:34:26.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.689+0000 7f5e72834780 1 < completed part key=_multipart_QGGULCYZ0ZSA.2~5P9N5RCCVLT2.1 size=383982 2024-02-23T06:34:26.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.691+0000 7f5e72834780 1 < completed multipart upload key=QGGULCYZ0ZSA upload=5P9N5RCCVLT2 tag=9C0MY4D7GQI9 type=write size=2481134 2024-02-23T06:34:26.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.692+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=PKUFS8E14G0Z type=write size=239114 2024-02-23T06:34:26.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.694+0000 7f5e72834780 1 < suggested remove operation key=QGGULCYZ0ZSA tag=6SLVSPT02062 type=write 2024-02-23T06:34:26.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.696+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=XYRRBEAQR3RX type=del size=979280 2024-02-23T06:34:26.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.697+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=R3ND5BJVHKMC type=del 2024-02-23T06:34:26.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.698+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=IFDDDRGRTRTJ type=del size=295760 2024-02-23T06:34:26.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.699+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=D59M5W8FHP70 type=del 2024-02-23T06:34:26.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.700+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=V6AAPCZ1W4C8 type=del size=210345 2024-02-23T06:34:26.704 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.703+0000 7f5e72834780 1 < suggested remove operation key=8Q6WC7B9BY5Q tag=2O1WACVKJ838 type=write 2024-02-23T06:34:26.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.707+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~RAASBKU3CFY0.0 size=1048576 2024-02-23T06:34:26.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.707+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~RAASBKU3CFY0.1 size=767413 2024-02-23T06:34:26.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.707+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=RAASBKU3CFY0 tag=A0W129E0GMKS type=write size=2864565 2024-02-23T06:34:26.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.710+0000 7f5e72834780 1 < suggested update operation key=4M7BT05YB0C3 tag=EZTBTU2DL1H4 type=del size=2765571 2024-02-23T06:34:26.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.712+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~UFFJE0MNTH34.0 size=344396 2024-02-23T06:34:26.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.712+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=UFFJE0MNTH34 tag=GGAJ1S36RS3O type=write size=1392972 2024-02-23T06:34:26.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.713+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=Q73DQ2MJ9P4Z type=del 2024-02-23T06:34:26.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.715+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=BW71F61ODOEJ type=del size=1236572 2024-02-23T06:34:26.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.716+0000 7f5e72834780 -1 < failed to complete operation key=4M7BT05YB0C3 tag=VYMRSR9BU15N type=del size=1584082: (22) Invalid argument 2024-02-23T06:34:26.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.718+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~QDS83Z5JEGQA.0 size=1048576 2024-02-23T06:34:26.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.719+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~QDS83Z5JEGQA.1 size=859040 2024-02-23T06:34:26.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.719+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=QDS83Z5JEGQA tag=X0SB7Q2NHIEZ type=write size=2956192 2024-02-23T06:34:26.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.720+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=2QERATOSM1BX type=del 2024-02-23T06:34:26.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.721+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=UI70HVGPFAKO type=del size=2600388 2024-02-23T06:34:26.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.722+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=XYXFOQ067X8G type=del 2024-02-23T06:34:26.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.723+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=2EAJMD5EB43U type=del size=158147 2024-02-23T06:34:26.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.724+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~FHRXW2DWSZ9G.0 size=1048576 2024-02-23T06:34:26.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.725+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~FHRXW2DWSZ9G.1 size=1048576 2024-02-23T06:34:26.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.726+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~FHRXW2DWSZ9G.2 size=356996 2024-02-23T06:34:26.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.728+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=FHRXW2DWSZ9G tag=Z1IPDOC493XM type=write size=3502724 2024-02-23T06:34:26.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.729+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=97YFN27QJ678 type=del size=3797085 2024-02-23T06:34:26.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.730+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=HXTCNX9VAIUP type=write size=293814 2024-02-23T06:34:26.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.731+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=2J25F4W0D0XO type=del size=1989146 2024-02-23T06:34:26.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.733+0000 7f5e72834780 1 < suggested update operation key=ZC75CQ2789VE tag=IKYLZ0NPQRNN type=del size=1446205 2024-02-23T06:34:26.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.734+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=KEDDLJH9Y530 type=del size=1533004 2024-02-23T06:34:26.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.736+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~JG0EVWTNJ8IZ.0 size=257055 2024-02-23T06:34:26.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.738+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=JG0EVWTNJ8IZ tag=YMPG2HIA7JNU type=write size=1305631 2024-02-23T06:34:26.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.739+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=KT9ZDAFQ3NU1 type=del size=218228 2024-02-23T06:34:26.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.740+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NHA31N79FJC6.0 size=1048576 2024-02-23T06:34:26.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.741+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NHA31N79FJC6.1 size=1048576 2024-02-23T06:34:26.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.742+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~NHA31N79FJC6.2 size=390556 2024-02-23T06:34:26.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.745+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=NHA31N79FJC6 tag=DZND72G08R63 type=write size=3536284 2024-02-23T06:34:26.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.746+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=0SU7HKMY6C60 type=del size=3089137 2024-02-23T06:34:26.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.747+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=TPXTW4J2I38G type=del 2024-02-23T06:34:26.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.748+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=YVHUUI50RE1Y type=write size=847797 2024-02-23T06:34:26.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.749+0000 7f5e72834780 1 < completed write operation key=N8RXOY8X71MO tag=PKUFS8E14G0Z type=write size=239114 2024-02-23T06:34:26.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.751+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~CBWJZ0IDI8Z1.0 size=1048576 2024-02-23T06:34:26.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.752+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~CBWJZ0IDI8Z1.1 size=429719 2024-02-23T06:34:26.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.752+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=CBWJZ0IDI8Z1 tag=67OVQPKF31OQ type=write size=2526871 2024-02-23T06:34:26.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.753+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=XYRRBEAQR3RX type=del 2024-02-23T06:34:26.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.754+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=7UWFKL5ZWM19 type=del size=3460816 2024-02-23T06:34:26.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.755+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=IFDDDRGRTRTJ type=del 2024-02-23T06:34:26.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.757+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=YC9NLYY8PTPO type=del size=914736 2024-02-23T06:34:26.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.759+0000 7f5e72834780 1 < suggested remove operation key=ZC75CQ2789VE tag=V6AAPCZ1W4C8 type=del 2024-02-23T06:34:26.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.760+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=WFZB31EKSK3X type=del size=847189 2024-02-23T06:34:26.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.761+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~RAASBKU3CFY0.0 size=1048576 2024-02-23T06:34:26.763 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.762+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~RAASBKU3CFY0.1 size=767413 2024-02-23T06:34:26.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.764+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=RAASBKU3CFY0 tag=A0W129E0GMKS type=write size=2864565 2024-02-23T06:34:26.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.766+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~XXN07UPN14TS.0 size=869915 2024-02-23T06:34:26.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.766+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=XXN07UPN14TS tag=9BN2545CU2G4 type=write size=1918491 2024-02-23T06:34:26.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.767+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~UFFJE0MNTH34.0 size=344396 2024-02-23T06:34:26.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.769+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=UFFJE0MNTH34 tag=GGAJ1S36RS3O type=write size=1392972 2024-02-23T06:34:26.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.770+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=68VATAI6UEJ6 type=del size=3756926 2024-02-23T06:34:26.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.771+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=BW71F61ODOEJ type=del 2024-02-23T06:34:26.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.772+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=71WAS5GEHQAY type=del size=1464774 2024-02-23T06:34:26.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.772+0000 7f5e72834780 1 < canceled part key=_multipart_RS03NUABC1U2.2~QDS83Z5JEGQA.0 size=1048576 2024-02-23T06:34:26.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.773+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~QDS83Z5JEGQA.1 size=859040 2024-02-23T06:34:26.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.775+0000 7f5e72834780 1 < canceled multipart upload key=RS03NUABC1U2 upload=QDS83Z5JEGQA tag=X0SB7Q2NHIEZ type=write size=2956192 2024-02-23T06:34:26.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.776+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=FC5UBV7KKZ2T type=del size=1382963 2024-02-23T06:34:26.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.777+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=UI70HVGPFAKO type=del 2024-02-23T06:34:26.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.778+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=XIXM06RCMR1W type=del size=2075934 2024-02-23T06:34:26.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.781+0000 7f5e72834780 1 < suggested remove operation key=GW6EKQ84FQ6L tag=2EAJMD5EB43U type=del 2024-02-23T06:34:26.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.782+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~J4MUEBSTELLF.0 size=1048576 2024-02-23T06:34:26.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.783+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~J4MUEBSTELLF.1 size=1048576 2024-02-23T06:34:26.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.784+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~J4MUEBSTELLF.2 size=758685 2024-02-23T06:34:26.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.784+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=J4MUEBSTELLF tag=31I70WWVCJ1F type=write size=3904413 2024-02-23T06:34:26.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.785+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=97YFN27QJ678 type=del 2024-02-23T06:34:26.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.787+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=0CS5TZZGTVO9 type=del size=1680041 2024-02-23T06:34:26.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.788+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=2J25F4W0D0XO type=del 2024-02-23T06:34:26.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.790+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~CLRNNOFH15ID.0 size=673392 2024-02-23T06:34:26.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.790+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=CLRNNOFH15ID tag=B412XX9Y5MSW type=write size=1721968 2024-02-23T06:34:26.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.791+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=KEDDLJH9Y530 type=del 2024-02-23T06:34:26.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.792+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=Q9PDLN8AWXBE type=write size=645246 2024-02-23T06:34:26.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.793+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=KT9ZDAFQ3NU1 type=del 2024-02-23T06:34:26.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.794+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=F6ZD7CKUU197 type=del size=4149267 2024-02-23T06:34:26.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.796+0000 7f5e72834780 1 < canceled operation key=TNH85ZWPALJN tag=0SU7HKMY6C60 type=del size=3089137 2024-02-23T06:34:26.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.797+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=CLCRQDU5B2O6 type=del size=2457239 2024-02-23T06:34:26.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.799+0000 7f5e72834780 1 < suggested update operation key=GWTK3YV0RY21 tag=YVHUUI50RE1Y type=write size=847797 2024-02-23T06:34:26.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.801+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~3H9P0NO680L1.0 size=1048576 2024-02-23T06:34:26.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.802+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~3H9P0NO680L1.1 size=693365 2024-02-23T06:34:26.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.802+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=3H9P0NO680L1 tag=LJI2I2OYEQ1H type=write size=2790517 2024-02-23T06:34:26.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.802+0000 7f5e72834780 1 < canceled part key=_multipart_GW6EKQ84FQ6L.2~CBWJZ0IDI8Z1.0 size=1048576 2024-02-23T06:34:26.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.803+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~CBWJZ0IDI8Z1.1 size=429719 2024-02-23T06:34:26.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.805+0000 7f5e72834780 1 < canceled multipart upload key=GW6EKQ84FQ6L upload=CBWJZ0IDI8Z1 tag=67OVQPKF31OQ type=write size=2526871 2024-02-23T06:34:26.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.806+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=JDOYDBC2CLUJ type=del size=1186398 2024-02-23T06:34:26.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.807+0000 7f5e72834780 -1 < failed to complete operation key=GWTK3YV0RY21 tag=7UWFKL5ZWM19 type=del size=3460816: (22) Invalid argument 2024-02-23T06:34:26.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.809+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=IXC1M5R65544 type=del size=2185316 2024-02-23T06:34:26.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.810+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=YC9NLYY8PTPO type=del 2024-02-23T06:34:26.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.812+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~1NDZMCXDWOZU.0 size=1048576 2024-02-23T06:34:26.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.814+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~1NDZMCXDWOZU.1 size=1048576 2024-02-23T06:34:26.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.816+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~1NDZMCXDWOZU.2 size=35034 2024-02-23T06:34:26.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.816+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=1NDZMCXDWOZU tag=D8A0JRCIJZCY type=write size=3180762 2024-02-23T06:34:26.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.818+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=WFZB31EKSK3X type=del 2024-02-23T06:34:26.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.819+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=H90IE8NFK3B5 type=del size=2608742 2024-02-23T06:34:26.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.820+0000 7f5e72834780 1 < canceled part key=_multipart_ZM1YKZOUFSCY.2~XXN07UPN14TS.0 size=869915 2024-02-23T06:34:26.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.822+0000 7f5e72834780 1 < canceled multipart upload key=ZM1YKZOUFSCY upload=XXN07UPN14TS tag=9BN2545CU2G4 type=write size=1918491 2024-02-23T06:34:26.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.823+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=DF2OUZV1FMLD type=del size=1828676 2024-02-23T06:34:26.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.824+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=68VATAI6UEJ6 type=del 2024-02-23T06:34:26.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.825+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=0OZ03EVN9LTF type=del size=465435 2024-02-23T06:34:26.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.826+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=71WAS5GEHQAY type=del 2024-02-23T06:34:26.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.828+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=DCBC23X2DLV4 type=del size=752726 2024-02-23T06:34:26.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.829+0000 7f5e72834780 1 < completed delete operation key=4M7BT05YB0C3 tag=FC5UBV7KKZ2T type=del 2024-02-23T06:34:26.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.831+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~TUYSR03C9JAE.0 size=283677 2024-02-23T06:34:26.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.831+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=TUYSR03C9JAE tag=4LHM4PJ1AEWC type=write size=1332253 2024-02-23T06:34:26.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.832+0000 7f5e72834780 1 < canceled operation key=883VBT1ADE6K tag=XIXM06RCMR1W type=del size=2075934 2024-02-23T06:34:26.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.833+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=7FLNI8KYNTN4 type=del size=4054497 2024-02-23T06:34:26.834 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.833+0000 7f5e72834780 1 < canceled part key=_multipart_03P6IEKSHB17.2~J4MUEBSTELLF.0 size=1048576 2024-02-23T06:34:26.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.834+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~J4MUEBSTELLF.1 size=1048576 2024-02-23T06:34:26.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.835+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~J4MUEBSTELLF.2 size=758685 2024-02-23T06:34:26.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.837+0000 7f5e72834780 1 < canceled multipart upload key=03P6IEKSHB17 upload=J4MUEBSTELLF tag=31I70WWVCJ1F type=write size=3904413 2024-02-23T06:34:26.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.838+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=7QEP9AKQMD3F type=del size=2554318 2024-02-23T06:34:26.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.839+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=0CS5TZZGTVO9 type=del 2024-02-23T06:34:26.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.841+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~Y9ZFAAITECUG.0 size=598225 2024-02-23T06:34:26.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.841+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=Y9ZFAAITECUG tag=YY473YLK7UMM type=write size=1646801 2024-02-23T06:34:26.843 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.842+0000 7f5e72834780 1 < canceled part key=_multipart_M5LH10WTDP0P.2~CLRNNOFH15ID.0 size=673392 2024-02-23T06:34:26.845 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.844+0000 7f5e72834780 1 < canceled multipart upload key=M5LH10WTDP0P upload=CLRNNOFH15ID tag=B412XX9Y5MSW type=write size=1721968 2024-02-23T06:34:26.846 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.845+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=01YXZ9ZMC8TN type=del size=3099588 2024-02-23T06:34:26.848 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.847+0000 7f5e72834780 1 < suggested update operation key=ZC75CQ2789VE tag=Q9PDLN8AWXBE type=write size=645246 2024-02-23T06:34:26.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.849+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~MSUWOT2H8KYU.0 size=1048576 2024-02-23T06:34:26.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.850+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~MSUWOT2H8KYU.1 size=1048576 2024-02-23T06:34:26.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.851+0000 7f5e72834780 1 > prepared part key=_multipart_WK98HMHAZIUB.2~MSUWOT2H8KYU.2 size=924131 2024-02-23T06:34:26.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.851+0000 7f5e72834780 1 > prepared multipart upload key=WK98HMHAZIUB upload=MSUWOT2H8KYU tag=0AR91H4QLTEL type=write size=4069859 2024-02-23T06:34:26.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.852+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=F6ZD7CKUU197 type=del 2024-02-23T06:34:26.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.854+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~SUOJQOKBJPL7.0 size=625708 2024-02-23T06:34:26.856 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.854+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=SUOJQOKBJPL7 tag=0C85CLGUNJGJ type=write size=1674284 2024-02-23T06:34:26.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.855+0000 7f5e72834780 1 < completed delete operation key=GACVVXC2Z1YO tag=CLCRQDU5B2O6 type=del 2024-02-23T06:34:26.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.857+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=JJT9RBFY7HR7 type=write size=947373 2024-02-23T06:34:26.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.858+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~3H9P0NO680L1.0 size=1048576 2024-02-23T06:34:26.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.859+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~3H9P0NO680L1.1 size=693365 2024-02-23T06:34:26.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.861+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=3H9P0NO680L1 tag=LJI2I2OYEQ1H type=write size=2790517 2024-02-23T06:34:26.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.863+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~OF3600SC5XUO.0 size=1048576 2024-02-23T06:34:26.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.864+0000 7f5e72834780 1 > prepared part key=_multipart_GWTK3YV0RY21.2~OF3600SC5XUO.1 size=583454 2024-02-23T06:34:26.865 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.864+0000 7f5e72834780 1 > prepared multipart upload key=GWTK3YV0RY21 upload=OF3600SC5XUO tag=NY2QQOWQVJ5A type=write size=2680606 2024-02-23T06:34:26.866 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.865+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=JDOYDBC2CLUJ type=del 2024-02-23T06:34:26.868 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.867+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~62LRSPSHPV2L.0 size=1048576 2024-02-23T06:34:26.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.868+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~62LRSPSHPV2L.1 size=1048576 2024-02-23T06:34:26.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.869+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~62LRSPSHPV2L.2 size=969904 2024-02-23T06:34:26.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.869+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=62LRSPSHPV2L tag=ENNNP9WZH658 type=write size=4115632 2024-02-23T06:34:26.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.870+0000 7f5e72834780 1 < completed delete operation key=MB8BZ2BXZE9M tag=IXC1M5R65544 type=del 2024-02-23T06:34:26.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.871+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=EPTP44KLOZKN type=del size=3094976 2024-02-23T06:34:26.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.872+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~1NDZMCXDWOZU.0 size=1048576 2024-02-23T06:34:26.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.873+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~1NDZMCXDWOZU.1 size=1048576 2024-02-23T06:34:26.875 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.874+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~1NDZMCXDWOZU.2 size=35034 2024-02-23T06:34:26.877 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.876+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=1NDZMCXDWOZU tag=D8A0JRCIJZCY type=write size=3180762 2024-02-23T06:34:26.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.878+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~YS8DVAYADC42.0 size=579864 2024-02-23T06:34:26.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.878+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=YS8DVAYADC42 tag=I7YENMPDPD36 type=write size=1628440 2024-02-23T06:34:26.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.879+0000 7f5e72834780 -1 < failed to complete operation key=ZC75CQ2789VE tag=H90IE8NFK3B5 type=del size=2608742: (22) Invalid argument 2024-02-23T06:34:26.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.880+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=BKGNEP61TEML type=del size=3981770 2024-02-23T06:34:26.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.883+0000 7f5e72834780 1 < suggested update operation key=9ZCNDGBEPWMN tag=DF2OUZV1FMLD type=del size=1828676 2024-02-23T06:34:26.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.884+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=FPMWQQRPPLR2 type=write size=789783 2024-02-23T06:34:26.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.885+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=0OZ03EVN9LTF type=del 2024-02-23T06:34:26.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.886+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=KIKBBW4LD2S9 type=del size=3618531 2024-02-23T06:34:26.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.887+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=DCBC23X2DLV4 type=del 2024-02-23T06:34:26.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.888+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=K3A5KZ98P9K1 type=del size=2130878 2024-02-23T06:34:26.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.890+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~TUYSR03C9JAE.0 size=283677 2024-02-23T06:34:26.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.892+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=TUYSR03C9JAE tag=4LHM4PJ1AEWC type=write size=1332253 2024-02-23T06:34:26.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.894+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=BLAQAUAQ64GD type=write size=240221 2024-02-23T06:34:26.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.895+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=7FLNI8KYNTN4 type=del 2024-02-23T06:34:26.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.898+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~Z8D5CECBFCYG.0 size=1048576 2024-02-23T06:34:26.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.898+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~Z8D5CECBFCYG.1 size=1048576 2024-02-23T06:34:26.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.899+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~Z8D5CECBFCYG.2 size=787182 2024-02-23T06:34:26.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.899+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=Z8D5CECBFCYG tag=X3ZD3M9B8EZW type=write size=3932910 2024-02-23T06:34:26.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.900+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=7QEP9AKQMD3F type=del 2024-02-23T06:34:26.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.901+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=5JGC6PSWYJK4 type=write size=491855 2024-02-23T06:34:26.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.902+0000 7f5e72834780 1 < canceled part key=_multipart_4M7BT05YB0C3.2~Y9ZFAAITECUG.0 size=598225 2024-02-23T06:34:26.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.903+0000 7f5e72834780 1 < canceled multipart upload key=4M7BT05YB0C3 upload=Y9ZFAAITECUG tag=YY473YLK7UMM type=write size=1646801 2024-02-23T06:34:26.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.905+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~A83KSE6ML6V5.0 size=87813 2024-02-23T06:34:26.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.905+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=A83KSE6ML6V5 tag=42L0OSZOW6CN type=write size=1136389 2024-02-23T06:34:26.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.907+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=01YXZ9ZMC8TN type=del 2024-02-23T06:34:26.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.908+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=97VHQ14ADZBC type=write size=548828 2024-02-23T06:34:26.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.909+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~MSUWOT2H8KYU.0 size=1048576 2024-02-23T06:34:26.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.910+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~MSUWOT2H8KYU.1 size=1048576 2024-02-23T06:34:26.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.911+0000 7f5e72834780 1 < completed part key=_multipart_WK98HMHAZIUB.2~MSUWOT2H8KYU.2 size=924131 2024-02-23T06:34:26.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.914+0000 7f5e72834780 1 < completed multipart upload key=WK98HMHAZIUB upload=MSUWOT2H8KYU tag=0AR91H4QLTEL type=write size=4069859 2024-02-23T06:34:26.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.915+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=82WXMHE99U4U type=write size=722577 2024-02-23T06:34:26.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.916+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~SUOJQOKBJPL7.0 size=625708 2024-02-23T06:34:26.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.918+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=SUOJQOKBJPL7 tag=0C85CLGUNJGJ type=write size=1674284 2024-02-23T06:34:26.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.920+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=IJZH26GHFZE8 type=del size=2626977 2024-02-23T06:34:26.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.921+0000 7f5e72834780 1 < canceled operation key=883VBT1ADE6K tag=JJT9RBFY7HR7 type=write size=947373 2024-02-23T06:34:26.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.923+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~CBNTDB0KTTY7.0 size=1048576 2024-02-23T06:34:26.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.924+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~CBNTDB0KTTY7.1 size=1048576 2024-02-23T06:34:26.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.925+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~CBNTDB0KTTY7.2 size=93420 2024-02-23T06:34:26.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.925+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=CBNTDB0KTTY7 tag=FFVC726QVSOU type=write size=3239148 2024-02-23T06:34:26.927 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.926+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~OF3600SC5XUO.0 size=1048576 2024-02-23T06:34:26.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.928+0000 7f5e72834780 1 < completed part key=_multipart_GWTK3YV0RY21.2~OF3600SC5XUO.1 size=583454 2024-02-23T06:34:26.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.930+0000 7f5e72834780 1 < completed multipart upload key=GWTK3YV0RY21 upload=OF3600SC5XUO tag=NY2QQOWQVJ5A type=write size=2680606 2024-02-23T06:34:26.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.932+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=WJFKWLDT2BSK type=del size=2362838 2024-02-23T06:34:26.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.933+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~62LRSPSHPV2L.0 size=1048576 2024-02-23T06:34:26.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.934+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~62LRSPSHPV2L.1 size=1048576 2024-02-23T06:34:26.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.935+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~62LRSPSHPV2L.2 size=969904 2024-02-23T06:34:26.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.937+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=62LRSPSHPV2L tag=ENNNP9WZH658 type=write size=4115632 2024-02-23T06:34:26.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.938+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=0PCJOLPNEPF1 type=del size=4163795 2024-02-23T06:34:26.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.941+0000 7f5e72834780 1 < suggested update operation key=VER8U5YMTPS6 tag=EPTP44KLOZKN type=del size=3094976 2024-02-23T06:34:26.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.942+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=Z042HG4T8E0N type=del size=3817581 2024-02-23T06:34:26.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.943+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~YS8DVAYADC42.0 size=579864 2024-02-23T06:34:26.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.945+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=YS8DVAYADC42 tag=I7YENMPDPD36 type=write size=1628440 2024-02-23T06:34:26.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.947+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=T2UJPILPXPKK type=del size=430662 2024-02-23T06:34:26.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.948+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=BKGNEP61TEML type=del 2024-02-23T06:34:26.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.950+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~1D7YMTYT3JCQ.0 size=524223 2024-02-23T06:34:26.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.950+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=1D7YMTYT3JCQ tag=9DW5XRKIW38H type=write size=1572799 2024-02-23T06:34:26.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.951+0000 7f5e72834780 1 < canceled operation key=TPADM4812N0Z tag=FPMWQQRPPLR2 type=write size=789783 2024-02-23T06:34:26.954 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.953+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=A5Z1KQELIK0S type=del size=2643597 2024-02-23T06:34:26.955 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.954+0000 7f5e72834780 -1 < failed to complete operation key=VER8U5YMTPS6 tag=KIKBBW4LD2S9 type=del size=3618531: (22) Invalid argument 2024-02-23T06:34:26.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.956+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~PPDW3E5WZTR3.0 size=1048576 2024-02-23T06:34:26.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.957+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~PPDW3E5WZTR3.1 size=467343 2024-02-23T06:34:26.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.957+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=PPDW3E5WZTR3 tag=T8AZ1PN1RA4M type=write size=2564495 2024-02-23T06:34:26.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.959+0000 7f5e72834780 1 < suggested update operation key=MB8BZ2BXZE9M tag=K3A5KZ98P9K1 type=del size=2130878 2024-02-23T06:34:26.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.960+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=MWMW920BW0Q5 type=del size=1847182 2024-02-23T06:34:26.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.961+0000 7f5e72834780 1 < completed write operation key=R3STDBS79MV0 tag=BLAQAUAQ64GD type=write size=240221 2024-02-23T06:34:26.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.963+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~Q6HNBHOG3K90.0 size=1048576 2024-02-23T06:34:26.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.964+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~Q6HNBHOG3K90.1 size=240315 2024-02-23T06:34:26.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.964+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=Q6HNBHOG3K90 tag=P43EHF1Y58LH type=write size=2337467 2024-02-23T06:34:26.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.965+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~Z8D5CECBFCYG.0 size=1048576 2024-02-23T06:34:26.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.966+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~Z8D5CECBFCYG.1 size=1048576 2024-02-23T06:34:26.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.967+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~Z8D5CECBFCYG.2 size=787182 2024-02-23T06:34:26.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.969+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=Z8D5CECBFCYG tag=X3ZD3M9B8EZW type=write size=3932910 2024-02-23T06:34:26.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.970+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=EZDO7LUWNUJC type=write size=410665 2024-02-23T06:34:26.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.972+0000 7f5e72834780 1 < completed write operation key=M5LH10WTDP0P tag=5JGC6PSWYJK4 type=write size=491855 2024-02-23T06:34:26.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.973+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=VJCOKDDFWB1B type=del size=795962 2024-02-23T06:34:26.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.974+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~A83KSE6ML6V5.0 size=87813 2024-02-23T06:34:26.977 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.976+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=A83KSE6ML6V5 tag=42L0OSZOW6CN type=write size=1136389 2024-02-23T06:34:26.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.977+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=B90DTX99M9GN type=del size=2868355 2024-02-23T06:34:26.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.978+0000 7f5e72834780 1 < completed write operation key=GWTK3YV0RY21 tag=97VHQ14ADZBC type=write size=548828 2024-02-23T06:34:26.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.981+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~SJ4OE939VOAC.0 size=1048576 2024-02-23T06:34:26.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.981+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~SJ4OE939VOAC.1 size=981465 2024-02-23T06:34:26.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.981+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=SJ4OE939VOAC tag=468XZE5SJO7O type=write size=3078617 2024-02-23T06:34:26.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.984+0000 7f5e72834780 1 < suggested remove operation key=LUERFL6AN6HF tag=82WXMHE99U4U type=write 2024-02-23T06:34:26.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.985+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=DXZ3QC4ZK38K type=del size=141037 2024-02-23T06:34:26.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.986+0000 7f5e72834780 1 < canceled operation key=WETP4ONTU3HL tag=IJZH26GHFZE8 type=del size=2626977 2024-02-23T06:34:26.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.987+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=S4I2S9KKQQFH type=del size=2930815 2024-02-23T06:34:26.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.988+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~CBNTDB0KTTY7.0 size=1048576 2024-02-23T06:34:26.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.989+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~CBNTDB0KTTY7.1 size=1048576 2024-02-23T06:34:26.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.990+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~CBNTDB0KTTY7.2 size=93420 2024-02-23T06:34:26.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.992+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=CBNTDB0KTTY7 tag=FFVC726QVSOU type=write size=3239148 2024-02-23T06:34:26.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.993+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=UA8L3O0LO7CO type=del size=904008 2024-02-23T06:34:26.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.994+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=WJFKWLDT2BSK type=del 2024-02-23T06:34:26.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.996+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~OFKESXDVK3P7.0 size=1048576 2024-02-23T06:34:26.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.997+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~OFKESXDVK3P7.1 size=1048576 2024-02-23T06:34:26.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.998+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~OFKESXDVK3P7.2 size=136558 2024-02-23T06:34:26.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.998+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=OFKESXDVK3P7 tag=CC6D71XB9KG7 type=write size=3282286 2024-02-23T06:34:27.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:26.999+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=0PCJOLPNEPF1 type=del 2024-02-23T06:34:27.002 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.001+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~UADVSAOAIU3Q.0 size=1048576 2024-02-23T06:34:27.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.002+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~UADVSAOAIU3Q.1 size=1048576 2024-02-23T06:34:27.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.003+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~UADVSAOAIU3Q.2 size=118777 2024-02-23T06:34:27.004 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.003+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=UADVSAOAIU3Q tag=6H27PP9FPBQ6 type=write size=3264505 2024-02-23T06:34:27.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.004+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=Z042HG4T8E0N type=del 2024-02-23T06:34:27.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.005+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=0QQJ69Y2NHBH type=del size=2596246 2024-02-23T06:34:27.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.006+0000 7f5e72834780 1 < canceled operation key=GWTK3YV0RY21 tag=T2UJPILPXPKK type=del size=430662 2024-02-23T06:34:27.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.007+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=708JTOQK8GC2 type=del size=3140539 2024-02-23T06:34:27.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.008+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~1D7YMTYT3JCQ.0 size=524223 2024-02-23T06:34:27.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.010+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=1D7YMTYT3JCQ tag=9DW5XRKIW38H type=write size=1572799 2024-02-23T06:34:27.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.012+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~I58CR30IUK9Q.0 size=1048576 2024-02-23T06:34:27.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.013+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~I58CR30IUK9Q.1 size=1048576 2024-02-23T06:34:27.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.014+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~I58CR30IUK9Q.2 size=826172 2024-02-23T06:34:27.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.014+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=I58CR30IUK9Q tag=WWA2MGUZ7KK5 type=write size=3971900 2024-02-23T06:34:27.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.015+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=A5Z1KQELIK0S type=del 2024-02-23T06:34:27.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.016+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=3OB9O3TUGGCC type=del size=3093765 2024-02-23T06:34:27.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.017+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~PPDW3E5WZTR3.0 size=1048576 2024-02-23T06:34:27.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.018+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~PPDW3E5WZTR3.1 size=467343 2024-02-23T06:34:27.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.020+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=PPDW3E5WZTR3 tag=T8AZ1PN1RA4M type=write size=2564495 2024-02-23T06:34:27.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.022+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~5UJ2MWOJZF96.0 size=1048576 2024-02-23T06:34:27.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.023+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~5UJ2MWOJZF96.1 size=502389 2024-02-23T06:34:27.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.023+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=5UJ2MWOJZF96 tag=HVJVNQSTNL6S type=write size=2599541 2024-02-23T06:34:27.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.025+0000 7f5e72834780 1 < suggested remove operation key=R3STDBS79MV0 tag=MWMW920BW0Q5 type=del 2024-02-23T06:34:27.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.027+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GZ2KTKLO0ZDK.0 size=328003 2024-02-23T06:34:27.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.027+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=GZ2KTKLO0ZDK tag=PKP955ANPSJB type=write size=1376579 2024-02-23T06:34:27.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.028+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~Q6HNBHOG3K90.0 size=1048576 2024-02-23T06:34:27.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.029+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~Q6HNBHOG3K90.1 size=240315 2024-02-23T06:34:27.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.031+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=Q6HNBHOG3K90 tag=P43EHF1Y58LH type=write size=2337467 2024-02-23T06:34:27.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.032+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=JVE6M9K7N05U type=del size=852097 2024-02-23T06:34:27.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.033+0000 7f5e72834780 1 < completed write operation key=R4YA9DUAJABL tag=EZDO7LUWNUJC type=write size=410665 2024-02-23T06:34:27.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.036+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~58BR6978TI3O.0 size=1048576 2024-02-23T06:34:27.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.037+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~58BR6978TI3O.1 size=1048576 2024-02-23T06:34:27.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.038+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~58BR6978TI3O.2 size=345740 2024-02-23T06:34:27.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.038+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=58BR6978TI3O tag=3VACTGHFFQ53 type=write size=3491468 2024-02-23T06:34:27.040 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.039+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=VJCOKDDFWB1B type=del 2024-02-23T06:34:27.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.040+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=5ULDDSF1K8B2 type=del size=2215698 2024-02-23T06:34:27.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.043+0000 7f5e72834780 1 < suggested update operation key=RS03NUABC1U2 tag=B90DTX99M9GN type=del size=2868355 2024-02-23T06:34:27.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.044+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=ID94LXWPJLX4 type=del size=2757786 2024-02-23T06:34:27.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.045+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~SJ4OE939VOAC.0 size=1048576 2024-02-23T06:34:27.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.046+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~SJ4OE939VOAC.1 size=981465 2024-02-23T06:34:27.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.048+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=SJ4OE939VOAC tag=468XZE5SJO7O type=write size=3078617 2024-02-23T06:34:27.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.050+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~3LOX6KIY6336.0 size=1048576 2024-02-23T06:34:27.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.051+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~3LOX6KIY6336.1 size=1048576 2024-02-23T06:34:27.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.052+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~3LOX6KIY6336.2 size=331831 2024-02-23T06:34:27.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.052+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=3LOX6KIY6336 tag=C0ZK3L20R5HN type=write size=3477559 2024-02-23T06:34:27.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.053+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=DXZ3QC4ZK38K type=del 2024-02-23T06:34:27.056 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.055+0000 7f5e72834780 1 > prepared operation key=26EE3EHDK8EM tag=BC6YLUV15E45 type=del size=220717 2024-02-23T06:34:27.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.056+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=S4I2S9KKQQFH type=del 2024-02-23T06:34:27.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.057+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=1KFICI0IVNZC type=del size=1067059 2024-02-23T06:34:27.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.058+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=UA8L3O0LO7CO type=del 2024-02-23T06:34:27.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.059+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=PW0269JU71TW type=del size=3358211 2024-02-23T06:34:27.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.061+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~OFKESXDVK3P7.0 size=1048576 2024-02-23T06:34:27.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.062+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~OFKESXDVK3P7.1 size=1048576 2024-02-23T06:34:27.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.063+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~OFKESXDVK3P7.2 size=136558 2024-02-23T06:34:27.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.065+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=OFKESXDVK3P7 tag=CC6D71XB9KG7 type=write size=3282286 2024-02-23T06:34:27.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.067+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~O2U9CEOR9K4F.0 size=1048576 2024-02-23T06:34:27.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.068+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~O2U9CEOR9K4F.1 size=1048576 2024-02-23T06:34:27.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.068+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~O2U9CEOR9K4F.2 size=838948 2024-02-23T06:34:27.070 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.068+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=O2U9CEOR9K4F tag=LUVT73QSTLW0 type=write size=3984676 2024-02-23T06:34:27.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.070+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~UADVSAOAIU3Q.0 size=1048576 2024-02-23T06:34:27.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.071+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~UADVSAOAIU3Q.1 size=1048576 2024-02-23T06:34:27.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.071+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~UADVSAOAIU3Q.2 size=118777 2024-02-23T06:34:27.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.073+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=UADVSAOAIU3Q tag=6H27PP9FPBQ6 type=write size=3264505 2024-02-23T06:34:27.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.075+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~W17XKS0KMXQO.0 size=1048576 2024-02-23T06:34:27.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.076+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~W17XKS0KMXQO.1 size=660004 2024-02-23T06:34:27.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.076+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=W17XKS0KMXQO tag=CPY80082LJFJ type=write size=2757156 2024-02-23T06:34:27.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.078+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=0QQJ69Y2NHBH type=del 2024-02-23T06:34:27.081 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.080+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~9XKMY0TJMYRA.0 size=1048576 2024-02-23T06:34:27.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.081+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~9XKMY0TJMYRA.1 size=348156 2024-02-23T06:34:27.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.081+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=9XKMY0TJMYRA tag=K4B6YI0O510C type=write size=2445308 2024-02-23T06:34:27.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.082+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=708JTOQK8GC2 type=del 2024-02-23T06:34:27.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.083+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=5NFUYR415IRC type=write size=278676 2024-02-23T06:34:27.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.084+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~I58CR30IUK9Q.0 size=1048576 2024-02-23T06:34:27.087 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.086+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~I58CR30IUK9Q.1 size=1048576 2024-02-23T06:34:27.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.086+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~I58CR30IUK9Q.2 size=826172 2024-02-23T06:34:27.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.089+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=I58CR30IUK9Q tag=WWA2MGUZ7KK5 type=write size=3971900 2024-02-23T06:34:27.092 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.091+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~HMZVJVVNI41R.0 size=1048576 2024-02-23T06:34:27.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.092+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~HMZVJVVNI41R.1 size=400627 2024-02-23T06:34:27.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.092+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=HMZVJVVNI41R tag=TBU38P89E7PT type=write size=2497779 2024-02-23T06:34:27.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.093+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=3OB9O3TUGGCC type=del 2024-02-23T06:34:27.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.094+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=W01AOUX8V9KC type=del size=1419693 2024-02-23T06:34:27.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.095+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~5UJ2MWOJZF96.0 size=1048576 2024-02-23T06:34:27.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.096+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~5UJ2MWOJZF96.1 size=502389 2024-02-23T06:34:27.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.100+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=5UJ2MWOJZF96 tag=HVJVNQSTNL6S type=write size=2599541 2024-02-23T06:34:27.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.102+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~O55N3OZKJCDZ.0 size=1048576 2024-02-23T06:34:27.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.103+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~O55N3OZKJCDZ.1 size=423934 2024-02-23T06:34:27.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.103+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=O55N3OZKJCDZ tag=JG4SJEJ0VMR1 type=write size=2521086 2024-02-23T06:34:27.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.104+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GZ2KTKLO0ZDK.0 size=328003 2024-02-23T06:34:27.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.106+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=GZ2KTKLO0ZDK tag=PKP955ANPSJB type=write size=1376579 2024-02-23T06:34:27.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.107+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=Q2XNA1Z19QO2 type=del size=1179686 2024-02-23T06:34:27.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.108+0000 7f5e72834780 1 < completed delete operation key=721UW0AGSKVR tag=JVE6M9K7N05U type=del 2024-02-23T06:34:27.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.110+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~MH2WO7166P79.0 size=898861 2024-02-23T06:34:27.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.110+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=MH2WO7166P79 tag=3FYBHJVA3YS5 type=write size=1947437 2024-02-23T06:34:27.112 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.111+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~58BR6978TI3O.0 size=1048576 2024-02-23T06:34:27.113 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.112+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~58BR6978TI3O.1 size=1048576 2024-02-23T06:34:27.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.113+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~58BR6978TI3O.2 size=345740 2024-02-23T06:34:27.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.115+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=58BR6978TI3O tag=3VACTGHFFQ53 type=write size=3491468 2024-02-23T06:34:27.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.117+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=ZRWORAXE9SFN type=del size=3418295 2024-02-23T06:34:27.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.118+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=5ULDDSF1K8B2 type=del 2024-02-23T06:34:27.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.120+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~WLIMUQEFPO5V.0 size=1048576 2024-02-23T06:34:27.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.121+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~WLIMUQEFPO5V.1 size=583867 2024-02-23T06:34:27.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.121+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=WLIMUQEFPO5V tag=F1S10E2SHE1F type=write size=2681019 2024-02-23T06:34:27.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.124+0000 7f5e72834780 1 < suggested update operation key=WETP4ONTU3HL tag=ID94LXWPJLX4 type=del size=2757786 2024-02-23T06:34:27.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.125+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=NSOE9UR2G2OY type=del size=161028 2024-02-23T06:34:27.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.126+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~3LOX6KIY6336.0 size=1048576 2024-02-23T06:34:27.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.127+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~3LOX6KIY6336.1 size=1048576 2024-02-23T06:34:27.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.128+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~3LOX6KIY6336.2 size=331831 2024-02-23T06:34:27.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.130+0000 7f5e72834780 1 < completed multipart upload key=9AQCXLBZW3EV upload=3LOX6KIY6336 tag=C0ZK3L20R5HN type=write size=3477559 2024-02-23T06:34:27.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.131+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=C0ATT7JJ1ZTD type=write size=486667 2024-02-23T06:34:27.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.133+0000 7f5e72834780 1 < completed delete operation key=26EE3EHDK8EM tag=BC6YLUV15E45 type=del 2024-02-23T06:34:27.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.134+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=8CL0VCKA79ZG type=del size=1746846 2024-02-23T06:34:27.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.136+0000 7f5e72834780 1 < suggested update operation key=4M7BT05YB0C3 tag=1KFICI0IVNZC type=del size=1067059 2024-02-23T06:34:27.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.137+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=87NE2IEWKN7B type=del size=1898751 2024-02-23T06:34:27.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.139+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=PW0269JU71TW type=del 2024-02-23T06:34:27.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.140+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=RDFLUV34ML7W type=del size=2328789 2024-02-23T06:34:27.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.141+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~O2U9CEOR9K4F.0 size=1048576 2024-02-23T06:34:27.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.142+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~O2U9CEOR9K4F.1 size=1048576 2024-02-23T06:34:27.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.143+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~O2U9CEOR9K4F.2 size=838948 2024-02-23T06:34:27.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.147+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=O2U9CEOR9K4F tag=LUVT73QSTLW0 type=write size=3984676 2024-02-23T06:34:27.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.148+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=S6T8TIUM6H7Q type=write size=711027 2024-02-23T06:34:27.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.150+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~W17XKS0KMXQO.0 size=1048576 2024-02-23T06:34:27.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.150+0000 7f5e72834780 1 < canceled part key=_multipart_R4YA9DUAJABL.2~W17XKS0KMXQO.1 size=660004 2024-02-23T06:34:27.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.153+0000 7f5e72834780 1 < canceled multipart upload key=R4YA9DUAJABL upload=W17XKS0KMXQO tag=CPY80082LJFJ type=write size=2757156 2024-02-23T06:34:27.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.155+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~OX6VXZLJEEFH.0 size=894207 2024-02-23T06:34:27.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.155+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=OX6VXZLJEEFH tag=DA12KPUO3Y9V type=write size=1942783 2024-02-23T06:34:27.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.156+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~9XKMY0TJMYRA.0 size=1048576 2024-02-23T06:34:27.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.157+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~9XKMY0TJMYRA.1 size=348156 2024-02-23T06:34:27.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.159+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=9XKMY0TJMYRA tag=K4B6YI0O510C type=write size=2445308 2024-02-23T06:34:27.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.162+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~8D2DHGGD8Y24.0 size=1048576 2024-02-23T06:34:27.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.163+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~8D2DHGGD8Y24.1 size=854374 2024-02-23T06:34:27.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.163+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=8D2DHGGD8Y24 tag=A3OPGDHUNTO7 type=write size=2951526 2024-02-23T06:34:27.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.164+0000 7f5e72834780 1 < completed write operation key=721UW0AGSKVR tag=5NFUYR415IRC type=write size=278676 2024-02-23T06:34:27.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.165+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=LK1HKTAK6F18 type=del size=13650 2024-02-23T06:34:27.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.167+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~HMZVJVVNI41R.0 size=1048576 2024-02-23T06:34:27.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.168+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~HMZVJVVNI41R.1 size=400627 2024-02-23T06:34:27.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.170+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=HMZVJVVNI41R tag=TBU38P89E7PT type=write size=2497779 2024-02-23T06:34:27.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.171+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=NN9VVVJR7VQY type=write size=644151 2024-02-23T06:34:27.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.173+0000 7f5e72834780 1 < suggested update operation key=ZM1YKZOUFSCY tag=W01AOUX8V9KC type=del size=1419693 2024-02-23T06:34:27.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.174+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=1F2C5Q63AL2W type=del size=2680137 2024-02-23T06:34:27.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.176+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~O55N3OZKJCDZ.0 size=1048576 2024-02-23T06:34:27.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.177+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~O55N3OZKJCDZ.1 size=423934 2024-02-23T06:34:27.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.179+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=O55N3OZKJCDZ tag=JG4SJEJ0VMR1 type=write size=2521086 2024-02-23T06:34:27.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.180+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=N580FDTVRLZ1 type=del size=526188 2024-02-23T06:34:27.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.181+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=Q2XNA1Z19QO2 type=del 2024-02-23T06:34:27.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.184+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~FHCABOCWW09M.0 size=1048576 2024-02-23T06:34:27.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.185+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~FHCABOCWW09M.1 size=1048576 2024-02-23T06:34:27.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.186+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~FHCABOCWW09M.2 size=97943 2024-02-23T06:34:27.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.186+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=FHCABOCWW09M tag=IAH9OEJG34ME type=write size=3243671 2024-02-23T06:34:27.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.187+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~MH2WO7166P79.0 size=898861 2024-02-23T06:34:27.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.189+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=MH2WO7166P79 tag=3FYBHJVA3YS5 type=write size=1947437 2024-02-23T06:34:27.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.191+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~3M10U0X12SER.0 size=1048576 2024-02-23T06:34:27.194 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.192+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~3M10U0X12SER.1 size=1048576 2024-02-23T06:34:27.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.193+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~3M10U0X12SER.2 size=220431 2024-02-23T06:34:27.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.193+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=3M10U0X12SER tag=1TX919ZI5VR2 type=write size=3366159 2024-02-23T06:34:27.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.195+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=ZRWORAXE9SFN type=del size=3418295 2024-02-23T06:34:27.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.197+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=F01XP8C7Q1H4 type=del size=4010776 2024-02-23T06:34:27.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.198+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~WLIMUQEFPO5V.0 size=1048576 2024-02-23T06:34:27.200 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.199+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~WLIMUQEFPO5V.1 size=583867 2024-02-23T06:34:27.202 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.201+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=WLIMUQEFPO5V tag=F1S10E2SHE1F type=write size=2681019 2024-02-23T06:34:27.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.203+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~VA2KHYXJTJ9G.0 size=1048576 2024-02-23T06:34:27.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.203+0000 7f5e72834780 1 > prepared part key=_multipart_8Q6WC7B9BY5Q.2~VA2KHYXJTJ9G.1 size=800300 2024-02-23T06:34:27.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.203+0000 7f5e72834780 1 > prepared multipart upload key=8Q6WC7B9BY5Q upload=VA2KHYXJTJ9G tag=OTNX5WM8T8OT type=write size=2897452 2024-02-23T06:34:27.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.205+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=NSOE9UR2G2OY type=del 2024-02-23T06:34:27.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.206+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=F1ZMNQMI7IVZ type=del size=3295459 2024-02-23T06:34:27.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.207+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=C0ATT7JJ1ZTD type=write size=486667 2024-02-23T06:34:27.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.208+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=X71RBE0KIUR1 type=del size=3587795 2024-02-23T06:34:27.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.209+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=8CL0VCKA79ZG type=del 2024-02-23T06:34:27.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.210+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=XU9PDISM3YOU type=write size=289157 2024-02-23T06:34:27.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.213+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=87NE2IEWKN7B type=del 2024-02-23T06:34:27.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.215+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~6MHYXAV0IB03.0 size=1048576 2024-02-23T06:34:27.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.216+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~6MHYXAV0IB03.1 size=1048576 2024-02-23T06:34:27.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.217+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~6MHYXAV0IB03.2 size=394508 2024-02-23T06:34:27.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.217+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=6MHYXAV0IB03 tag=X9CDHZA35SAS type=write size=3540236 2024-02-23T06:34:27.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.218+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=RDFLUV34ML7W type=del 2024-02-23T06:34:27.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.220+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~QSZUZYE9JDBY.0 size=677558 2024-02-23T06:34:27.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.220+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=QSZUZYE9JDBY tag=VR4NN1SYZMFP type=write size=1726134 2024-02-23T06:34:27.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.222+0000 7f5e72834780 1 < suggested remove operation key=R3STDBS79MV0 tag=S6T8TIUM6H7Q type=write 2024-02-23T06:34:27.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.224+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~FEB95ZPYX6EI.0 size=1048576 2024-02-23T06:34:27.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.225+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~FEB95ZPYX6EI.1 size=584099 2024-02-23T06:34:27.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.225+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=FEB95ZPYX6EI tag=0TYHKSOM4241 type=write size=2681251 2024-02-23T06:34:27.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.225+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~OX6VXZLJEEFH.0 size=894207 2024-02-23T06:34:27.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.227+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=OX6VXZLJEEFH tag=DA12KPUO3Y9V type=write size=1942783 2024-02-23T06:34:27.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.228+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=VV5JUJUIRX04 type=del size=1751963 2024-02-23T06:34:27.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.230+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~8D2DHGGD8Y24.0 size=1048576 2024-02-23T06:34:27.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.230+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~8D2DHGGD8Y24.1 size=854374 2024-02-23T06:34:27.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.233+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=8D2DHGGD8Y24 tag=A3OPGDHUNTO7 type=write size=2951526 2024-02-23T06:34:27.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.235+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~BLBK8JYC0FPR.0 size=1048576 2024-02-23T06:34:27.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.236+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~BLBK8JYC0FPR.1 size=316252 2024-02-23T06:34:27.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.236+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=BLBK8JYC0FPR tag=PNIWOT74XYQK type=write size=2413404 2024-02-23T06:34:27.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.237+0000 7f5e72834780 1 < completed delete operation key=WETP4ONTU3HL tag=LK1HKTAK6F18 type=del 2024-02-23T06:34:27.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.239+0000 7f5e72834780 1 > prepared operation key=WETP4ONTU3HL tag=V3HMV8YMURF1 type=write size=144818 2024-02-23T06:34:27.242 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.241+0000 7f5e72834780 1 < suggested update operation key=GW6EKQ84FQ6L tag=NN9VVVJR7VQY type=write size=644151 2024-02-23T06:34:27.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.242+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=0RXPR2VOTY64 type=del size=2693936 2024-02-23T06:34:27.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.243+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=1F2C5Q63AL2W type=del 2024-02-23T06:34:27.245 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.244+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=ICQQNSPR5S34 type=del size=4137693 2024-02-23T06:34:27.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.245+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=N580FDTVRLZ1 type=del 2024-02-23T06:34:27.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.247+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=L5QHRE8GKLCO type=write size=48607 2024-02-23T06:34:27.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.248+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~FHCABOCWW09M.0 size=1048576 2024-02-23T06:34:27.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.249+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~FHCABOCWW09M.1 size=1048576 2024-02-23T06:34:27.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.249+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~FHCABOCWW09M.2 size=97943 2024-02-23T06:34:27.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.251+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=FHCABOCWW09M tag=IAH9OEJG34ME type=write size=3243671 2024-02-23T06:34:27.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.252+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=B26OZHEGTR9E type=write size=186441 2024-02-23T06:34:27.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.254+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~3M10U0X12SER.0 size=1048576 2024-02-23T06:34:27.256 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.255+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~3M10U0X12SER.1 size=1048576 2024-02-23T06:34:27.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.256+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~3M10U0X12SER.2 size=220431 2024-02-23T06:34:27.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.258+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=3M10U0X12SER tag=1TX919ZI5VR2 type=write size=3366159 2024-02-23T06:34:27.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.259+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=U141DRUR1XLY type=del size=2978252 2024-02-23T06:34:27.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.262+0000 7f5e72834780 1 < completed delete operation key=QZLNM2RQ9SDC tag=F01XP8C7Q1H4 type=del 2024-02-23T06:34:27.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.264+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~H6ZHTBPFEB7X.0 size=1048576 2024-02-23T06:34:27.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.265+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~H6ZHTBPFEB7X.1 size=1048576 2024-02-23T06:34:27.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.266+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~H6ZHTBPFEB7X.2 size=728788 2024-02-23T06:34:27.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.266+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=H6ZHTBPFEB7X tag=IQ7XOLEB2E4M type=write size=3874516 2024-02-23T06:34:27.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.267+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~VA2KHYXJTJ9G.0 size=1048576 2024-02-23T06:34:27.269 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.268+0000 7f5e72834780 1 < completed part key=_multipart_8Q6WC7B9BY5Q.2~VA2KHYXJTJ9G.1 size=800300 2024-02-23T06:34:27.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.270+0000 7f5e72834780 1 < completed multipart upload key=8Q6WC7B9BY5Q upload=VA2KHYXJTJ9G tag=OTNX5WM8T8OT type=write size=2897452 2024-02-23T06:34:27.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.272+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~Q08LOYIZ6U1F.0 size=1048576 2024-02-23T06:34:27.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.273+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~Q08LOYIZ6U1F.1 size=1048576 2024-02-23T06:34:27.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.274+0000 7f5e72834780 1 > prepared part key=_multipart_GACVVXC2Z1YO.2~Q08LOYIZ6U1F.2 size=453917 2024-02-23T06:34:27.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.274+0000 7f5e72834780 1 > prepared multipart upload key=GACVVXC2Z1YO upload=Q08LOYIZ6U1F tag=FND3LDY11H3T type=write size=3599645 2024-02-23T06:34:27.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.276+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=F1ZMNQMI7IVZ type=del 2024-02-23T06:34:27.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.277+0000 7f5e72834780 1 > prepared operation key=4M7BT05YB0C3 tag=G7LUDR3EBEIM type=del size=1273129 2024-02-23T06:34:27.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.278+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=X71RBE0KIUR1 type=del 2024-02-23T06:34:27.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.279+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=BS50U8WSJTQO type=del size=1250189 2024-02-23T06:34:27.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.280+0000 7f5e72834780 1 < completed write operation key=JV6FJONY04AW tag=XU9PDISM3YOU type=write size=289157 2024-02-23T06:34:27.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.282+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=3M5KE3HK4402 type=del size=3343863 2024-02-23T06:34:27.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.282+0000 7f5e72834780 1 < canceled part key=_multipart_MB8BZ2BXZE9M.2~6MHYXAV0IB03.0 size=1048576 2024-02-23T06:34:27.284 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.283+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~6MHYXAV0IB03.1 size=1048576 2024-02-23T06:34:27.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.284+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~6MHYXAV0IB03.2 size=394508 2024-02-23T06:34:27.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.286+0000 7f5e72834780 1 < canceled multipart upload key=MB8BZ2BXZE9M upload=6MHYXAV0IB03 tag=X9CDHZA35SAS type=write size=3540236 2024-02-23T06:34:27.288 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.287+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=YW5FG51FNJHR type=del size=3688381 2024-02-23T06:34:27.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.288+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~QSZUZYE9JDBY.0 size=677558 2024-02-23T06:34:27.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.290+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=QSZUZYE9JDBY tag=VR4NN1SYZMFP type=write size=1726134 2024-02-23T06:34:27.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.291+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=5NCDV2WFW70E type=del size=784485 2024-02-23T06:34:27.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.292+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~FEB95ZPYX6EI.0 size=1048576 2024-02-23T06:34:27.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.293+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~FEB95ZPYX6EI.1 size=584099 2024-02-23T06:34:27.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.295+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=FEB95ZPYX6EI tag=0TYHKSOM4241 type=write size=2681251 2024-02-23T06:34:27.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.297+0000 7f5e72834780 1 > prepared part key=_multipart_MB8BZ2BXZE9M.2~4J7MZGEU1NIA.0 size=902317 2024-02-23T06:34:27.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.297+0000 7f5e72834780 1 > prepared multipart upload key=MB8BZ2BXZE9M upload=4J7MZGEU1NIA tag=UEAZA1V40GX0 type=write size=1950893 2024-02-23T06:34:27.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.300+0000 7f5e72834780 1 < suggested update operation key=RS03NUABC1U2 tag=VV5JUJUIRX04 type=del size=1751963 2024-02-23T06:34:27.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.301+0000 7f5e72834780 1 > prepared operation key=721UW0AGSKVR tag=WFKPZZLNJFKQ type=del size=3421005 2024-02-23T06:34:27.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.302+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~BLBK8JYC0FPR.0 size=1048576 2024-02-23T06:34:27.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.302+0000 7f5e72834780 1 < canceled part key=_multipart_883VBT1ADE6K.2~BLBK8JYC0FPR.1 size=316252 2024-02-23T06:34:27.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.304+0000 7f5e72834780 1 < canceled multipart upload key=883VBT1ADE6K upload=BLBK8JYC0FPR tag=PNIWOT74XYQK type=write size=2413404 2024-02-23T06:34:27.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.306+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~DIX9JXYKBBVP.0 size=1048576 2024-02-23T06:34:27.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.307+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~DIX9JXYKBBVP.1 size=862191 2024-02-23T06:34:27.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.307+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=DIX9JXYKBBVP tag=SC9RBWJ4G4RE type=write size=2959343 2024-02-23T06:34:27.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.309+0000 7f5e72834780 1 < suggested remove operation key=WETP4ONTU3HL tag=V3HMV8YMURF1 type=write 2024-02-23T06:34:27.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.310+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=V3SABJO2KKWX type=del size=2748001 2024-02-23T06:34:27.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.311+0000 7f5e72834780 1 < canceled operation key=R4YA9DUAJABL tag=0RXPR2VOTY64 type=del size=2693936 2024-02-23T06:34:27.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.312+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=F2HCANMTU8DG type=del size=920818 2024-02-23T06:34:27.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.314+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=ICQQNSPR5S34 type=del 2024-02-23T06:34:27.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.315+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=2F38PJZKC320 type=del size=690400 2024-02-23T06:34:27.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.316+0000 7f5e72834780 1 < canceled operation key=7N8OH7EETRN8 tag=L5QHRE8GKLCO type=write size=48607 2024-02-23T06:34:27.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.317+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=J2U92OQKTV5O type=del size=2571334 2024-02-23T06:34:27.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.318+0000 7f5e72834780 1 < completed write operation key=ZM1YKZOUFSCY tag=B26OZHEGTR9E type=write size=186441 2024-02-23T06:34:27.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.320+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=RJV3N34DGHEH type=write size=171615 2024-02-23T06:34:27.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.321+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=U141DRUR1XLY type=del 2024-02-23T06:34:27.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.323+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~QM46ZOCXG68F.0 size=1048576 2024-02-23T06:34:27.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.324+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~QM46ZOCXG68F.1 size=1048576 2024-02-23T06:34:27.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.325+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~QM46ZOCXG68F.2 size=156387 2024-02-23T06:34:27.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.325+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=QM46ZOCXG68F tag=YZTZNVULD4W2 type=write size=3302115 2024-02-23T06:34:27.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.325+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~H6ZHTBPFEB7X.0 size=1048576 2024-02-23T06:34:27.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.326+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~H6ZHTBPFEB7X.1 size=1048576 2024-02-23T06:34:27.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.326+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~H6ZHTBPFEB7X.2 size=728788 2024-02-23T06:34:27.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.328+0000 7f5e72834780 1 < canceled multipart upload key=26EE3EHDK8EM upload=H6ZHTBPFEB7X tag=IQ7XOLEB2E4M type=write size=3874516 2024-02-23T06:34:27.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.329+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=62DZXL49YNRY type=del size=802716 2024-02-23T06:34:27.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.330+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~Q08LOYIZ6U1F.0 size=1048576 2024-02-23T06:34:27.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.331+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~Q08LOYIZ6U1F.1 size=1048576 2024-02-23T06:34:27.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.332+0000 7f5e72834780 1 < completed part key=_multipart_GACVVXC2Z1YO.2~Q08LOYIZ6U1F.2 size=453917 2024-02-23T06:34:27.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.334+0000 7f5e72834780 1 < completed multipart upload key=GACVVXC2Z1YO upload=Q08LOYIZ6U1F tag=FND3LDY11H3T type=write size=3599645 2024-02-23T06:34:27.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.335+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=VG0SXUPRLSKV type=del size=618432 2024-02-23T06:34:27.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.337+0000 7f5e72834780 1 < suggested remove operation key=4M7BT05YB0C3 tag=G7LUDR3EBEIM type=del 2024-02-23T06:34:27.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.339+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~Z6Z9FD2G4FLG.0 size=1048576 2024-02-23T06:34:27.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.340+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~Z6Z9FD2G4FLG.1 size=341414 2024-02-23T06:34:27.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.340+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=Z6Z9FD2G4FLG tag=TOCUMOA5THW7 type=write size=2438566 2024-02-23T06:34:27.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.341+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=BS50U8WSJTQO type=del 2024-02-23T06:34:27.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.343+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=VSXQ1N51VRBD type=del size=1740355 2024-02-23T06:34:27.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.345+0000 7f5e72834780 1 < suggested update operation key=M5LH10WTDP0P tag=3M5KE3HK4402 type=del size=3343863 2024-02-23T06:34:27.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.346+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=UPAUF3EOKCL6 type=del size=3017379 2024-02-23T06:34:27.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.347+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=YW5FG51FNJHR type=del 2024-02-23T06:34:27.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.349+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~88HKOC53CSIW.0 size=1048576 2024-02-23T06:34:27.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.350+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~88HKOC53CSIW.1 size=77680 2024-02-23T06:34:27.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.350+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=88HKOC53CSIW tag=XFBFG9DZQPF8 type=write size=2174832 2024-02-23T06:34:27.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.351+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=5NCDV2WFW70E type=del 2024-02-23T06:34:27.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.353+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~ZJTBL0IUCHTJ.0 size=302461 2024-02-23T06:34:27.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.353+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=ZJTBL0IUCHTJ tag=10D2AI00UZJT type=write size=1351037 2024-02-23T06:34:27.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.354+0000 7f5e72834780 1 < completed part key=_multipart_MB8BZ2BXZE9M.2~4J7MZGEU1NIA.0 size=902317 2024-02-23T06:34:27.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.356+0000 7f5e72834780 1 < completed multipart upload key=MB8BZ2BXZE9M upload=4J7MZGEU1NIA tag=UEAZA1V40GX0 type=write size=1950893 2024-02-23T06:34:27.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.358+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~3N8P71EJ2BD4.0 size=854296 2024-02-23T06:34:27.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.358+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=3N8P71EJ2BD4 tag=99INVRQIS4XW type=write size=1902872 2024-02-23T06:34:27.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.361+0000 7f5e72834780 1 < suggested update operation key=721UW0AGSKVR tag=WFKPZZLNJFKQ type=del size=3421005 2024-02-23T06:34:27.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.363+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~XU1O1GF5HTNM.0 size=1048576 2024-02-23T06:34:27.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.364+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~XU1O1GF5HTNM.1 size=1048576 2024-02-23T06:34:27.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.365+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~XU1O1GF5HTNM.2 size=969107 2024-02-23T06:34:27.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.365+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=XU1O1GF5HTNM tag=SPZLKKX115NE type=write size=4114835 2024-02-23T06:34:27.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.367+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~DIX9JXYKBBVP.0 size=1048576 2024-02-23T06:34:27.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.368+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~DIX9JXYKBBVP.1 size=862191 2024-02-23T06:34:27.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.371+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=DIX9JXYKBBVP tag=SC9RBWJ4G4RE type=write size=2959343 2024-02-23T06:34:27.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.373+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~85IMSUDCA1I4.0 size=1048576 2024-02-23T06:34:27.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.374+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~85IMSUDCA1I4.1 size=523367 2024-02-23T06:34:27.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.374+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=85IMSUDCA1I4 tag=LSXHB3Y04IAL type=write size=2620519 2024-02-23T06:34:27.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.377+0000 7f5e72834780 1 < suggested update operation key=ZM1YKZOUFSCY tag=V3SABJO2KKWX type=del size=2748001 2024-02-23T06:34:27.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.378+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=KV46TL2A0IEZ type=del size=2226603 2024-02-23T06:34:27.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.379+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=F2HCANMTU8DG type=del 2024-02-23T06:34:27.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.381+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~AZRAIUU2TGWC.0 size=1048576 2024-02-23T06:34:27.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.382+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~AZRAIUU2TGWC.1 size=1048576 2024-02-23T06:34:27.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.383+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~AZRAIUU2TGWC.2 size=102831 2024-02-23T06:34:27.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.383+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=AZRAIUU2TGWC tag=Y1LIY80QAFE7 type=write size=3248559 2024-02-23T06:34:27.385 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.384+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=2F38PJZKC320 type=del 2024-02-23T06:34:27.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.386+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~WLSM3J5AJT93.0 size=1048576 2024-02-23T06:34:27.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.387+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~WLSM3J5AJT93.1 size=1048576 2024-02-23T06:34:27.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.388+0000 7f5e72834780 1 > prepared part key=_multipart_883VBT1ADE6K.2~WLSM3J5AJT93.2 size=500426 2024-02-23T06:34:27.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.388+0000 7f5e72834780 1 > prepared multipart upload key=883VBT1ADE6K upload=WLSM3J5AJT93 tag=69KVU30V19P4 type=write size=3646154 2024-02-23T06:34:27.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.389+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=J2U92OQKTV5O type=del 2024-02-23T06:34:27.393 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.392+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~R5927311JZ0T.0 size=1048576 2024-02-23T06:34:27.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.392+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~R5927311JZ0T.1 size=1048576 2024-02-23T06:34:27.394 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.393+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~R5927311JZ0T.2 size=648570 2024-02-23T06:34:27.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.393+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=R5927311JZ0T tag=S5FOKA9T3TZK type=write size=3794298 2024-02-23T06:34:27.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.394+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=RJV3N34DGHEH type=write size=171615 2024-02-23T06:34:27.397 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.396+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=G7B0DD944QL0 type=del size=2718944 2024-02-23T06:34:27.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.397+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~QM46ZOCXG68F.0 size=1048576 2024-02-23T06:34:27.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.398+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~QM46ZOCXG68F.1 size=1048576 2024-02-23T06:34:27.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.399+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~QM46ZOCXG68F.2 size=156387 2024-02-23T06:34:27.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.401+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=QM46ZOCXG68F tag=YZTZNVULD4W2 type=write size=3302115 2024-02-23T06:34:27.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.402+0000 7f5e72834780 1 > prepared operation key=GACVVXC2Z1YO tag=IVTRR5KWT73K type=del size=1639548 2024-02-23T06:34:27.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.403+0000 7f5e72834780 1 < canceled operation key=9ZCNDGBEPWMN tag=62DZXL49YNRY type=del size=802716 2024-02-23T06:34:27.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.404+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=NFMF95D66DQS type=del size=2276018 2024-02-23T06:34:27.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.406+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=VG0SXUPRLSKV type=del 2024-02-23T06:34:27.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.408+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~P7LHCWVZNIF6.0 size=1048576 2024-02-23T06:34:27.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.409+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~P7LHCWVZNIF6.1 size=299387 2024-02-23T06:34:27.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.409+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=P7LHCWVZNIF6 tag=12RH0HW88SR5 type=write size=2396539 2024-02-23T06:34:27.411 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.410+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~Z6Z9FD2G4FLG.0 size=1048576 2024-02-23T06:34:27.412 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.411+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~Z6Z9FD2G4FLG.1 size=341414 2024-02-23T06:34:27.414 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.413+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=Z6Z9FD2G4FLG tag=TOCUMOA5THW7 type=write size=2438566 2024-02-23T06:34:27.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.416+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~F3PFMS89GQLS.0 size=1048576 2024-02-23T06:34:27.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.424+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~F3PFMS89GQLS.1 size=1048576 2024-02-23T06:34:27.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.424+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~F3PFMS89GQLS.2 size=295300 2024-02-23T06:34:27.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.424+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=F3PFMS89GQLS tag=KF3KLT8JDZ4O type=write size=3441028 2024-02-23T06:34:27.427 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.425+0000 7f5e72834780 1 < completed delete operation key=QGGULCYZ0ZSA tag=VSXQ1N51VRBD type=del 2024-02-23T06:34:27.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.427+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=YKD7UQHG4JX3 type=del size=1583947 2024-02-23T06:34:27.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.428+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=UPAUF3EOKCL6 type=del 2024-02-23T06:34:27.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.430+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NT09ORFPFGF0.0 size=1048576 2024-02-23T06:34:27.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.431+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~NT09ORFPFGF0.1 size=335860 2024-02-23T06:34:27.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.431+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=NT09ORFPFGF0 tag=MYHJ0KTCJ84V type=write size=2433012 2024-02-23T06:34:27.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.433+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~88HKOC53CSIW.0 size=1048576 2024-02-23T06:34:27.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.434+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~88HKOC53CSIW.1 size=77680 2024-02-23T06:34:27.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.436+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=88HKOC53CSIW tag=XFBFG9DZQPF8 type=write size=2174832 2024-02-23T06:34:27.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.437+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=2JRW6OB6DGPI type=write size=132165 2024-02-23T06:34:27.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.438+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~ZJTBL0IUCHTJ.0 size=302461 2024-02-23T06:34:27.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.440+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=ZJTBL0IUCHTJ tag=10D2AI00UZJT type=write size=1351037 2024-02-23T06:34:27.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.442+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~6S4HADXJDPDO.0 size=1048576 2024-02-23T06:34:27.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.443+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~6S4HADXJDPDO.1 size=751855 2024-02-23T06:34:27.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.443+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=6S4HADXJDPDO tag=9SJ4OLIUJX53 type=write size=2849007 2024-02-23T06:34:27.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.444+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~3N8P71EJ2BD4.0 size=854296 2024-02-23T06:34:27.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.446+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=3N8P71EJ2BD4 tag=99INVRQIS4XW type=write size=1902872 2024-02-23T06:34:27.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.448+0000 7f5e72834780 1 > prepared part key=_multipart_TNH85ZWPALJN.2~0KCW7UTAB1HR.0 size=53574 2024-02-23T06:34:27.449 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.448+0000 7f5e72834780 1 > prepared multipart upload key=TNH85ZWPALJN upload=0KCW7UTAB1HR tag=CA2CLIBMHFCY type=write size=1102150 2024-02-23T06:34:27.450 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.449+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~XU1O1GF5HTNM.0 size=1048576 2024-02-23T06:34:27.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.450+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~XU1O1GF5HTNM.1 size=1048576 2024-02-23T06:34:27.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.451+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~XU1O1GF5HTNM.2 size=969107 2024-02-23T06:34:27.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.453+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=XU1O1GF5HTNM tag=SPZLKKX115NE type=write size=4114835 2024-02-23T06:34:27.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.455+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~77PIQTWLUPZK.0 size=340642 2024-02-23T06:34:27.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.455+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=77PIQTWLUPZK tag=4Q58EKI6RGHF type=write size=1389218 2024-02-23T06:34:27.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.456+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~85IMSUDCA1I4.0 size=1048576 2024-02-23T06:34:27.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.457+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~85IMSUDCA1I4.1 size=523367 2024-02-23T06:34:27.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.459+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=85IMSUDCA1I4 tag=LSXHB3Y04IAL type=write size=2620519 2024-02-23T06:34:27.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.461+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=11WMV6DPB392 type=del size=1418995 2024-02-23T06:34:27.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.462+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=KV46TL2A0IEZ type=del 2024-02-23T06:34:27.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.463+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=4L1PT29RSJ51 type=write size=771033 2024-02-23T06:34:27.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.464+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~AZRAIUU2TGWC.0 size=1048576 2024-02-23T06:34:27.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.465+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~AZRAIUU2TGWC.1 size=1048576 2024-02-23T06:34:27.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.466+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~AZRAIUU2TGWC.2 size=102831 2024-02-23T06:34:27.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.468+0000 7f5e72834780 1 < completed multipart upload key=03P6IEKSHB17 upload=AZRAIUU2TGWC tag=Y1LIY80QAFE7 type=write size=3248559 2024-02-23T06:34:27.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.470+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~VASPDN43XL7G.0 size=1048576 2024-02-23T06:34:27.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.471+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~VASPDN43XL7G.1 size=1048576 2024-02-23T06:34:27.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.472+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~VASPDN43XL7G.2 size=335219 2024-02-23T06:34:27.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.472+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=VASPDN43XL7G tag=KGYN9OB2PIPO type=write size=3480947 2024-02-23T06:34:27.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.473+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~WLSM3J5AJT93.0 size=1048576 2024-02-23T06:34:27.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.474+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~WLSM3J5AJT93.1 size=1048576 2024-02-23T06:34:27.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.475+0000 7f5e72834780 1 < completed part key=_multipart_883VBT1ADE6K.2~WLSM3J5AJT93.2 size=500426 2024-02-23T06:34:27.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.477+0000 7f5e72834780 1 < completed multipart upload key=883VBT1ADE6K upload=WLSM3J5AJT93 tag=69KVU30V19P4 type=write size=3646154 2024-02-23T06:34:27.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.479+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~6DBENUNHR447.0 size=1048576 2024-02-23T06:34:27.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.480+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~6DBENUNHR447.1 size=843082 2024-02-23T06:34:27.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.480+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=6DBENUNHR447 tag=VJ8QKTZD6BR8 type=write size=2940234 2024-02-23T06:34:27.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.481+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~R5927311JZ0T.0 size=1048576 2024-02-23T06:34:27.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.481+0000 7f5e72834780 1 < canceled part key=_multipart_VEJ6D2J3LZI8.2~R5927311JZ0T.1 size=1048576 2024-02-23T06:34:27.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.482+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~R5927311JZ0T.2 size=648570 2024-02-23T06:34:27.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.485+0000 7f5e72834780 1 < canceled multipart upload key=VEJ6D2J3LZI8 upload=R5927311JZ0T tag=S5FOKA9T3TZK type=write size=3794298 2024-02-23T06:34:27.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.486+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=FFUIZ2QZJU0Z type=del size=4160879 2024-02-23T06:34:27.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.487+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=G7B0DD944QL0 type=del 2024-02-23T06:34:27.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.488+0000 7f5e72834780 1 > prepared operation key=0WLEPDK2O30W tag=7DEWR4FHN9XL type=del size=3289163 2024-02-23T06:34:27.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.490+0000 7f5e72834780 1 < suggested remove operation key=GACVVXC2Z1YO tag=IVTRR5KWT73K type=del 2024-02-23T06:34:27.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.492+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~OEWYU4VWFG90.0 size=1048576 2024-02-23T06:34:27.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.493+0000 7f5e72834780 1 > prepared part key=_multipart_R4YA9DUAJABL.2~OEWYU4VWFG90.1 size=375929 2024-02-23T06:34:27.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.493+0000 7f5e72834780 1 > prepared multipart upload key=R4YA9DUAJABL upload=OEWYU4VWFG90 tag=3P52Q2J6X2AQ type=write size=2473081 2024-02-23T06:34:27.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.494+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=NFMF95D66DQS type=del 2024-02-23T06:34:27.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.495+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=GX610EYZHHVE type=write size=671021 2024-02-23T06:34:27.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.496+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~P7LHCWVZNIF6.0 size=1048576 2024-02-23T06:34:27.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.496+0000 7f5e72834780 1 < canceled part key=_multipart_26EE3EHDK8EM.2~P7LHCWVZNIF6.1 size=299387 2024-02-23T06:34:27.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.498+0000 7f5e72834780 1 < canceled multipart upload key=26EE3EHDK8EM upload=P7LHCWVZNIF6 tag=12RH0HW88SR5 type=write size=2396539 2024-02-23T06:34:27.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.499+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=IWM5HUZLQ53F type=del size=495405 2024-02-23T06:34:27.501 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.500+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~F3PFMS89GQLS.0 size=1048576 2024-02-23T06:34:27.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.501+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~F3PFMS89GQLS.1 size=1048576 2024-02-23T06:34:27.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.502+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~F3PFMS89GQLS.2 size=295300 2024-02-23T06:34:27.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.503+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=F3PFMS89GQLS tag=KF3KLT8JDZ4O type=write size=3441028 2024-02-23T06:34:27.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.505+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=P7F0IMMVTM2Z type=write size=61501 2024-02-23T06:34:27.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.506+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=YKD7UQHG4JX3 type=del 2024-02-23T06:34:27.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.507+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=IIZW637NJVM8 type=del size=3711794 2024-02-23T06:34:27.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.508+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NT09ORFPFGF0.0 size=1048576 2024-02-23T06:34:27.510 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.509+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~NT09ORFPFGF0.1 size=335860 2024-02-23T06:34:27.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.511+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=NT09ORFPFGF0 tag=MYHJ0KTCJ84V type=write size=2433012 2024-02-23T06:34:27.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.513+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~5P7SRXEIZUHK.0 size=1048576 2024-02-23T06:34:27.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.514+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~5P7SRXEIZUHK.1 size=615733 2024-02-23T06:34:27.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.514+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=5P7SRXEIZUHK tag=ZL2OF403QGJY type=write size=2712885 2024-02-23T06:34:27.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.515+0000 7f5e72834780 1 < completed write operation key=M5LH10WTDP0P tag=2JRW6OB6DGPI type=write size=132165 2024-02-23T06:34:27.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.517+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~VFIWT0LIU6JX.0 size=637198 2024-02-23T06:34:27.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.517+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=VFIWT0LIU6JX tag=ZT94HWUFFIDZ type=write size=1685774 2024-02-23T06:34:27.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.518+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~6S4HADXJDPDO.0 size=1048576 2024-02-23T06:34:27.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.519+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~6S4HADXJDPDO.1 size=751855 2024-02-23T06:34:27.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.521+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=6S4HADXJDPDO tag=9SJ4OLIUJX53 type=write size=2849007 2024-02-23T06:34:27.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.523+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=TPY5XODID4Q7 type=del size=1570970 2024-02-23T06:34:27.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.524+0000 7f5e72834780 1 < completed part key=_multipart_TNH85ZWPALJN.2~0KCW7UTAB1HR.0 size=53574 2024-02-23T06:34:27.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.526+0000 7f5e72834780 1 < completed multipart upload key=TNH85ZWPALJN upload=0KCW7UTAB1HR tag=CA2CLIBMHFCY type=write size=1102150 2024-02-23T06:34:27.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.527+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=PJTURGTSOYTQ type=write size=211623 2024-02-23T06:34:27.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.528+0000 7f5e72834780 1 < completed part key=_multipart_VER8U5YMTPS6.2~77PIQTWLUPZK.0 size=340642 2024-02-23T06:34:27.531 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.530+0000 7f5e72834780 1 < completed multipart upload key=VER8U5YMTPS6 upload=77PIQTWLUPZK tag=4Q58EKI6RGHF type=write size=1389218 2024-02-23T06:34:27.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.532+0000 7f5e72834780 1 > prepared part key=_multipart_N8RXOY8X71MO.2~N152A18Y28YJ.0 size=469803 2024-02-23T06:34:27.533 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.532+0000 7f5e72834780 1 > prepared multipart upload key=N8RXOY8X71MO upload=N152A18Y28YJ tag=7PYE499Z40QW type=write size=1518379 2024-02-23T06:34:27.534 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.533+0000 7f5e72834780 1 < completed delete operation key=IDTA5RV6IUF6 tag=11WMV6DPB392 type=del 2024-02-23T06:34:27.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.535+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~6RTV8CZND7M8.0 size=1048576 2024-02-23T06:34:27.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.536+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~6RTV8CZND7M8.1 size=1048576 2024-02-23T06:34:27.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.537+0000 7f5e72834780 1 > prepared part key=_multipart_JV6FJONY04AW.2~6RTV8CZND7M8.2 size=955390 2024-02-23T06:34:27.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.537+0000 7f5e72834780 1 > prepared multipart upload key=JV6FJONY04AW upload=6RTV8CZND7M8 tag=XS0XTQ3YD1WJ type=write size=4101118 2024-02-23T06:34:27.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.539+0000 7f5e72834780 1 < completed write operation key=TNH85ZWPALJN tag=4L1PT29RSJ51 type=write size=771033 2024-02-23T06:34:27.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.541+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~AP1SCOGRBOY9.0 size=1048576 2024-02-23T06:34:27.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.542+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~AP1SCOGRBOY9.1 size=1048576 2024-02-23T06:34:27.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.543+0000 7f5e72834780 1 > prepared part key=_multipart_RS03NUABC1U2.2~AP1SCOGRBOY9.2 size=528599 2024-02-23T06:34:27.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.543+0000 7f5e72834780 1 > prepared multipart upload key=RS03NUABC1U2 upload=AP1SCOGRBOY9 tag=QZ0UOOTKNSGI type=write size=3674327 2024-02-23T06:34:27.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.544+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~VASPDN43XL7G.0 size=1048576 2024-02-23T06:34:27.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.544+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~VASPDN43XL7G.1 size=1048576 2024-02-23T06:34:27.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.544+0000 7f5e72834780 1 < canceled part key=_multipart_ZC75CQ2789VE.2~VASPDN43XL7G.2 size=335219 2024-02-23T06:34:27.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.547+0000 7f5e72834780 1 < canceled multipart upload key=ZC75CQ2789VE upload=VASPDN43XL7G tag=KGYN9OB2PIPO type=write size=3480947 2024-02-23T06:34:27.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.548+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=J4TSEAYDP2CW type=del size=285088 2024-02-23T06:34:27.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.549+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~6DBENUNHR447.0 size=1048576 2024-02-23T06:34:27.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.551+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~6DBENUNHR447.1 size=843082 2024-02-23T06:34:27.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.552+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=6DBENUNHR447 tag=VJ8QKTZD6BR8 type=write size=2940234 2024-02-23T06:34:27.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.554+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=2PO6WNJ1BDW4 type=del size=1042652 2024-02-23T06:34:27.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.555+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=FFUIZ2QZJU0Z type=del 2024-02-23T06:34:27.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.556+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=R3DZ6B44FHQ6 type=del size=541808 2024-02-23T06:34:27.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.557+0000 7f5e72834780 1 < completed delete operation key=0WLEPDK2O30W tag=7DEWR4FHN9XL type=del 2024-02-23T06:34:27.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.559+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=OO0YSRLFP5PZ type=del size=201247 2024-02-23T06:34:27.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.560+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~OEWYU4VWFG90.0 size=1048576 2024-02-23T06:34:27.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.561+0000 7f5e72834780 1 < completed part key=_multipart_R4YA9DUAJABL.2~OEWYU4VWFG90.1 size=375929 2024-02-23T06:34:27.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.563+0000 7f5e72834780 1 < completed multipart upload key=R4YA9DUAJABL upload=OEWYU4VWFG90 tag=3P52Q2J6X2AQ type=write size=2473081 2024-02-23T06:34:27.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.565+0000 7f5e72834780 1 > prepared part key=_multipart_ZM1YKZOUFSCY.2~5EFHCE86V7IA.0 size=554962 2024-02-23T06:34:27.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.565+0000 7f5e72834780 1 > prepared multipart upload key=ZM1YKZOUFSCY upload=5EFHCE86V7IA tag=0OIXTYVSJA4Q type=write size=1603538 2024-02-23T06:34:27.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.566+0000 7f5e72834780 1 < completed write operation key=QZLNM2RQ9SDC tag=GX610EYZHHVE type=write size=671021 2024-02-23T06:34:27.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.567+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=JXV5257EL77D type=del size=494169 2024-02-23T06:34:27.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.568+0000 7f5e72834780 1 < completed delete operation key=9AQCXLBZW3EV tag=IWM5HUZLQ53F type=del 2024-02-23T06:34:27.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.570+0000 7f5e72834780 1 > prepared part key=_multipart_721UW0AGSKVR.2~OZ8E3M1ISILJ.0 size=933217 2024-02-23T06:34:27.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.570+0000 7f5e72834780 1 > prepared multipart upload key=721UW0AGSKVR upload=OZ8E3M1ISILJ tag=0QOLYWZORDAM type=write size=1981793 2024-02-23T06:34:27.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.571+0000 7f5e72834780 1 < completed write operation key=9ZCNDGBEPWMN tag=P7F0IMMVTM2Z type=write size=61501 2024-02-23T06:34:27.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.573+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~25UUULF9IU8G.0 size=1048576 2024-02-23T06:34:27.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.574+0000 7f5e72834780 1 > prepared part key=_multipart_M5LH10WTDP0P.2~25UUULF9IU8G.1 size=358726 2024-02-23T06:34:27.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.574+0000 7f5e72834780 1 > prepared multipart upload key=M5LH10WTDP0P upload=25UUULF9IU8G tag=P622TORBUKZ1 type=write size=2455878 2024-02-23T06:34:27.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.575+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=IIZW637NJVM8 type=del 2024-02-23T06:34:27.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.577+0000 7f5e72834780 1 > prepared operation key=QZLNM2RQ9SDC tag=PGIJZHF5ZDNF type=del size=3417983 2024-02-23T06:34:27.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.578+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~5P7SRXEIZUHK.0 size=1048576 2024-02-23T06:34:27.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.579+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~5P7SRXEIZUHK.1 size=615733 2024-02-23T06:34:27.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.581+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=5P7SRXEIZUHK tag=ZL2OF403QGJY type=write size=2712885 2024-02-23T06:34:27.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.583+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~SK1DEUXSHCV6.0 size=1048576 2024-02-23T06:34:27.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.584+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~SK1DEUXSHCV6.1 size=1048576 2024-02-23T06:34:27.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.585+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~SK1DEUXSHCV6.2 size=795685 2024-02-23T06:34:27.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.585+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=SK1DEUXSHCV6 tag=07MQG8DQABXF type=write size=3941413 2024-02-23T06:34:27.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.586+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~VFIWT0LIU6JX.0 size=637198 2024-02-23T06:34:27.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.588+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=VFIWT0LIU6JX tag=ZT94HWUFFIDZ type=write size=1685774 2024-02-23T06:34:27.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.589+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=FFN20NIIBNWQ type=del size=445940 2024-02-23T06:34:27.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.590+0000 7f5e72834780 1 < completed delete operation key=03P6IEKSHB17 tag=TPY5XODID4Q7 type=del 2024-02-23T06:34:27.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.592+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=QALMR67WZC97 type=write size=162841 2024-02-23T06:34:27.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.595+0000 7f5e72834780 1 < suggested remove operation key=JV6FJONY04AW tag=PJTURGTSOYTQ type=write 2024-02-23T06:34:27.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.597+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~7J89DK0OGM1Q.0 size=94265 2024-02-23T06:34:27.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.597+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=7J89DK0OGM1Q tag=FE0NGW0Z0ZRN type=write size=1142841 2024-02-23T06:34:27.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.598+0000 7f5e72834780 1 < completed part key=_multipart_N8RXOY8X71MO.2~N152A18Y28YJ.0 size=469803 2024-02-23T06:34:27.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.600+0000 7f5e72834780 1 < completed multipart upload key=N8RXOY8X71MO upload=N152A18Y28YJ tag=7PYE499Z40QW type=write size=1518379 2024-02-23T06:34:27.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.601+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~Z72I9P2RI4N3.0 size=1048576 2024-02-23T06:34:27.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.602+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~Z72I9P2RI4N3.1 size=78239 2024-02-23T06:34:27.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.602+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=Z72I9P2RI4N3 tag=FN7WT29NJUHP type=write size=2175391 2024-02-23T06:34:27.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.604+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~6RTV8CZND7M8.0 size=1048576 2024-02-23T06:34:27.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.605+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~6RTV8CZND7M8.1 size=1048576 2024-02-23T06:34:27.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.606+0000 7f5e72834780 1 < completed part key=_multipart_JV6FJONY04AW.2~6RTV8CZND7M8.2 size=955390 2024-02-23T06:34:27.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.609+0000 7f5e72834780 1 < completed multipart upload key=JV6FJONY04AW upload=6RTV8CZND7M8 tag=XS0XTQ3YD1WJ type=write size=4101118 2024-02-23T06:34:27.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.612+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~1E3WRLNJTIPA.0 size=1048576 2024-02-23T06:34:27.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.613+0000 7f5e72834780 1 > prepared part key=_multipart_GW6EKQ84FQ6L.2~1E3WRLNJTIPA.1 size=651220 2024-02-23T06:34:27.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.613+0000 7f5e72834780 1 > prepared multipart upload key=GW6EKQ84FQ6L upload=1E3WRLNJTIPA tag=EPFR55LWGD4G type=write size=2748372 2024-02-23T06:34:27.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.614+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~AP1SCOGRBOY9.0 size=1048576 2024-02-23T06:34:27.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.615+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~AP1SCOGRBOY9.1 size=1048576 2024-02-23T06:34:27.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.616+0000 7f5e72834780 1 < completed part key=_multipart_RS03NUABC1U2.2~AP1SCOGRBOY9.2 size=528599 2024-02-23T06:34:27.619 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.618+0000 7f5e72834780 1 < completed multipart upload key=RS03NUABC1U2 upload=AP1SCOGRBOY9 tag=QZ0UOOTKNSGI type=write size=3674327 2024-02-23T06:34:27.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.620+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=1S9IDY66QV32 type=del size=3808390 2024-02-23T06:34:27.622 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.621+0000 7f5e72834780 1 < completed delete operation key=GW6EKQ84FQ6L tag=J4TSEAYDP2CW type=del 2024-02-23T06:34:27.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.623+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~3KC5P6FPNZVG.0 size=808256 2024-02-23T06:34:27.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.623+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=3KC5P6FPNZVG tag=J00BYC27VIYX type=write size=1856832 2024-02-23T06:34:27.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.624+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=2PO6WNJ1BDW4 type=del 2024-02-23T06:34:27.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.626+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~BQZGHVOMCKN6.0 size=1048576 2024-02-23T06:34:27.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.627+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~BQZGHVOMCKN6.1 size=1048576 2024-02-23T06:34:27.629 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.628+0000 7f5e72834780 1 > prepared part key=_multipart_9AQCXLBZW3EV.2~BQZGHVOMCKN6.2 size=884048 2024-02-23T06:34:27.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.628+0000 7f5e72834780 1 > prepared multipart upload key=9AQCXLBZW3EV upload=BQZGHVOMCKN6 tag=5DO9P8GIHI02 type=write size=4029776 2024-02-23T06:34:27.632 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.631+0000 7f5e72834780 1 < suggested update operation key=QZLNM2RQ9SDC tag=R3DZ6B44FHQ6 type=del size=541808 2024-02-23T06:34:27.633 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.632+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=RIIUG4O3JL3Z type=del size=2700424 2024-02-23T06:34:27.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.633+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=OO0YSRLFP5PZ type=del 2024-02-23T06:34:27.636 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.635+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~JEDUWUC05AT8.0 size=1048576 2024-02-23T06:34:27.637 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.636+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~JEDUWUC05AT8.1 size=1048576 2024-02-23T06:34:27.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.637+0000 7f5e72834780 1 > prepared part key=_multipart_7N8OH7EETRN8.2~JEDUWUC05AT8.2 size=490771 2024-02-23T06:34:27.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.637+0000 7f5e72834780 1 > prepared multipart upload key=7N8OH7EETRN8 upload=JEDUWUC05AT8 tag=TLZE3MQQH4RU type=write size=3636499 2024-02-23T06:34:27.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.638+0000 7f5e72834780 1 < completed part key=_multipart_ZM1YKZOUFSCY.2~5EFHCE86V7IA.0 size=554962 2024-02-23T06:34:27.641 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.640+0000 7f5e72834780 1 < completed multipart upload key=ZM1YKZOUFSCY upload=5EFHCE86V7IA tag=0OIXTYVSJA4Q type=write size=1603538 2024-02-23T06:34:27.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.642+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=9K1I7FDKFTWK type=del size=3043392 2024-02-23T06:34:27.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.643+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=JXV5257EL77D type=del 2024-02-23T06:34:27.646 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.645+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~ZYJ2AF2WTW43.0 size=1048576 2024-02-23T06:34:27.647 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.646+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~ZYJ2AF2WTW43.1 size=1048576 2024-02-23T06:34:27.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.647+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~ZYJ2AF2WTW43.2 size=700024 2024-02-23T06:34:27.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.647+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=ZYJ2AF2WTW43 tag=T3A79YLJI1PG type=write size=3845752 2024-02-23T06:34:27.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.648+0000 7f5e72834780 1 < completed part key=_multipart_721UW0AGSKVR.2~OZ8E3M1ISILJ.0 size=933217 2024-02-23T06:34:27.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.650+0000 7f5e72834780 1 < completed multipart upload key=721UW0AGSKVR upload=OZ8E3M1ISILJ tag=0QOLYWZORDAM type=write size=1981793 2024-02-23T06:34:27.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.651+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=UE7J5KGGCSGD type=del size=1270581 2024-02-23T06:34:27.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.652+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~25UUULF9IU8G.0 size=1048576 2024-02-23T06:34:27.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.653+0000 7f5e72834780 1 < completed part key=_multipart_M5LH10WTDP0P.2~25UUULF9IU8G.1 size=358726 2024-02-23T06:34:27.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.655+0000 7f5e72834780 1 < completed multipart upload key=M5LH10WTDP0P upload=25UUULF9IU8G tag=P622TORBUKZ1 type=write size=2455878 2024-02-23T06:34:27.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.656+0000 7f5e72834780 1 > prepared operation key=N8RXOY8X71MO tag=TYB7GFJPENWF type=del size=3471241 2024-02-23T06:34:27.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.657+0000 7f5e72834780 -1 < failed to complete operation key=QZLNM2RQ9SDC tag=PGIJZHF5ZDNF type=del size=3417983: (22) Invalid argument 2024-02-23T06:34:27.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.659+0000 7f5e72834780 1 > prepared operation key=TNH85ZWPALJN tag=ER6HQMLVNSLV type=del size=3403015 2024-02-23T06:34:27.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.660+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~SK1DEUXSHCV6.0 size=1048576 2024-02-23T06:34:27.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.661+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~SK1DEUXSHCV6.1 size=1048576 2024-02-23T06:34:27.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.661+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~SK1DEUXSHCV6.2 size=795685 2024-02-23T06:34:27.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.663+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=SK1DEUXSHCV6 tag=07MQG8DQABXF type=write size=3941413 2024-02-23T06:34:27.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.665+0000 7f5e72834780 1 > prepared operation key=R3STDBS79MV0 tag=QP41SBXQPIT0 type=del size=66399 2024-02-23T06:34:27.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.666+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=FFN20NIIBNWQ type=del 2024-02-23T06:34:27.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.668+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~HWF5UVQ2LAWQ.0 size=1048576 2024-02-23T06:34:27.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.669+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~HWF5UVQ2LAWQ.1 size=1048576 2024-02-23T06:34:27.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.670+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~HWF5UVQ2LAWQ.2 size=856821 2024-02-23T06:34:27.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.670+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=HWF5UVQ2LAWQ tag=0EVEKEQRVXHP type=write size=4002549 2024-02-23T06:34:27.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.673+0000 7f5e72834780 1 < suggested remove operation key=IDTA5RV6IUF6 tag=QALMR67WZC97 type=write 2024-02-23T06:34:27.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.674+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=QPOI1VYC65CI type=del size=1626657 2024-02-23T06:34:27.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.675+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~7J89DK0OGM1Q.0 size=94265 2024-02-23T06:34:27.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.677+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=7J89DK0OGM1Q tag=FE0NGW0Z0ZRN type=write size=1142841 2024-02-23T06:34:27.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.678+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=48173GY7QIT3 type=del size=3956800 2024-02-23T06:34:27.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.679+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~Z72I9P2RI4N3.0 size=1048576 2024-02-23T06:34:27.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.679+0000 7f5e72834780 1 < canceled part key=_multipart_IDTA5RV6IUF6.2~Z72I9P2RI4N3.1 size=78239 2024-02-23T06:34:27.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.681+0000 7f5e72834780 1 < canceled multipart upload key=IDTA5RV6IUF6 upload=Z72I9P2RI4N3 tag=FN7WT29NJUHP type=write size=2175391 2024-02-23T06:34:27.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.682+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=N9W8Q46QA5PB type=del size=3165539 2024-02-23T06:34:27.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.684+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~1E3WRLNJTIPA.0 size=1048576 2024-02-23T06:34:27.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.684+0000 7f5e72834780 1 < completed part key=_multipart_GW6EKQ84FQ6L.2~1E3WRLNJTIPA.1 size=651220 2024-02-23T06:34:27.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.686+0000 7f5e72834780 1 < completed multipart upload key=GW6EKQ84FQ6L upload=1E3WRLNJTIPA tag=EPFR55LWGD4G type=write size=2748372 2024-02-23T06:34:27.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.687+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=KZC21V5GFK12 type=write size=5106 2024-02-23T06:34:27.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.688+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=1S9IDY66QV32 type=del 2024-02-23T06:34:27.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.690+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=1XL2905BF4M4 type=del size=1351410 2024-02-23T06:34:27.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.691+0000 7f5e72834780 1 < completed part key=_multipart_VEJ6D2J3LZI8.2~3KC5P6FPNZVG.0 size=808256 2024-02-23T06:34:27.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.693+0000 7f5e72834780 1 < completed multipart upload key=VEJ6D2J3LZI8 upload=3KC5P6FPNZVG tag=J00BYC27VIYX type=write size=1856832 2024-02-23T06:34:27.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.694+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=EY1ETE03A1L6 type=del size=3643934 2024-02-23T06:34:27.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.695+0000 7f5e72834780 1 < canceled part key=_multipart_9AQCXLBZW3EV.2~BQZGHVOMCKN6.0 size=1048576 2024-02-23T06:34:27.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.696+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~BQZGHVOMCKN6.1 size=1048576 2024-02-23T06:34:27.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.697+0000 7f5e72834780 1 < completed part key=_multipart_9AQCXLBZW3EV.2~BQZGHVOMCKN6.2 size=884048 2024-02-23T06:34:27.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.699+0000 7f5e72834780 1 < canceled multipart upload key=9AQCXLBZW3EV upload=BQZGHVOMCKN6 tag=5DO9P8GIHI02 type=write size=4029776 2024-02-23T06:34:27.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.700+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=X7I3BD2UFO79 type=del size=1468461 2024-02-23T06:34:27.703 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.702+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=RIIUG4O3JL3Z type=del 2024-02-23T06:34:27.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.704+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=BJA9AIOJLRBK type=del size=2577190 2024-02-23T06:34:27.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.705+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~JEDUWUC05AT8.0 size=1048576 2024-02-23T06:34:27.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.706+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~JEDUWUC05AT8.1 size=1048576 2024-02-23T06:34:27.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.707+0000 7f5e72834780 1 < completed part key=_multipart_7N8OH7EETRN8.2~JEDUWUC05AT8.2 size=490771 2024-02-23T06:34:27.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.709+0000 7f5e72834780 1 < completed multipart upload key=7N8OH7EETRN8 upload=JEDUWUC05AT8 tag=TLZE3MQQH4RU type=write size=3636499 2024-02-23T06:34:27.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.711+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~GCMPDG2OFE4B.0 size=803133 2024-02-23T06:34:27.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.711+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=GCMPDG2OFE4B tag=74ILVNKM79WF type=write size=1851709 2024-02-23T06:34:27.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.712+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=9K1I7FDKFTWK type=del 2024-02-23T06:34:27.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.713+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=L6T9TC33SWTC type=del size=2045306 2024-02-23T06:34:27.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.715+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~ZYJ2AF2WTW43.0 size=1048576 2024-02-23T06:34:27.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.716+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~ZYJ2AF2WTW43.1 size=1048576 2024-02-23T06:34:27.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.716+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~ZYJ2AF2WTW43.2 size=700024 2024-02-23T06:34:27.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.718+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=ZYJ2AF2WTW43 tag=T3A79YLJI1PG type=write size=3845752 2024-02-23T06:34:27.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.719+0000 7f5e72834780 1 > prepared operation key=WK98HMHAZIUB tag=VEJWFP7BAL5W type=write size=128865 2024-02-23T06:34:27.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.721+0000 7f5e72834780 1 < completed delete operation key=883VBT1ADE6K tag=UE7J5KGGCSGD type=del 2024-02-23T06:34:27.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.722+0000 7f5e72834780 1 > prepared operation key=TPADM4812N0Z tag=4L6FKDXR98NA type=del size=684787 2024-02-23T06:34:27.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.723+0000 7f5e72834780 1 < completed delete operation key=N8RXOY8X71MO tag=TYB7GFJPENWF type=del 2024-02-23T06:34:27.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.724+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=LF7OQ4Q8AHOU type=del size=3616250 2024-02-23T06:34:27.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.725+0000 7f5e72834780 1 < completed delete operation key=TNH85ZWPALJN tag=ER6HQMLVNSLV type=del 2024-02-23T06:34:27.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.727+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~4P2GMG8LH7IF.0 size=865936 2024-02-23T06:34:27.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.727+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=4P2GMG8LH7IF tag=N0UFFH6EENG3 type=write size=1914512 2024-02-23T06:34:27.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.728+0000 7f5e72834780 1 < completed delete operation key=R3STDBS79MV0 tag=QP41SBXQPIT0 type=del 2024-02-23T06:34:27.731 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.730+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=BB431C8BQ3WK type=write size=1018393 2024-02-23T06:34:27.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.731+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~HWF5UVQ2LAWQ.0 size=1048576 2024-02-23T06:34:27.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.732+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~HWF5UVQ2LAWQ.1 size=1048576 2024-02-23T06:34:27.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.732+0000 7f5e72834780 1 < canceled part key=_multipart_IDTA5RV6IUF6.2~HWF5UVQ2LAWQ.2 size=856821 2024-02-23T06:34:27.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.734+0000 7f5e72834780 1 < canceled multipart upload key=IDTA5RV6IUF6 upload=HWF5UVQ2LAWQ tag=0EVEKEQRVXHP type=write size=4002549 2024-02-23T06:34:27.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.735+0000 7f5e72834780 1 > prepared operation key=LUERFL6AN6HF tag=97PYB2T33COT type=del size=2685368 2024-02-23T06:34:27.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.736+0000 7f5e72834780 1 < completed delete operation key=WK98HMHAZIUB tag=QPOI1VYC65CI type=del 2024-02-23T06:34:27.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.738+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GR4JCHFV6972.0 size=1048576 2024-02-23T06:34:27.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.739+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GR4JCHFV6972.1 size=1048576 2024-02-23T06:34:27.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.740+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~GR4JCHFV6972.2 size=302833 2024-02-23T06:34:27.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.740+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=GR4JCHFV6972 tag=YGAVDQHMZ7G5 type=write size=3448561 2024-02-23T06:34:27.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.742+0000 7f5e72834780 1 < completed delete operation key=R4YA9DUAJABL tag=48173GY7QIT3 type=del 2024-02-23T06:34:27.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.743+0000 7f5e72834780 1 > prepared operation key=GWTK3YV0RY21 tag=V4VABDYLYODI type=del size=1611274 2024-02-23T06:34:27.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.744+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=N9W8Q46QA5PB type=del 2024-02-23T06:34:27.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.746+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~P0FETEROYSB7.0 size=1048576 2024-02-23T06:34:27.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.747+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~P0FETEROYSB7.1 size=1048576 2024-02-23T06:34:27.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.748+0000 7f5e72834780 1 > prepared part key=_multipart_ZC75CQ2789VE.2~P0FETEROYSB7.2 size=518288 2024-02-23T06:34:27.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.748+0000 7f5e72834780 1 > prepared multipart upload key=ZC75CQ2789VE upload=P0FETEROYSB7 tag=AMN4CENP1FN0 type=write size=3664016 2024-02-23T06:34:27.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.749+0000 7f5e72834780 1 < completed write operation key=QGGULCYZ0ZSA tag=KZC21V5GFK12 type=write size=5106 2024-02-23T06:34:27.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.750+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=MQ0617LWVFRX type=del size=968941 2024-02-23T06:34:27.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.752+0000 7f5e72834780 1 < canceled operation key=JV6FJONY04AW tag=1XL2905BF4M4 type=del size=1351410 2024-02-23T06:34:27.755 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.754+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~KPHOYAGOOEWB.0 size=1048576 2024-02-23T06:34:27.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.755+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~KPHOYAGOOEWB.1 size=281534 2024-02-23T06:34:27.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.755+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=KPHOYAGOOEWB tag=DV1BL3XAHRLU type=write size=2378686 2024-02-23T06:34:27.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.756+0000 7f5e72834780 1 < canceled operation key=8Q6WC7B9BY5Q tag=EY1ETE03A1L6 type=del size=3643934 2024-02-23T06:34:27.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.757+0000 7f5e72834780 1 > prepared operation key=RS03NUABC1U2 tag=UQXOG2GC1TUX type=write size=660292 2024-02-23T06:34:27.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.758+0000 7f5e72834780 1 < completed delete operation key=ZC75CQ2789VE tag=X7I3BD2UFO79 type=del 2024-02-23T06:34:27.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.759+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=HWZ49UCWOMM0 type=del size=2153167 2024-02-23T06:34:27.763 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.761+0000 7f5e72834780 1 < suggested update operation key=03P6IEKSHB17 tag=BJA9AIOJLRBK type=del size=2577190 2024-02-23T06:34:27.765 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.764+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~G9ZBZ2I58ZZ1.0 size=1048576 2024-02-23T06:34:27.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.764+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~G9ZBZ2I58ZZ1.1 size=1048576 2024-02-23T06:34:27.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.765+0000 7f5e72834780 1 > prepared part key=_multipart_IDTA5RV6IUF6.2~G9ZBZ2I58ZZ1.2 size=858667 2024-02-23T06:34:27.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.765+0000 7f5e72834780 1 > prepared multipart upload key=IDTA5RV6IUF6 upload=G9ZBZ2I58ZZ1 tag=78Z7W1ZURIG9 type=write size=4004395 2024-02-23T06:34:27.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.766+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~GCMPDG2OFE4B.0 size=803133 2024-02-23T06:34:27.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.768+0000 7f5e72834780 1 < completed multipart upload key=LUERFL6AN6HF upload=GCMPDG2OFE4B tag=74ILVNKM79WF type=write size=1851709 2024-02-23T06:34:27.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.770+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=G1QJCG0GHF4X type=del size=2830078 2024-02-23T06:34:27.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.772+0000 7f5e72834780 1 < suggested remove operation key=ZM1YKZOUFSCY tag=L6T9TC33SWTC type=del 2024-02-23T06:34:27.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.774+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~80GEKFXI2YMF.0 size=1048576 2024-02-23T06:34:27.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.775+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~80GEKFXI2YMF.1 size=1048576 2024-02-23T06:34:27.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.776+0000 7f5e72834780 1 > prepared part key=_multipart_WETP4ONTU3HL.2~80GEKFXI2YMF.2 size=1008934 2024-02-23T06:34:27.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.776+0000 7f5e72834780 1 > prepared multipart upload key=WETP4ONTU3HL upload=80GEKFXI2YMF tag=0CHSWVOOCQME type=write size=4154662 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.777+0000 7f5e72834780 1 < completed write operation key=WK98HMHAZIUB tag=VEJWFP7BAL5W type=write size=128865 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.779+0000 7f5e72834780 1 > prepared operation key=ZC75CQ2789VE tag=T9N3L2HP1DEX type=write size=181145 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.780+0000 7f5e72834780 1 < completed delete operation key=TPADM4812N0Z tag=4L6FKDXR98NA type=del 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.782+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~GSEZO4KSE3MC.0 size=1048576 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.783+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~GSEZO4KSE3MC.1 size=1048576 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.784+0000 7f5e72834780 1 > prepared part key=_multipart_TPADM4812N0Z.2~GSEZO4KSE3MC.2 size=497523 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.784+0000 7f5e72834780 1 > prepared multipart upload key=TPADM4812N0Z upload=GSEZO4KSE3MC tag=SQF7HJS1O74F type=write size=3643251 2024-02-23T06:34:27.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.785+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=LF7OQ4Q8AHOU type=del 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.787+0000 7f5e72834780 1 > prepared operation key=QGGULCYZ0ZSA tag=VB66AW0Q9BRG type=write size=615703 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.788+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~4P2GMG8LH7IF.0 size=865936 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.790+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=4P2GMG8LH7IF tag=N0UFFH6EENG3 type=write size=1914512 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.791+0000 7f5e72834780 1 > prepared operation key=ZM1YKZOUFSCY tag=OB2YMY2LO4O7 type=del size=3101186 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.794+0000 7f5e72834780 1 < completed write operation key=VER8U5YMTPS6 tag=BB431C8BQ3WK type=write size=1018393 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.796+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~4KR91Z03I2JL.0 size=1048576 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.797+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~4KR91Z03I2JL.1 size=1048576 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.798+0000 7f5e72834780 1 > prepared part key=_multipart_0WLEPDK2O30W.2~4KR91Z03I2JL.2 size=788400 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.798+0000 7f5e72834780 1 > prepared multipart upload key=0WLEPDK2O30W upload=4KR91Z03I2JL tag=SX17CLWK1G5S type=write size=3934128 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.799+0000 7f5e72834780 1 < completed delete operation key=LUERFL6AN6HF tag=97PYB2T33COT type=del 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.800+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=H04K093DMF9K type=del size=2325048 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.801+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GR4JCHFV6972.0 size=1048576 2024-02-23T06:34:27.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.802+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GR4JCHFV6972.1 size=1048576 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.803+0000 7f5e72834780 1 < completed part key=_multipart_26EE3EHDK8EM.2~GR4JCHFV6972.2 size=302833 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.805+0000 7f5e72834780 1 < completed multipart upload key=26EE3EHDK8EM upload=GR4JCHFV6972 tag=YGAVDQHMZ7G5 type=write size=3448561 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.807+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=M2JUCN1MK8JI type=del size=1261418 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.808+0000 7f5e72834780 1 < completed delete operation key=GWTK3YV0RY21 tag=V4VABDYLYODI type=del 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.809+0000 7f5e72834780 1 > prepared operation key=MB8BZ2BXZE9M tag=Q4NJY5DFEN09 type=del size=1159623 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.810+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~P0FETEROYSB7.0 size=1048576 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.811+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~P0FETEROYSB7.1 size=1048576 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.812+0000 7f5e72834780 1 < completed part key=_multipart_ZC75CQ2789VE.2~P0FETEROYSB7.2 size=518288 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.817+0000 7f5e72834780 1 < completed multipart upload key=ZC75CQ2789VE upload=P0FETEROYSB7 tag=AMN4CENP1FN0 type=write size=3664016 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.818+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=8FXSE8FD424T type=del size=1372596 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.822+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=MQ0617LWVFRX type=del 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.823+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=92IUOH796IHC type=write size=185582 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.825+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~KPHOYAGOOEWB.0 size=1048576 2024-02-23T06:34:27.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.826+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~KPHOYAGOOEWB.1 size=281534 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.828+0000 7f5e72834780 1 < completed multipart upload key=TPADM4812N0Z upload=KPHOYAGOOEWB tag=DV1BL3XAHRLU type=write size=2378686 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.829+0000 7f5e72834780 1 > prepared operation key=VEJ6D2J3LZI8 tag=CV977EBMD9TW type=write size=287707 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.830+0000 7f5e72834780 1 < completed write operation key=RS03NUABC1U2 tag=UQXOG2GC1TUX type=write size=660292 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.831+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=1K9YZ8Y43WFU type=del size=2231376 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.833+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=HWZ49UCWOMM0 type=del 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.835+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~N1EY4ENUW1P2.0 size=1048576 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.836+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~N1EY4ENUW1P2.1 size=1034357 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.836+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=N1EY4ENUW1P2 tag=LFF05TV4B4JS type=write size=3131509 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.837+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~G9ZBZ2I58ZZ1.0 size=1048576 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.838+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~G9ZBZ2I58ZZ1.1 size=1048576 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.839+0000 7f5e72834780 1 < completed part key=_multipart_IDTA5RV6IUF6.2~G9ZBZ2I58ZZ1.2 size=858667 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.841+0000 7f5e72834780 1 < completed multipart upload key=IDTA5RV6IUF6 upload=G9ZBZ2I58ZZ1 tag=78Z7W1ZURIG9 type=write size=4004395 2024-02-23T06:34:27.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.842+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=Z3G70HWNVWZ1 type=write size=382036 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.843+0000 7f5e72834780 1 < completed delete operation key=M5LH10WTDP0P tag=G1QJCG0GHF4X type=del 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.846+0000 7f5e72834780 1 > prepared part key=_multipart_4M7BT05YB0C3.2~SYB15Q8LZLR9.0 size=606455 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.846+0000 7f5e72834780 1 > prepared multipart upload key=4M7BT05YB0C3 upload=SYB15Q8LZLR9 tag=ZOM50DRMUERZ type=write size=1655031 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.847+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~80GEKFXI2YMF.0 size=1048576 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.848+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~80GEKFXI2YMF.1 size=1048576 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.849+0000 7f5e72834780 1 < completed part key=_multipart_WETP4ONTU3HL.2~80GEKFXI2YMF.2 size=1008934 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.851+0000 7f5e72834780 1 < completed multipart upload key=WETP4ONTU3HL upload=80GEKFXI2YMF tag=0CHSWVOOCQME type=write size=4154662 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.853+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~4U1YPJ3JU86V.0 size=1048576 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.854+0000 7f5e72834780 1 > prepared part key=_multipart_LUERFL6AN6HF.2~4U1YPJ3JU86V.1 size=91953 2024-02-23T06:34:27.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.854+0000 7f5e72834780 1 > prepared multipart upload key=LUERFL6AN6HF upload=4U1YPJ3JU86V tag=0PKPJJFNT8UZ type=write size=2189105 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.855+0000 7f5e72834780 1 < completed write operation key=ZC75CQ2789VE tag=T9N3L2HP1DEX type=write size=181145 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.856+0000 7f5e72834780 1 > prepared operation key=9ZCNDGBEPWMN tag=RU6GIS5ILT9R type=del size=2399663 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.858+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~GSEZO4KSE3MC.0 size=1048576 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.858+0000 7f5e72834780 1 < canceled part key=_multipart_TPADM4812N0Z.2~GSEZO4KSE3MC.1 size=1048576 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.859+0000 7f5e72834780 1 < completed part key=_multipart_TPADM4812N0Z.2~GSEZO4KSE3MC.2 size=497523 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.861+0000 7f5e72834780 1 < canceled multipart upload key=TPADM4812N0Z upload=GSEZO4KSE3MC tag=SQF7HJS1O74F type=write size=3643251 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.862+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=NUEG81RJXNYN type=del size=2127698 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.864+0000 7f5e72834780 1 < suggested remove operation key=QGGULCYZ0ZSA tag=VB66AW0Q9BRG type=write 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.866+0000 7f5e72834780 1 > prepared operation key=883VBT1ADE6K tag=TZVQ0X5SJU2A type=write size=497836 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.867+0000 7f5e72834780 1 < completed delete operation key=ZM1YKZOUFSCY tag=OB2YMY2LO4O7 type=del 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.868+0000 7f5e72834780 1 > prepared operation key=JV6FJONY04AW tag=IELVQZIR3CNR type=write size=914289 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.869+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~4KR91Z03I2JL.0 size=1048576 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.870+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~4KR91Z03I2JL.1 size=1048576 2024-02-23T06:34:27.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.871+0000 7f5e72834780 1 < completed part key=_multipart_0WLEPDK2O30W.2~4KR91Z03I2JL.2 size=788400 2024-02-23T06:34:27.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.873+0000 7f5e72834780 1 < completed multipart upload key=0WLEPDK2O30W upload=4KR91Z03I2JL tag=SX17CLWK1G5S type=write size=3934128 2024-02-23T06:34:27.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.875+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~L74IV8P1O35R.0 size=1048576 2024-02-23T06:34:27.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.876+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~L74IV8P1O35R.1 size=1048576 2024-02-23T06:34:27.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.877+0000 7f5e72834780 1 > prepared part key=_multipart_R3STDBS79MV0.2~L74IV8P1O35R.2 size=278026 2024-02-23T06:34:27.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.877+0000 7f5e72834780 1 > prepared multipart upload key=R3STDBS79MV0 upload=L74IV8P1O35R tag=H9X79KMV3BVI type=write size=3423754 2024-02-23T06:34:27.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.878+0000 7f5e72834780 1 < completed delete operation key=VEJ6D2J3LZI8 tag=H04K093DMF9K type=del 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.880+0000 7f5e72834780 1 > prepared operation key=R4YA9DUAJABL tag=K8L25OYV123G type=del size=2977493 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.881+0000 7f5e72834780 1 < completed delete operation key=JV6FJONY04AW tag=M2JUCN1MK8JI type=del 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.883+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~O0GU11953V9X.0 size=1048576 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.884+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~O0GU11953V9X.1 size=1048576 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.885+0000 7f5e72834780 1 > prepared part key=_multipart_VEJ6D2J3LZI8.2~O0GU11953V9X.2 size=84626 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.885+0000 7f5e72834780 1 > prepared multipart upload key=VEJ6D2J3LZI8 upload=O0GU11953V9X tag=7NMRRH1PEJLS type=write size=3230354 2024-02-23T06:34:27.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.886+0000 7f5e72834780 1 < canceled operation key=MB8BZ2BXZE9M tag=Q4NJY5DFEN09 type=del size=1159623 2024-02-23T06:34:27.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.887+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=7KQC9DVN959C type=write size=30781 2024-02-23T06:34:27.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.888+0000 7f5e72834780 1 < canceled operation key=9AQCXLBZW3EV tag=8FXSE8FD424T type=del size=1372596 2024-02-23T06:34:27.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.890+0000 7f5e72834780 1 > prepared part key=_multipart_03P6IEKSHB17.2~VWW9OP9JC0P9.0 size=180391 2024-02-23T06:34:27.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.890+0000 7f5e72834780 1 > prepared multipart upload key=03P6IEKSHB17 upload=VWW9OP9JC0P9 tag=TC80LX0YA8QA type=write size=1228967 2024-02-23T06:34:27.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.892+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=92IUOH796IHC type=write size=185582 2024-02-23T06:34:27.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.894+0000 7f5e72834780 1 > prepared part key=_multipart_VER8U5YMTPS6.2~41YFKS2B0S49.0 size=201453 2024-02-23T06:34:27.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.894+0000 7f5e72834780 1 > prepared multipart upload key=VER8U5YMTPS6 upload=41YFKS2B0S49 tag=JOL5JK4M0U63 type=write size=1250029 2024-02-23T06:34:27.897 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.896+0000 7f5e72834780 1 < suggested remove operation key=VEJ6D2J3LZI8 tag=CV977EBMD9TW type=write 2024-02-23T06:34:27.898 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.897+0000 7f5e72834780 1 > prepared operation key=7N8OH7EETRN8 tag=FQ6Q76G5YW81 type=write size=183894 2024-02-23T06:34:27.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.899+0000 7f5e72834780 1 < completed delete operation key=VER8U5YMTPS6 tag=1K9YZ8Y43WFU type=del 2024-02-23T06:34:27.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.900+0000 7f5e72834780 1 > prepared operation key=9AQCXLBZW3EV tag=LUBA2QGHTYG1 type=del size=1332253 2024-02-23T06:34:27.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.900+0000 7f5e72834780 1 < canceled part key=_multipart_03P6IEKSHB17.2~N1EY4ENUW1P2.0 size=1048576 2024-02-23T06:34:27.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.901+0000 7f5e72834780 1 < completed part key=_multipart_03P6IEKSHB17.2~N1EY4ENUW1P2.1 size=1034357 2024-02-23T06:34:27.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.903+0000 7f5e72834780 1 < canceled multipart upload key=03P6IEKSHB17 upload=N1EY4ENUW1P2 tag=LFF05TV4B4JS type=write size=3131509 2024-02-23T06:34:27.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.904+0000 7f5e72834780 1 > prepared operation key=M5LH10WTDP0P tag=LAAWPN89IMAR type=write size=310029 2024-02-23T06:34:27.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.905+0000 7f5e72834780 1 < completed write operation key=7N8OH7EETRN8 tag=Z3G70HWNVWZ1 type=write size=382036 2024-02-23T06:34:27.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.906+0000 7f5e72834780 1 > prepared operation key=GW6EKQ84FQ6L tag=2E1C3LZ7YI9P type=del size=718259 2024-02-23T06:34:27.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.908+0000 7f5e72834780 1 < completed part key=_multipart_4M7BT05YB0C3.2~SYB15Q8LZLR9.0 size=606455 2024-02-23T06:34:27.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.910+0000 7f5e72834780 1 < completed multipart upload key=4M7BT05YB0C3 upload=SYB15Q8LZLR9 tag=ZOM50DRMUERZ type=write size=1655031 2024-02-23T06:34:27.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.911+0000 7f5e72834780 1 > prepared operation key=8Q6WC7B9BY5Q tag=GOHA8PZOG7JO type=del size=2068030 2024-02-23T06:34:27.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.912+0000 7f5e72834780 1 < completed part key=_multipart_LUERFL6AN6HF.2~4U1YPJ3JU86V.0 size=1048576 2024-02-23T06:34:27.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.912+0000 7f5e72834780 1 < canceled part key=_multipart_LUERFL6AN6HF.2~4U1YPJ3JU86V.1 size=91953 2024-02-23T06:34:27.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.914+0000 7f5e72834780 1 < canceled multipart upload key=LUERFL6AN6HF upload=4U1YPJ3JU86V tag=0PKPJJFNT8UZ type=write size=2189105 2024-02-23T06:34:27.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.915+0000 7f5e72834780 1 > prepared operation key=VER8U5YMTPS6 tag=HFSTTC954QPA type=del size=2999721 2024-02-23T06:34:27.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.916+0000 7f5e72834780 1 < completed delete operation key=9ZCNDGBEPWMN tag=RU6GIS5ILT9R type=del 2024-02-23T06:34:27.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.920+0000 7f5e72834780 1 > prepared part key=_multipart_26EE3EHDK8EM.2~LYDW2267S9YM.0 size=816165 2024-02-23T06:34:27.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.920+0000 7f5e72834780 1 > prepared multipart upload key=26EE3EHDK8EM upload=LYDW2267S9YM tag=TYHMMAJB9E29 type=write size=1864741 2024-02-23T06:34:27.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.921+0000 7f5e72834780 1 < completed delete operation key=7N8OH7EETRN8 tag=NUEG81RJXNYN type=del 2024-02-23T06:34:27.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.922+0000 7f5e72834780 1 > prepared operation key=03P6IEKSHB17 tag=9OD7YAVNJUY4 type=del size=1932861 2024-02-23T06:34:27.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.923+0000 7f5e72834780 1 < canceled operation key=883VBT1ADE6K tag=TZVQ0X5SJU2A type=write size=497836 2024-02-23T06:34:27.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:34:27.924+0000 7f5e72834780 1 > prepared operation key=IDTA5RV6IUF6 tag=A3KF905X1TA9 type=del size=1647600 2024-02-23T06:34:27.926 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] cls_rgw_stats.simulate (8995 ms) 2024-02-23T06:34:27.926 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 1 test from cls_rgw_stats (8996 ms total) 2024-02-23T06:34:27.926 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:34:27.926 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:34:27.949 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 1 test from 1 test suite ran. (10870 ms total) 2024-02-23T06:34:27.949 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 1 test. 2024-02-23T06:34:27.953 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:34:27.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:34:28.033 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-02-23T06:34:28.034 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-02-23T06:34:28.035 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-02-23T06:34:28.114 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:34:28.114 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 31 tests from 1 test suite. 2024-02-23T06:34:28.114 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:34:29.965 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 31 tests from CmpOmap 2024-02-23T06:34:29.965 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-02-23T06:34:29.981 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-02-23T06:34:29.981 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-02-23T06:34:29.988 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (7 ms) 2024-02-23T06:34:29.988 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-02-23T06:34:29.991 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (2 ms) 2024-02-23T06:34:29.991 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-02-23T06:34:29.994 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-02-23T06:34:29.994 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-02-23T06:34:30.001 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-02-23T06:34:30.001 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-02-23T06:34:30.006 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-02-23T06:34:30.006 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-02-23T06:34:30.010 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-02-23T06:34:30.010 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-02-23T06:34:30.014 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-02-23T06:34:30.014 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-02-23T06:34:30.018 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-02-23T06:34:30.018 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-02-23T06:34:30.022 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-02-23T06:34:30.022 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-02-23T06:34:30.022 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-02-23T06:34:30.022 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-02-23T06:34:30.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-02-23T06:34:30.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-02-23T06:34:30.030 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-02-23T06:34:30.030 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-02-23T06:34:30.038 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-02-23T06:34:30.038 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-02-23T06:34:30.045 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-02-23T06:34:30.045 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-02-23T06:34:30.052 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-02-23T06:34:30.052 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-02-23T06:34:30.060 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-02-23T06:34:30.060 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-02-23T06:34:30.067 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-02-23T06:34:30.067 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-02-23T06:34:30.070 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-02-23T06:34:30.071 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-02-23T06:34:30.073 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-02-23T06:34:30.073 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-02-23T06:34:30.074 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-02-23T06:34:30.074 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-02-23T06:34:30.075 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-02-23T06:34:30.075 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-02-23T06:34:30.081 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-02-23T06:34:30.081 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-02-23T06:34:30.087 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-02-23T06:34:30.087 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-02-23T06:34:30.094 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-02-23T06:34:30.094 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-02-23T06:34:30.102 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-02-23T06:34:30.102 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-02-23T06:34:30.104 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-02-23T06:34:30.104 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-02-23T06:34:30.107 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-02-23T06:34:30.107 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-02-23T06:34:30.108 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-02-23T06:34:30.108 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-02-23T06:34:30.109 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-02-23T06:34:30.109 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-02-23T06:34:30.116 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-02-23T06:34:30.116 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 31 tests from CmpOmap (152 ms total) 2024-02-23T06:34:30.116 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:34:30.116 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:34:30.964 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 31 tests from 1 test suite ran. (2850 ms total) 2024-02-23T06:34:30.964 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 31 tests. 2024-02-23T06:34:30.968 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:34:30.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:34:31.054 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-02-23T06:34:31.055 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-02-23T06:34:31.055 DEBUG:teuthology.orchestra.run.smithi142:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-02-23T06:34:31.099 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:34:31.099 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 24 tests from 1 test suite. 2024-02-23T06:34:31.099 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:34:31.099 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from TestCls2PCQueue 2024-02-23T06:34:31.099 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-02-23T06:34:33.997 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2899 ms) 2024-02-23T06:34:33.998 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-02-23T06:34:37.008 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3011 ms) 2024-02-23T06:34:37.009 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-02-23T06:34:40.204 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.Reserve (3034 ms) 2024-02-23T06:34:40.205 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-02-23T06:34:43.058 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3015 ms) 2024-02-23T06:34:43.059 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-02-23T06:34:46.085 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.Commit (3027 ms) 2024-02-23T06:34:46.085 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-02-23T06:34:49.097 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.Stats (3012 ms) 2024-02-23T06:34:49.097 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-02-23T06:34:53.125 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4029 ms) 2024-02-23T06:34:53.126 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-02-23T06:34:56.163 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.Abort (3037 ms) 2024-02-23T06:34:56.163 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-02-23T06:34:59.184 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.ReserveError (3021 ms) 2024-02-23T06:34:59.184 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-02-23T06:35:02.212 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.CommitError (3028 ms) 2024-02-23T06:35:02.212 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-02-23T06:35:05.227 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.AbortError (3015 ms) 2024-02-23T06:35:05.227 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-02-23T06:35:08.253 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3025 ms) 2024-02-23T06:35:08.253 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-02-23T06:35:11.268 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3016 ms) 2024-02-23T06:35:11.268 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-02-23T06:35:14.282 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3014 ms) 2024-02-23T06:35:14.282 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-02-23T06:35:17.298 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3017 ms) 2024-02-23T06:35:17.299 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-02-23T06:35:20.318 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3018 ms) 2024-02-23T06:35:20.318 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-02-23T06:35:23.341 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3024 ms) 2024-02-23T06:35:23.341 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-02-23T06:35:26.350 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.Cleanup (3010 ms) 2024-02-23T06:35:26.351 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-02-23T06:35:36.890 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10538 ms) 2024-02-23T06:35:36.890 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-02-23T06:35:39.910 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3021 ms) 2024-02-23T06:35:39.911 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-02-23T06:35:51.962 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12052 ms) 2024-02-23T06:35:51.962 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-02-23T06:35:55.995 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4033 ms) 2024-02-23T06:35:55.995 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-02-23T06:36:02.033 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6038 ms) 2024-02-23T06:36:02.034 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-02-23T06:36:07.070 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5036 ms) 2024-02-23T06:36:07.070 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from TestCls2PCQueue (95970 ms total) 2024-02-23T06:36:07.070 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:07.070 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:07.070 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 24 tests from 1 test suite ran. (95970 ms total) 2024-02-23T06:36:07.070 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 24 tests. 2024-02-23T06:36:07.072 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:36:07.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:36:07.116 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-02-23T06:36:07.118 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-02-23T06:36:07.118 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-02-23T06:36:07.209 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:07.209 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:07.210 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 6 tests from 1 test suite. 2024-02-23T06:36:07.210 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:09.074 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 6 tests from rgw_gc_log 2024-02-23T06:36:09.075 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-02-23T06:36:09.503 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] rgw_gc_log.init_existing_queue (428 ms) 2024-02-23T06:36:09.503 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-02-23T06:36:09.506 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-02-23T06:36:09.506 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-02-23T06:36:09.509 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-02-23T06:36:09.510 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-02-23T06:36:09.511 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-02-23T06:36:09.511 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-02-23T06:36:09.514 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-02-23T06:36:09.514 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-02-23T06:36:09.516 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-02-23T06:36:09.516 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 6 tests from rgw_gc_log (441 ms total) 2024-02-23T06:36:09.516 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:09.516 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:10.077 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 6 tests from 1 test suite ran. (2867 ms total) 2024-02-23T06:36:10.077 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 6 tests. 2024-02-23T06:36:10.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:36:10.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:36:10.129 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-02-23T06:36:10.130 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-02-23T06:36:10.130 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:Running main() from gmock_main.cc 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 4 tests from 1 test suite. 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 4 tests from TestRGWObj 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestRGWObj.underscore 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.187 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns= i= 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns= i= 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns= i= 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.188 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.189 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.190 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.191 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.192 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.193 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns=ns i= 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns=ns i= 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns=ns i= 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.194 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.195 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.196 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.197 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.198 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.199 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns= i=v1 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns= i=v1 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns= i=v1 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.200 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.201 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.202 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.203 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.204 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns=ns i=v1 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns=ns i=v1 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: _obj[v1] 2024-02-23T06:36:10.205 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: _obj ns=ns i=v1 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.206 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.207 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.208 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.209 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.210 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.211 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.211 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_obj", 2024-02-23T06:36:10.211 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.211 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.211 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.211 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestRGWObj.no_underscore 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns= i= 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns= i= 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns= i= 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.212 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.213 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.214 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.215 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.216 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.217 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.218 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns=ns i= 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns=ns i= 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns=ns i= 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.219 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.220 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.221 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.222 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.223 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.224 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns= i=v1 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns= i=v1 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.225 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns= i=v1 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.226 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.227 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.228 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.228 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.228 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.228 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.228 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.228 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.229 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.230 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.231 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.232 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns=ns i=v1 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns=ns i=v1 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:parsed: obj[v1] 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:stripped: obj ns=ns i=v1 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout: "obj1": { 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.233 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "obj2": { 2024-02-23T06:36:10.234 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.235 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3": { 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.236 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "obj3-2": { 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.237 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "obj", 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "v1", 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-02-23T06:36:10.238 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.239 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.240 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker_myobj", 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.241 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.242 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.243 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.244 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker_myobj", 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.245 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.246 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.247 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.248 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns_myobj", 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.249 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.250 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.251 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.252 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.253 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns_myobj", 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.254 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.255 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.256 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.257 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst_myobj", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.258 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.259 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.260 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.261 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst_myobj", 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.262 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.263 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.264 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.265 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.266 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst_myobj", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.267 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.268 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.269 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.270 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst_myobj", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.271 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.272 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.273 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.274 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj", 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.275 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.276 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.277 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.278 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj", 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.279 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.280 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.281 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.282 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj", 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.283 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.284 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.285 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.286 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj", 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.287 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.288 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.289 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.290 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.291 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj", 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.292 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.293 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.294 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.295 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj", 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.296 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.297 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.298 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.299 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj", 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.300 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.301 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.302 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.303 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj", 2024-02-23T06:36:10.304 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.305 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.306 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.307 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.308 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj_", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.309 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.310 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.311 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.312 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj_", 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.313 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.314 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.315 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.316 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj_", 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.317 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.318 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.319 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.320 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj_", 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.321 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.322 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.323 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.324 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj_", 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.325 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.326 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.327 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.328 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.329 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.331 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.332 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj_", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.333 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.334 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.335 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.336 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": "default-placement.data", 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj_", 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "test", 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.337 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": "", 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": "" 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.338 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "obj": { 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.339 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.340 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj_", 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.341 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.342 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker_myobj", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.343 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker_myobj 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.344 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker_myobj", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.345 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker_myobj 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns_myobj", 2024-02-23T06:36:10.346 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.347 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__ns_myobj 2024-02-23T06:36:10.349 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns_myobj", 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.350 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__ns_myobj 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.351 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst_myobj", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.352 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__:inst_myobj 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.353 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst_myobj", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.354 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__:inst_myobj 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst_myobj", 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.355 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.356 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst_myobj", 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.357 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.358 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "myobj", 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj", 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.359 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.360 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker___myobj 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj", 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.361 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.362 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker___myobj 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj", 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.363 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.364 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__ns__myobj 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj", 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.365 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.366 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__ns__myobj 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj", 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.367 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.368 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__:inst__myobj 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj", 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj" 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.369 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__:inst__myobj 2024-02-23T06:36:10.370 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj", 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.371 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.372 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.373 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj", 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.374 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj_", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.375 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker___myobj_ 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker___myobj_", 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.376 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.377 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker___myobj_ 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj_", 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.378 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.379 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__ns__myobj_ 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns__myobj_", 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.380 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "", 2024-02-23T06:36:10.381 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj_", 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.382 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.383 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__:inst__myobj_", 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "marker__myobj_" 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.384 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "" 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-02-23T06:36:10.385 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj": { 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj_", 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj": { 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.386 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "raw_obj2": { 2024-02-23T06:36:10.387 INFO:tasks.workunit.client.0.smithi142.stdout: "pool": ".data-pool", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "oid": "marker__ns:inst__myobj_", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "loc": "" 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "new_obj2": { 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket": { 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "ebtest", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "marker": "marker", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_id": "bucket-id", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "tenant": "", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "explicit_placement": { 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "data_pool": ".data-pool", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "data_extra_pool": "", 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: "index_pool": ".index-pool" 2024-02-23T06:36:10.388 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: "key": { 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: "name": "_myobj_", 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: "instance": "inst", 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: "ns": "ns" 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-02-23T06:36:10.389 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 4 tests. 2024-02-23T06:36:10.390 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:36:10.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:36:10.431 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-02-23T06:36:10.432 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-02-23T06:36:10.432 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-02-23T06:36:10.623 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:10.624 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:10.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.663+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 realm 2024-02-23T06:36:10.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:36:10.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.664+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.665+0000 7f5e7768c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:36:10.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.665+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.666+0000 7f5e7768c800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:36:10.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.666+0000 7f5e7768c800 20 searching for the correct realm 2024-02-23T06:36:10.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.680+0000 7f5e6c74e640 0 -- 172.21.15.142:0/341580455 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f5e640565b0 msgr2=0x7f5e64087250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:36:10.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.684+0000 7f5e6c74e640 0 -- 172.21.15.142:0/341580455 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f5e640565b0 msgr2=0x7f5d4007c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:36:10.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:36:10.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:36:10.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.891+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:36:10.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 20 zone default found 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 4 Realm: () 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 20 zonegroup default 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.892+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.893+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.893+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.893+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.893+0000 7f5e7768c800 20 started sync module instance, tier type = 2024-02-23T06:36:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.893+0000 7f5e7768c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:36:10.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=0 2024-02-23T06:36:10.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=1 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=2 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=3 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=4 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=5 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.903+0000 7f5e7768c800 20 add_watcher() i=6 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.904+0000 7f5e7768c800 20 add_watcher() i=7 2024-02-23T06:36:10.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.904+0000 7f5e7768c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:36:10.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.905+0000 7f5d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:36:10.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:36:10.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:36:10.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 5 note: GC not initialized 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5d29fe3640 20 reqs_thread_entry: start 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 20 init_complete bucket index max shards: 11 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 20 Filter name: none 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5c9b7fe640 20 reqs_thread_entry: start 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.906+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-02-23T06:36:10.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache get: name=default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= : miss 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 20 rados->read ofs=0 len=0 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache put: name=default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= info.flags=0x0 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 adding default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= to cache LRU end 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache get: name=default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= : hit (negative entry) 2024-02-23T06:36:10.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.907+0000 7f5e7768c800 10 cache get: name=default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= : hit (negative entry) 2024-02-23T06:36:10.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.909+0000 7f5e7768c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-02-23T06:36:10.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.909+0000 7f5e7768c800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-02-23T06:36:10.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.909+0000 7f5e7768c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-02-23T06:36:10.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.909+0000 7f5d4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987521 cookie 93898016177936 notifier 5544 bl.length()=664 2024-02-23T06:36:10.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.909+0000 7f5d4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-02-23T06:36:10.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.909+0000 7f5d4bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-02-23T06:36:10.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.911+0000 7f5e7768c800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-02-23T06:36:10.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.911+0000 7f5e7768c800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-02-23T06:36:10.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.911+0000 7f5e7768c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-02-23T06:36:10.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.911+0000 7f5d4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987520 cookie 93898016170336 notifier 5544 bl.length()=194 2024-02-23T06:36:10.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.911+0000 7f5d4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-02-23T06:36:10.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.911+0000 7f5d4bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-02-23T06:36:10.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.913+0000 7f5e7768c800 10 cache put: name=default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= info.flags=0x7 2024-02-23T06:36:10.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.913+0000 7f5e7768c800 10 moving default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= to cache LRU end 2024-02-23T06:36:10.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.913+0000 7f5e7768c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:FwrYeomGhgPvHOGqOaYBPCB0+nc=, ofs0, ns] 2024-02-23T06:36:10.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.913+0000 7f5d4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987521 cookie 93898016170336 notifier 5544 bl.length()=203 2024-02-23T06:36:10.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.913+0000 7f5d4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= info.flags=0x7 2024-02-23T06:36:10.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.913+0000 7f5d4bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FwrYeomGhgPvHOGqOaYBPCB0+nc= to cache LRU end 2024-02-23T06:36:10.914 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "user_id": "ceph-test-librgw-file", 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "display_name": "librgw test user", 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "email": "librgw@example.com", 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "suspended": 0, 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "max_buckets": 1000, 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "subusers": [], 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "keys": [ 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: { 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "user": "ceph-test-librgw-file", 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "access_key": "FwrYeomGhgPvHOGqOaYBPCB0+nc=", 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "secret_key": "kz63hQXcGYtjYMoVkGLJ6iVPDjqS4TvWCEsNIAhL7S5MksHQHVpd2Q==", 2024-02-23T06:36:10.915 INFO:tasks.workunit.client.0.smithi142.stdout: "active": true 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: ], 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: "swift_keys": [], 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: "caps": [], 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: "op_mask": "read, write, delete", 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: "default_placement": "", 2024-02-23T06:36:10.916 INFO:tasks.workunit.client.0.smithi142.stdout: "default_storage_class": "", 2024-02-23T06:36:10.917 INFO:tasks.workunit.client.0.smithi142.stdout: "placement_tags": [], 2024-02-23T06:36:10.917 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_quota": { 2024-02-23T06:36:10.917 INFO:tasks.workunit.client.0.smithi142.stdout: "enabled": false, 2024-02-23T06:36:10.917 INFO:tasks.workunit.client.0.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:36:10.917 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size": -1, 2024-02-23T06:36:10.917 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "max_objects": -1 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "user_quota": { 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "enabled": false, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size": -1, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "max_objects": -1 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "temp_url_keys": [], 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "type": "rgw", 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: "mfa_ids": [] 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:10.918 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:10.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.914+0000 7f5d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:36:10.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.917+0000 7f5e7768c800 20 remove_watcher() i=0 2024-02-23T06:36:10.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.917+0000 7f5e7768c800 2 removed watcher, disabling cache 2024-02-23T06:36:10.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.918+0000 7f5e7768c800 20 remove_watcher() i=1 2024-02-23T06:36:10.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.919+0000 7f5e7768c800 20 remove_watcher() i=2 2024-02-23T06:36:10.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.920+0000 7f5e7768c800 20 remove_watcher() i=3 2024-02-23T06:36:10.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.921+0000 7f5e7768c800 20 remove_watcher() i=4 2024-02-23T06:36:10.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.922+0000 7f5e7768c800 20 remove_watcher() i=5 2024-02-23T06:36:10.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.923+0000 7f5e7768c800 20 remove_watcher() i=6 2024-02-23T06:36:10.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:10.924+0000 7f5e7768c800 20 remove_watcher() i=7 2024-02-23T06:36:10.933 INFO:tasks.workunit.client.0.smithi142.stdout:phase 1.1 2024-02-23T06:36:10.953 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 24 tests from 1 test suite. 2024-02-23T06:36:10.954 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:10.954 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from LibRGW 2024-02-23T06:36:10.954 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:10.964 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:10.964 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:11.140 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-02-23T06:36:11.140 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-02-23T06:36:11.141 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-02-23T06:36:11.141 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:11.141 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-02-23T06:36:11.142 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-02-23T06:36:11.149 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/quux 2024-02-23T06:36:11.154 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/f1 2024-02-23T06:36:11.157 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/f2 2024-02-23T06:36:11.161 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/f1 2024-02-23T06:36:11.164 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/d1/ 2024-02-23T06:36:11.166 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-02-23T06:36:11.169 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-02-23T06:36:11.172 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/momma 2024-02-23T06:36:11.174 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-02-23T06:36:11.177 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-02-23T06:36:11.180 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-02-23T06:36:11.183 INFO:tasks.workunit.client.0.smithi142.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-02-23T06:36:11.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETUP_HIER1 (44 ms) 2024-02-23T06:36:11.186 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-02-23T06:36:11.289 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETUP_DIRS1 (103 ms) 2024-02-23T06:36:11.289 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETATTR 2024-02-23T06:36:11.289 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-02-23T06:36:11.289 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-02-23T06:36:11.306 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-02-23T06:36:11.306 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-02-23T06:36:11.345 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (38 ms) 2024-02-23T06:36:11.345 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-02-23T06:36:11.345 INFO:tasks.workunit.client.0.smithi142.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-02-23T06:36:11.352 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-02-23T06:36:11.352 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-02-23T06:36:11.352 INFO:tasks.workunit.client.0.smithi142.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-02-23T06:36:11.358 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout:scanning objects in /bdirs1/dir_0 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout:scanning objects in /bdirs1/dir_1 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:11.359 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout:scanning objects in /bdirs1/dir_2 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout:read back objects in /bdirs1/dir_0 2024-02-23T06:36:11.360 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_0/sfile_0 2024-02-23T06:36:11.361 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_0 : "data for sfile_0" 2024-02-23T06:36:11.361 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_0/sfile_1 2024-02-23T06:36:11.361 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_1 : "data for sfile_1" 2024-02-23T06:36:11.361 INFO:tasks.workunit.client.0.smithi142.stdout:read back objects in /bdirs1/dir_1 2024-02-23T06:36:11.361 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_1/sfile_0 2024-02-23T06:36:11.363 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_0 : "data for sfile_0" 2024-02-23T06:36:11.363 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_1/sfile_1 2024-02-23T06:36:11.364 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_1 : "data for sfile_1" 2024-02-23T06:36:11.364 INFO:tasks.workunit.client.0.smithi142.stdout:read back objects in /bdirs1/dir_2 2024-02-23T06:36:11.364 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_2/sfile_0 2024-02-23T06:36:11.365 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_0 : "data for sfile_0" 2024-02-23T06:36:11.366 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_2/sfile_1 2024-02-23T06:36:11.367 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_1 : "data for sfile_1" 2024-02-23T06:36:11.367 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-02-23T06:36:11.367 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READF_SETUP1 (171 ms) 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_0 type: DIR refs: 2 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_0 type: FILE refs: 2 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_1 type: DIR refs: 2 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_1 type: FILE refs: 2 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_0 type: DIR refs: 2 2024-02-23T06:36:11.539 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_0 type: FILE refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_1 type: DIR refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_1 type: FILE refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_0 type: DIR refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_0 type: FILE refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_1 type: DIR refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_1 type: FILE refs: 2 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-02-23T06:36:11.540 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.HIER1 2024-02-23T06:36:11.546 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/f2 (f2): FILE 2024-02-23T06:36:11.546 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/f1 (f1): FILE 2024-02-23T06:36:11.549 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-02-23T06:36:11.551 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-02-23T06:36:11.556 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-02-23T06:36:11.556 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-02-23T06:36:11.556 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-02-23T06:36:11.556 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-02-23T06:36:11.556 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-02-23T06:36:11.557 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-02-23T06:36:11.557 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-02-23T06:36:11.559 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-02-23T06:36:11.559 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-02-23T06:36:11.559 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar (bar): DIR 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo (foo): DIR 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot (nfsroot): DIR 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:11.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:11.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:11.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:11.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:11.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:11.559+0000 7f82b6e198c0 -1 shutting down 2024-02-23T06:36:11.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:11.560+0000 7f818ebb7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65908, si_uid : 1000, si_addr0x3e800010174, si_status0 2024-02-23T06:36:11.606 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (46 ms) 2024-02-23T06:36:11.606 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from LibRGW (652 ms total) 2024-02-23T06:36:11.606 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:11.607 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:11.607 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 24 tests from 1 test suite ran. (652 ms total) 2024-02-23T06:36:11.607 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 24 tests. 2024-02-23T06:36:11.612 INFO:tasks.workunit.client.0.smithi142.stdout:phase 1.2 2024-02-23T06:36:11.632 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 24 tests from 1 test suite. 2024-02-23T06:36:11.632 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:11.632 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from LibRGW 2024-02-23T06:36:11.632 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:11.640 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:11.640 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:12.021 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-02-23T06:36:12.021 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-02-23T06:36:12.022 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-02-23T06:36:12.022 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETATTR 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-02-23T06:36:12.023 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-02-23T06:36:12.024 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.HIER1 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:12.025 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:12.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:12.022+0000 7f838c2198c0 -1 shutting down 2024-02-23T06:36:12.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:12.023+0000 7f8263fb7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66525, si_uid : 1000, si_addr0x3e8000103dd, si_status0 2024-02-23T06:36:12.067 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (45 ms) 2024-02-23T06:36:12.067 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from LibRGW (435 ms total) 2024-02-23T06:36:12.067 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:12.067 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:12.068 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 24 tests from 1 test suite ran. (435 ms total) 2024-02-23T06:36:12.068 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 24 tests. 2024-02-23T06:36:12.072 INFO:tasks.workunit.client.0.smithi142.stdout:phase 1.3 2024-02-23T06:36:12.093 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 24 tests from 1 test suite. 2024-02-23T06:36:12.093 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:12.093 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from LibRGW 2024-02-23T06:36:12.093 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:12.103 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:12.103 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:12.679 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (585 ms) 2024-02-23T06:36:12.679 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-02-23T06:36:12.679 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-02-23T06:36:12.679 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:12.679 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-02-23T06:36:12.679 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-02-23T06:36:12.684 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETUP_HIER1 (4 ms) 2024-02-23T06:36:12.684 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-02-23T06:36:12.744 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETUP_DIRS1 (60 ms) 2024-02-23T06:36:12.744 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SETATTR 2024-02-23T06:36:12.744 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-02-23T06:36:12.744 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-02-23T06:36:12.744 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-02-23T06:36:12.744 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:scanning objects in /bdirs1/dir_0 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout:scanning objects in /bdirs1/dir_1 2024-02-23T06:36:12.745 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout:scanning objects in /bdirs1/dir_2 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout:read back objects in /bdirs1/dir_0 2024-02-23T06:36:12.746 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_0/sfile_0 2024-02-23T06:36:12.747 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_0 : "data for sfile_0" 2024-02-23T06:36:12.747 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_0/sfile_1 2024-02-23T06:36:12.747 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_1 : "data for sfile_1" 2024-02-23T06:36:12.747 INFO:tasks.workunit.client.0.smithi142.stdout:read back objects in /bdirs1/dir_1 2024-02-23T06:36:12.747 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_1/sfile_0 2024-02-23T06:36:12.748 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_0 : "data for sfile_0" 2024-02-23T06:36:12.748 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_1/sfile_1 2024-02-23T06:36:12.749 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_1 : "data for sfile_1" 2024-02-23T06:36:12.749 INFO:tasks.workunit.client.0.smithi142.stdout:read back objects in /bdirs1/dir_2 2024-02-23T06:36:12.749 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_2/sfile_0 2024-02-23T06:36:12.751 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_0 : "data for sfile_0" 2024-02-23T06:36:12.751 INFO:tasks.workunit.client.0.smithi142.stdout:reading 0,256 dir_2/sfile_1 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout: read back from sfile_1 : "data for sfile_1" 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_0 type: DIR refs: 2 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_0 type: FILE refs: 2 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_1 type: DIR refs: 2 2024-02-23T06:36:12.754 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_1 type: FILE refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_0 type: DIR refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_0 type: FILE refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_1 type: DIR refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_1 type: FILE refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_0 type: DIR refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_0 type: FILE refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sdir_1 type: DIR refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:release sfile_1 type: FILE refs: 2 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-02-23T06:36:12.755 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.HIER1 2024-02-23T06:36:12.761 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/f2 (f2): FILE 2024-02-23T06:36:12.761 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/f1 (f1): FILE 2024-02-23T06:36:12.764 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-02-23T06:36:12.765 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-02-23T06:36:12.769 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-02-23T06:36:12.769 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-02-23T06:36:12.769 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-02-23T06:36:12.770 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-02-23T06:36:12.770 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-02-23T06:36:12.771 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-02-23T06:36:12.771 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-02-23T06:36:12.773 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo/bar (bar): DIR 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot/foo (foo): DIR 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:/nfsroot (nfsroot): DIR 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-02-23T06:36:12.774 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:12.775 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:12.775 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:12.775 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:12.775 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:12.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:12.773+0000 7f18f45238c0 -1 shutting down 2024-02-23T06:36:12.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:12.774+0000 7f17ce16b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67142, si_uid : 1000, si_addr0x3e800010646, si_status0 2024-02-23T06:36:12.844 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (70 ms) 2024-02-23T06:36:12.844 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 24 tests from LibRGW (750 ms total) 2024-02-23T06:36:12.844 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:12.844 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:12.844 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 24 tests from 1 test suite ran. (750 ms total) 2024-02-23T06:36:12.845 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 24 tests. 2024-02-23T06:36:12.850 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2.1 2024-02-23T06:36:12.871 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 9 tests from 1 test suite. 2024-02-23T06:36:12.871 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:12.871 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 9 tests from LibRGW 2024-02-23T06:36:12.871 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:12.880 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:12.880 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:13.041 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (170 ms) 2024-02-23T06:36:13.041 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:13.042 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:13.042 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-02-23T06:36:13.051 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-02-23T06:36:13.051 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-02-23T06:36:13.051 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-02-23T06:36:13.052 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-02-23T06:36:13.059 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave0 2024-02-23T06:36:13.068 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave1 2024-02-23T06:36:13.079 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave2 2024-02-23T06:36:13.086 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave3 2024-02-23T06:36:13.096 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave4 2024-02-23T06:36:13.108 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave5 2024-02-23T06:36:13.122 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave6 2024-02-23T06:36:13.129 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave7 2024-02-23T06:36:13.140 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave8 2024-02-23T06:36:13.148 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave9 2024-02-23T06:36:13.149 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (97 ms) 2024-02-23T06:36:13.149 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (250 ms) 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:13.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:13.398+0000 7fb2d0c1c8c0 -1 shutting down 2024-02-23T06:36:13.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:13.399+0000 7fb1a877f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67759, si_uid : 1000, si_addr0x3e8000108af, si_status0 2024-02-23T06:36:13.506 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (108 ms) 2024-02-23T06:36:13.507 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 9 tests from LibRGW (636 ms total) 2024-02-23T06:36:13.507 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:13.507 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:13.507 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 9 tests from 1 test suite ran. (636 ms total) 2024-02-23T06:36:13.507 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 9 tests. 2024-02-23T06:36:13.512 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2.2 2024-02-23T06:36:13.532 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 9 tests from 1 test suite. 2024-02-23T06:36:13.533 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:13.533 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 9 tests from LibRGW 2024-02-23T06:36:13.533 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:13.701 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (168 ms) 2024-02-23T06:36:13.701 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:13.701 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:13.702 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-02-23T06:36:13.702 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-02-23T06:36:13.702 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-02-23T06:36:13.732 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET (31 ms) 2024-02-23T06:36:13.732 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-02-23T06:36:13.741 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave0 2024-02-23T06:36:13.749 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave1 2024-02-23T06:36:13.757 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave2 2024-02-23T06:36:13.767 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave3 2024-02-23T06:36:13.776 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave4 2024-02-23T06:36:13.786 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave5 2024-02-23T06:36:13.797 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave6 2024-02-23T06:36:13.806 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave7 2024-02-23T06:36:13.815 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave8 2024-02-23T06:36:13.822 INFO:tasks.workunit.client.0.smithi142.stdout:created: sorrydave9 2024-02-23T06:36:13.822 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (89 ms) 2024-02-23T06:36:13.822 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-02-23T06:36:14.077 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (256 ms) 2024-02-23T06:36:14.078 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:14.078 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:14.078 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:14.078 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:14.078 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:14.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:14.077+0000 7f20a37528c0 -1 shutting down 2024-02-23T06:36:14.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:14.078+0000 7f1f7f1b7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68376, si_uid : 1000, si_addr0x3e800010b18, si_status0 2024-02-23T06:36:14.166 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (89 ms) 2024-02-23T06:36:14.167 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 9 tests from LibRGW (634 ms total) 2024-02-23T06:36:14.167 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:14.167 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:14.167 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 9 tests from 1 test suite ran. (634 ms total) 2024-02-23T06:36:14.167 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 9 tests. 2024-02-23T06:36:14.173 INFO:tasks.workunit.client.0.smithi142.stdout:phase 3.1 2024-02-23T06:36:14.484 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 13 tests from 1 test suite. 2024-02-23T06:36:14.484 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:14.484 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 13 tests from LibRGW 2024-02-23T06:36:14.484 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:14.493 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:14.493 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:15.071 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (587 ms) 2024-02-23T06:36:15.071 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:15.072 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:15.072 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-02-23T06:36:15.079 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-02-23T06:36:15.079 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-02-23T06:36:15.083 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-02-23T06:36:15.083 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-02-23T06:36:15.085 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-02-23T06:36:15.085 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LARGE1 2024-02-23T06:36:15.139 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LARGE1 (54 ms) 2024-02-23T06:36:15.139 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LARGE2 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LARGE2 (46 ms) 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:15.185 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:15.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:15.184+0000 7f1a624bf8c0 -1 shutting down 2024-02-23T06:36:15.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:15.186+0000 7f193b3b7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68993, si_uid : 1000, si_addr0x3e800010d81, si_status0 2024-02-23T06:36:15.238 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (53 ms) 2024-02-23T06:36:15.238 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 13 tests from LibRGW (754 ms total) 2024-02-23T06:36:15.238 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:15.238 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:15.238 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 13 tests from 1 test suite ran. (754 ms total) 2024-02-23T06:36:15.238 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 13 tests. 2024-02-23T06:36:15.245 INFO:tasks.workunit.client.0.smithi142.stdout:phase 3.2 2024-02-23T06:36:15.559 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 13 tests from 1 test suite. 2024-02-23T06:36:15.559 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:15.559 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 13 tests from LibRGW 2024-02-23T06:36:15.559 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:15.567 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:15.567 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:15.931 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (372 ms) 2024-02-23T06:36:15.931 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:15.932 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:15.932 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-02-23T06:36:15.932 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-02-23T06:36:15.932 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-02-23T06:36:15.937 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-02-23T06:36:15.937 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-02-23T06:36:15.941 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-02-23T06:36:15.941 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LARGE1 2024-02-23T06:36:16.359 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LARGE1 (419 ms) 2024-02-23T06:36:16.359 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LARGE2 2024-02-23T06:36:16.360 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-02-23T06:36:16.360 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-02-23T06:36:16.360 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-02-23T06:36:16.360 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-02-23T06:36:16.363 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-02-23T06:36:16.363 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-02-23T06:36:16.390 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:16.390+0000 7fbf3a5408c0 -1 shutting down 2024-02-23T06:36:16.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:16.391+0000 7fbe141b7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69610, si_uid : 1000, si_addr0x3e800010fea, si_status0 2024-02-23T06:36:16.488 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (97 ms) 2024-02-23T06:36:16.488 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 13 tests from LibRGW (929 ms total) 2024-02-23T06:36:16.488 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:16.488 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:16.488 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 13 tests from 1 test suite ran. (929 ms total) 2024-02-23T06:36:16.488 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 13 tests. 2024-02-23T06:36:16.495 INFO:tasks.workunit.client.0.smithi142.stdout:phase 4.1 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 11 tests from 1 test suite. 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 11 tests from LibRGW 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.TVAR 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:read i1: 64001 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:read s1: blunderbuss 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-02-23T06:36:16.516 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:16.527 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:16.527 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:16.902 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-02-23T06:36:16.902 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:16.902 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:16.903 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-02-23T06:36:16.918 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-02-23T06:36:16.918 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-02-23T06:36:17.481 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_0 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_1 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_2 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_3 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_4 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_5 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_6 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_7 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_8 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_9 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_10 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_11 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_12 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_13 2024-02-23T06:36:17.482 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_14 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_15 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_16 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_17 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_18 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_19 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_20 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_21 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_22 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_23 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_24 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_25 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_26 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_27 2024-02-23T06:36:17.483 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_28 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_29 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_30 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_31 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_32 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_33 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_34 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_35 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_36 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_37 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_38 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_39 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_40 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_41 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_42 2024-02-23T06:36:17.484 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_43 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_44 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_45 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_46 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_47 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_48 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_49 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_50 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_51 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_52 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_53 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_54 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_55 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_56 2024-02-23T06:36:17.485 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_57 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_58 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_59 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_60 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_61 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_62 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_63 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_64 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_65 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_66 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_67 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_68 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_69 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_70 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_71 2024-02-23T06:36:17.486 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_72 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_73 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_74 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_75 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_76 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_77 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_78 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_79 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_80 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_81 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_82 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_83 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_84 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_85 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_86 2024-02-23T06:36:17.487 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_87 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_88 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_89 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_90 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_91 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_92 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_93 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_94 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_95 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_96 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_97 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_98 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:created: dmarker:f_99 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (564 ms) 2024-02-23T06:36:17.488 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-02-23T06:36:17.490 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-02-23T06:36:17.491 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-02-23T06:36:17.492 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-02-23T06:36:17.493 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-02-23T06:36:17.494 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-02-23T06:36:17.495 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-02-23T06:36:17.496 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-02-23T06:36:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-02-23T06:36:17.498 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-02-23T06:36:17.499 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-02-23T06:36:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-02-23T06:36:17.501 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-02-23T06:36:17.502 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-02-23T06:36:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-02-23T06:36:17.504 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:17.505 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:17.505 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:17.505 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:17.505 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:17.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:17.485+0000 7fe859d368c0 -1 shutting down 2024-02-23T06:36:17.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:17.486+0000 7fe7339b7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70227, si_uid : 1000, si_addr0x3e800011253, si_status0 2024-02-23T06:36:17.578 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (93 ms) 2024-02-23T06:36:17.579 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 11 tests from LibRGW (1063 ms total) 2024-02-23T06:36:17.579 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:17.579 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:17.579 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 11 tests from 1 test suite ran. (1063 ms total) 2024-02-23T06:36:17.579 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 11 tests. 2024-02-23T06:36:17.585 INFO:tasks.workunit.client.0.smithi142.stdout:phase 4.2 2024-02-23T06:36:17.605 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 11 tests from 1 test suite. 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 11 tests from LibRGW 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.TVAR 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:read i1: 64001 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:read s1: blunderbuss 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-02-23T06:36:17.606 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:17.613 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:17.613 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:17.786 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (181 ms) 2024-02-23T06:36:17.786 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:17.786 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:17.787 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-02-23T06:36:17.795 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-02-23T06:36:17.795 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-02-23T06:36:17.795 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-02-23T06:36:17.795 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-02-23T06:36:17.795 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-02-23T06:36:17.796 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-02-23T06:36:17.798 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-02-23T06:36:17.799 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-02-23T06:36:17.800 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-02-23T06:36:17.801 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-02-23T06:36:17.802 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-02-23T06:36:17.803 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-02-23T06:36:17.804 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-02-23T06:36:17.805 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:17.797+0000 7faab9f268c0 -1 shutting down 2024-02-23T06:36:17.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:17.798+0000 7fa993bb7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70844, si_uid : 1000, si_addr0x3e8000114bc, si_status0 2024-02-23T06:36:17.860 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (63 ms) 2024-02-23T06:36:17.860 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 11 tests from LibRGW (256 ms total) 2024-02-23T06:36:17.861 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:17.861 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:17.861 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 11 tests from 1 test suite ran. (256 ms total) 2024-02-23T06:36:17.861 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 11 tests. 2024-02-23T06:36:17.865 INFO:tasks.workunit.client.0.smithi142.stdout:phase 5.1 2024-02-23T06:36:17.894 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 19 tests from 1 test suite. 2024-02-23T06:36:17.895 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:17.895 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 19 tests from LibRGW 2024-02-23T06:36:17.895 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:17.904 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:17.904 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:18.077 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-02-23T06:36:18.077 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:18.077 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:18.077 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-02-23T06:36:18.087 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-02-23T06:36:18.087 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-02-23T06:36:18.090 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-02-23T06:36:18.091 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-02-23T06:36:18.091 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-02-23T06:36:18.091 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-02-23T06:36:18.092 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-02-23T06:36:18.092 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-02-23T06:36:18.093 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-02-23T06:36:18.093 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-02-23T06:36:18.097 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-02-23T06:36:18.097 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-02-23T06:36:18.099 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-02-23T06:36:18.099 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-02-23T06:36:18.099 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-02-23T06:36:18.099 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITEV 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READV 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READV (0 ms) 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:18.100 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:18.101 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:18.101 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:18.101 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:18.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.099+0000 7ff47623b8c0 -1 shutting down 2024-02-23T06:36:18.101 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.100+0000 7ff34f7b7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71461, si_uid : 1000, si_addr0x3e800011725, si_status0 2024-02-23T06:36:18.151 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (53 ms) 2024-02-23T06:36:18.152 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 19 tests from LibRGW (257 ms total) 2024-02-23T06:36:18.152 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:18.152 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:18.152 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 19 tests from 1 test suite ran. (257 ms total) 2024-02-23T06:36:18.152 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 19 tests. 2024-02-23T06:36:18.157 INFO:tasks.workunit.client.0.smithi142.stdout:phase 5.2 2024-02-23T06:36:18.185 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] Running 19 tests from 1 test suite. 2024-02-23T06:36:18.185 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment set-up. 2024-02-23T06:36:18.186 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 19 tests from LibRGW 2024-02-23T06:36:18.186 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.INIT 2024-02-23T06:36:18.193 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:18.193 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:18.554 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.INIT (368 ms) 2024-02-23T06:36:18.554 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.MOUNT 2024-02-23T06:36:18.555 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-02-23T06:36:18.555 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-02-23T06:36:18.555 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-02-23T06:36:18.555 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-02-23T06:36:18.559 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-02-23T06:36:18.559 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-02-23T06:36:18.560 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.WRITEV 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READV 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READV (0 ms) 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-02-23T06:36:18.561 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-02-23T06:36:18.564 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-02-23T06:36:18.564 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-02-23T06:36:18.589 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.DELETE_BUCKET (25 ms) 2024-02-23T06:36:18.590 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.CLEANUP 2024-02-23T06:36:18.590 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-02-23T06:36:18.590 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.UMOUNT 2024-02-23T06:36:18.590 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-02-23T06:36:18.590 INFO:tasks.workunit.client.0.smithi142.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-02-23T06:36:18.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.589+0000 7f1d1cac18c0 -1 shutting down 2024-02-23T06:36:18.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.591+0000 7f1bf5bb7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72078, si_uid : 1000, si_addr0x3e80001198e, si_status0 2024-02-23T06:36:18.719 INFO:tasks.workunit.client.0.smithi142.stdout:[ OK ] LibRGW.SHUTDOWN (129 ms) 2024-02-23T06:36:18.719 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] 19 tests from LibRGW (533 ms total) 2024-02-23T06:36:18.719 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:18.719 INFO:tasks.workunit.client.0.smithi142.stdout:[----------] Global test environment tear-down 2024-02-23T06:36:18.719 INFO:tasks.workunit.client.0.smithi142.stdout:[==========] 19 tests from 1 test suite ran. (533 ms total) 2024-02-23T06:36:18.719 INFO:tasks.workunit.client.0.smithi142.stdout:[ PASSED ] 19 tests. 2024-02-23T06:36:18.725 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:36:18.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:36:18.766 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-02-23T06:36:18.767 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-02-23T06:36:18.767 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-02-23T06:36:18.837 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -z ']' 2024-02-23T06:36:18.837 INFO:tasks.workunit.client.0.smithi142.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-02-23T06:36:18.837 INFO:tasks.workunit.client.0.smithi142.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-02-23T06:36:18.837 INFO:tasks.workunit.client.0.smithi142.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-02-23T06:36:18.837 INFO:tasks.workunit.client.0.smithi142.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-02-23T06:36:18.837 INFO:tasks.workunit.client.0.smithi142.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-02-23T06:36:18.874 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:36:18.874 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.907+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 20 realm 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.908+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.909+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.909+0000 7f0c43630800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:36:18.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.909+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.910+0000 7f0c43630800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:36:18.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.910+0000 7f0c43630800 20 searching for the correct realm 2024-02-23T06:36:18.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.914+0000 7f0c35e4a640 0 -- 172.21.15.142:0/4189498821 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f0c3007d040 msgr2=0x7f0c3006bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:36:18.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.917+0000 7f0c35e4a640 0 -- 172.21.15.142:0/4189498821 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f0b08077cd0 msgr2=0x7f0b0807a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:36:18.921 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.920+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 zone default found 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 4 Realm: () 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 zonegroup default 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.921+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 started sync module instance, tier type = 2024-02-23T06:36:18.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.922+0000 7f0c43630800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:36:18.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=0 2024-02-23T06:36:18.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=1 2024-02-23T06:36:18.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=2 2024-02-23T06:36:18.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=3 2024-02-23T06:36:18.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=4 2024-02-23T06:36:18.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=5 2024-02-23T06:36:18.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.931+0000 7f0c43630800 20 add_watcher() i=6 2024-02-23T06:36:18.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.932+0000 7f0c43630800 20 add_watcher() i=7 2024-02-23T06:36:18.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.932+0000 7f0c43630800 2 all 8 watchers are set, enabling cache 2024-02-23T06:36:18.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.933+0000 7f0af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 5 note: GC not initialized 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0a6f7fe640 20 reqs_thread_entry: start 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 init_complete bucket index max shards: 11 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 Filter name: none 2024-02-23T06:36:18.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0a6d7fa640 20 reqs_thread_entry: start 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.934+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 20 rados->read ofs=0 len=0 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-02-23T06:36:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.935+0000 7f0c43630800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-02-23T06:36:18.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.936+0000 7f0c43630800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-02-23T06:36:18.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.936+0000 7f0c43630800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-02-23T06:36:18.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.936+0000 7f0c43630800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-02-23T06:36:18.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.936+0000 7f0b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987528 cookie 94041276670848 notifier 5766 bl.length()=644 2024-02-23T06:36:18.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.936+0000 7f0b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-02-23T06:36:18.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.936+0000 7f0b21ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-02-23T06:36:18.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.938+0000 7f0c43630800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.938+0000 7f0c43630800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.938+0000 7f0c43630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.939+0000 7f0b217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987527 cookie 94041276654624 notifier 5766 bl.length()=187 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.939+0000 7f0b217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.939+0000 7f0b217fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.940+0000 7f0c43630800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.940+0000 7f0c43630800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.940+0000 7f0c43630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.940+0000 7f0b217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987528 cookie 94041276654624 notifier 5766 bl.length()=197 2024-02-23T06:36:18.943 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.940+0000 7f0b217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.940+0000 7f0b217fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout: "user_id": "ceph-test-maven", 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout: "display_name": "maven test user", 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout: "email": "sigv4@example.com", 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout: "suspended": 0, 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout: "max_buckets": 1000, 2024-02-23T06:36:18.944 INFO:tasks.workunit.client.0.smithi142.stdout: "subusers": [], 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "keys": [ 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: { 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "user": "ceph-test-maven", 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "active": true 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: ], 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "swift_keys": [], 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "caps": [], 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "op_mask": "read, write, delete", 2024-02-23T06:36:18.945 INFO:tasks.workunit.client.0.smithi142.stdout: "default_placement": "", 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "default_storage_class": "", 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "placement_tags": [], 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_quota": { 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "enabled": false, 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size": -1, 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "max_objects": -1 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "user_quota": { 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "enabled": false, 2024-02-23T06:36:18.946 INFO:tasks.workunit.client.0.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size": -1, 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: "max_objects": -1 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: "temp_url_keys": [], 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: "type": "rgw", 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: "mfa_ids": [] 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:36:18.947 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.942+0000 7f0af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.944+0000 7f0c43630800 20 remove_watcher() i=0 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.944+0000 7f0c43630800 2 removed watcher, disabling cache 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.944+0000 7f0c43630800 20 remove_watcher() i=1 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.945+0000 7f0c43630800 20 remove_watcher() i=2 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.946+0000 7f0c43630800 20 remove_watcher() i=3 2024-02-23T06:36:18.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.947+0000 7f0c43630800 20 remove_watcher() i=4 2024-02-23T06:36:18.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.948+0000 7f0c43630800 20 remove_watcher() i=5 2024-02-23T06:36:18.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.949+0000 7f0c43630800 20 remove_watcher() i=6 2024-02-23T06:36:18.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:36:18.950+0000 7f0c43630800 20 remove_watcher() i=7 2024-02-23T06:36:18.960 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -z ']' 2024-02-23T06:36:18.960 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-02-23T06:36:18.960 INFO:tasks.workunit.client.0.smithi142.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-02-23T06:36:18.961 INFO:tasks.workunit.client.0.smithi142.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi142.front.sepia.ceph.com:80 2024-02-23T06:36:18.961 INFO:tasks.workunit.client.0.smithi142.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi142.front.sepia.ceph.com:80 2024-02-23T06:36:18.961 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-02-23T06:36:18.961 INFO:tasks.workunit.client.0.smithi142.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-02-23T06:36:18.961 INFO:tasks.workunit.client.0.smithi142.stderr:+ ./mvnw clean package 2024-02-23T06:36:18.969 INFO:tasks.workunit.client.0.smithi142.stdout:Warning: JAVA_HOME environment variable is not set. 2024-02-23T06:36:20.575 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Scanning for projects... 2024-02-23T06:36:20.684 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-02-23T06:36:20.774 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 61 kB/s) 2024-02-23T06:36:20.785 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-02-23T06:36:20.835 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.7 MB/s) 2024-02-23T06:36:20.842 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-02-23T06:36:20.866 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.2 MB/s) 2024-02-23T06:36:20.889 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:20.889 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-02-23T06:36:20.889 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Building jcksum 1.0 2024-02-23T06:36:20.889 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] from pom.xml 2024-02-23T06:36:20.889 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-02-23T06:36:20.892 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-02-23T06:36:20.910 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 279 kB/s) 2024-02-23T06:36:20.916 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-02-23T06:36:20.935 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 521 kB/s) 2024-02-23T06:36:20.939 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-02-23T06:36:20.958 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.3 MB/s) 2024-02-23T06:36:20.965 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-02-23T06:36:20.984 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-02-23T06:36:20.995 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-02-23T06:36:21.014 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.0 MB/s) 2024-02-23T06:36:21.022 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-02-23T06:36:21.041 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 429 kB/s) 2024-02-23T06:36:21.045 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-02-23T06:36:21.063 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-02-23T06:36:21.065 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-02-23T06:36:21.085 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.3 MB/s) 2024-02-23T06:36:21.090 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-02-23T06:36:21.109 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.1 MB/s) 2024-02-23T06:36:21.116 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-02-23T06:36:21.135 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.6 MB/s) 2024-02-23T06:36:21.145 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-02-23T06:36:21.164 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 517 kB/s) 2024-02-23T06:36:21.169 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-02-23T06:36:21.190 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.1 MB/s) 2024-02-23T06:36:21.198 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-02-23T06:36:21.217 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 280 kB/s) 2024-02-23T06:36:21.219 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-02-23T06:36:21.237 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-02-23T06:36:21.240 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-02-23T06:36:21.259 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-02-23T06:36:21.264 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-02-23T06:36:21.283 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.2 MB/s) 2024-02-23T06:36:21.292 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-02-23T06:36:21.309 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-02-23T06:36:21.313 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-02-23T06:36:21.336 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.9 MB/s) 2024-02-23T06:36:21.343 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-02-23T06:36:21.364 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 322 kB/s) 2024-02-23T06:36:21.367 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-02-23T06:36:21.385 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 550 kB/s) 2024-02-23T06:36:21.388 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-02-23T06:36:21.407 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-02-23T06:36:21.410 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-02-23T06:36:21.428 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-02-23T06:36:21.433 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-02-23T06:36:21.450 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-02-23T06:36:21.464 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-02-23T06:36:21.482 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-02-23T06:36:21.484 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-02-23T06:36:21.516 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 666 kB/s) 2024-02-23T06:36:21.520 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-02-23T06:36:21.538 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-02-23T06:36:21.545 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-02-23T06:36:21.563 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-02-23T06:36:21.565 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-02-23T06:36:21.583 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 86 kB/s) 2024-02-23T06:36:21.585 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-02-23T06:36:21.602 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-02-23T06:36:21.606 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-02-23T06:36:21.624 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-02-23T06:36:21.628 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-02-23T06:36:21.645 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-02-23T06:36:21.649 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-02-23T06:36:21.667 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-02-23T06:36:21.671 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-02-23T06:36:21.688 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-02-23T06:36:21.692 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-02-23T06:36:21.709 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-02-23T06:36:21.713 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-02-23T06:36:21.730 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-02-23T06:36:21.734 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-02-23T06:36:21.752 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 64 kB/s) 2024-02-23T06:36:21.754 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-02-23T06:36:21.771 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-02-23T06:36:21.773 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-02-23T06:36:21.791 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-02-23T06:36:21.793 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-02-23T06:36:21.811 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-02-23T06:36:21.815 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-02-23T06:36:21.833 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 129 kB/s) 2024-02-23T06:36:21.837 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-02-23T06:36:21.855 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-02-23T06:36:21.859 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-02-23T06:36:21.876 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-02-23T06:36:21.880 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-02-23T06:36:21.897 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-02-23T06:36:21.901 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-02-23T06:36:21.918 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 205 kB/s) 2024-02-23T06:36:21.922 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-02-23T06:36:21.940 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-02-23T06:36:21.942 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-02-23T06:36:21.959 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 142 kB/s) 2024-02-23T06:36:21.963 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-02-23T06:36:21.980 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-02-23T06:36:21.984 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-02-23T06:36:22.001 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-02-23T06:36:22.005 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-02-23T06:36:22.021 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-02-23T06:36:22.025 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-02-23T06:36:22.043 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-02-23T06:36:22.046 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-02-23T06:36:22.065 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-02-23T06:36:22.066 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-02-23T06:36:22.082 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-02-23T06:36:22.086 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-02-23T06:36:22.103 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-02-23T06:36:22.104 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-02-23T06:36:22.122 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-02-23T06:36:22.124 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-02-23T06:36:22.141 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-02-23T06:36:22.144 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-02-23T06:36:22.161 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-02-23T06:36:22.164 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-02-23T06:36:22.181 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-02-23T06:36:22.183 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-02-23T06:36:22.200 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-02-23T06:36:22.203 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-02-23T06:36:22.220 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-02-23T06:36:22.222 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-02-23T06:36:22.242 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.6 MB/s) 2024-02-23T06:36:22.247 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-02-23T06:36:22.264 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-02-23T06:36:22.268 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-02-23T06:36:22.287 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-02-23T06:36:22.288 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-02-23T06:36:22.308 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.2 MB/s) 2024-02-23T06:36:22.311 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-02-23T06:36:22.328 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-02-23T06:36:22.332 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-02-23T06:36:22.349 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-02-23T06:36:22.351 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-02-23T06:36:22.370 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.1 MB/s) 2024-02-23T06:36:22.376 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-02-23T06:36:22.394 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 202 kB/s) 2024-02-23T06:36:22.396 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-02-23T06:36:22.413 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-02-23T06:36:22.416 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-02-23T06:36:22.434 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 169 kB/s) 2024-02-23T06:36:22.436 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-02-23T06:36:22.454 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-02-23T06:36:22.456 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-02-23T06:36:22.473 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-02-23T06:36:22.475 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-02-23T06:36:22.492 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-02-23T06:36:22.495 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-02-23T06:36:22.512 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-02-23T06:36:22.514 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-02-23T06:36:22.531 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-02-23T06:36:22.532 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-02-23T06:36:22.550 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-02-23T06:36:22.552 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-02-23T06:36:22.569 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-02-23T06:36:22.571 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-02-23T06:36:22.588 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-02-23T06:36:22.591 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-02-23T06:36:22.608 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-02-23T06:36:22.611 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-02-23T06:36:22.628 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-02-23T06:36:22.630 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-02-23T06:36:22.647 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-02-23T06:36:22.649 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-02-23T06:36:22.666 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-02-23T06:36:22.668 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-02-23T06:36:22.685 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-02-23T06:36:22.686 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-02-23T06:36:22.704 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-02-23T06:36:22.720 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 31 MB/s) 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.7 MB/s) 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 422 kB/s) 2024-02-23T06:36:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-02-23T06:36:22.908 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (2): 8.3/16 kB | 1.4/49 kB Progress (2): 9.7/16 kB | 1.4/49 kB Progress (2): 9.7/16 kB | 2.8/49 kB Progress (2): 11/16 kB | 2.8/49 kB Progress (2): 11/16 kB | 4.1/49 kB Progress (2): 12/16 kB | 4.1/49 kB Progress (2): 12/16 kB | 5.5/49 kB Progress (2): 14/16 kB | 5.5/49 kB Progress (2): 14/16 kB | 6.9/49 kB Progress (2): 15/16 kB | 6.9/49 kB Progress (2): 16 kB | 6.9/49 kB Progress (3): 16 kB | 6.9/49 kB | 16/98 kB Progress (3): 16 kB | 8.3/49 kB | 16/98 kB Progress (3): 16 kB | 9.7/49 kB | 16/98 kB Progress (3): 16 kB | 11/49 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 292 kB/s) 2024-02-23T06:36:22.908 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 12/49 kB | 16/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-02-23T06:36:22.909 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 14/49 kB | 16/98 kB Progress (2): 15/49 kB | 16/98 kB Progress (2): 16/49 kB | 16/98 kB Progress (2): 17/49 kB | 16/98 kB Progress (2): 19/49 kB | 16/98 kB Progress (2): 20/49 kB | 16/98 kB Progress (2): 21/49 kB | 16/98 kB Progress (2): 23/49 kB | 16/98 kB Progress (2): 24/49 kB | 16/98 kB Progress (2): 25/49 kB | 16/98 kB Progress (2): 27/49 kB | 16/98 kB Progress (3): 27/49 kB | 16/98 kB | 16/782 kB Progress (3): 28/49 kB | 16/98 kB | 16/782 kB Progress (3): 28/49 kB | 16/98 kB | 33/782 kB Progress (3): 30/49 kB | 16/98 kB | 33/782 kB Progress (3): 30/49 kB | 16/98 kB | 49/782 kB Progress (3): 30/49 kB | 16/98 kB | 66/782 kB Progress (3): 30/49 kB | 16/98 kB | 82/782 kB Progress (3): 30/49 kB | 16/98 kB | 98/782 kB Progress (4): 30/49 kB | 16/98 kB | 98/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 115/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 131/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 147/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 164/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 180/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 197/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 213/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 229/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 246/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 262/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 279/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 295/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 311/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 328/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 344/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 360/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 377/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 393/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 410/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 426/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 442/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 459/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 475/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 492/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 508/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 524/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 541/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 557/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 573/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 585/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 601/782 kB | 16/71 kB Progress (4): 30/49 kB | 16/98 kB | 617/782 kB | 16/71 kB Progress (4): 30/49 kB | 33/98 kB | 617/782 kB | 16/71 kB Progress (4): 30/49 kB | 33/98 kB | 634/782 kB | 16/71 kB Progress (4): 30/49 kB | 33/98 kB | 650/782 kB | 16/71 kB Progress (4): 31/49 kB | 33/98 kB | 650/782 kB | 16/71 kB Progress (4): 32/49 kB | 33/98 kB | 650/782 kB | 16/71 kB Progress (4): 34/49 kB | 33/98 kB | 650/782 kB | 16/71 kB Progress (4): 34/49 kB | 33/98 kB | 667/782 kB | 16/71 kB Progress (4): 35/49 kB | 33/98 kB | 667/782 kB | 16/71 kB Progress (4): 36/49 kB | 33/98 kB | 667/782 kB | 16/71 kB Progress (4): 38/49 kB | 33/98 kB | 667/782 kB | 16/71 kB Progress (4): 39/49 kB | 33/98 kB | 667/782 kB | 16/71 kB Progress (4): 39/49 kB | 33/98 kB | 683/782 kB | 16/71 kB Progress (4): 39/49 kB | 33/98 kB | 699/782 kB | 16/71 kB Progress (4): 41/49 kB | 33/98 kB | 699/782 kB | 16/71 kB Progress (4): 41/49 kB | 33/98 kB | 716/782 kB | 16/71 kB Progress (4): 42/49 kB | 33/98 kB | 716/782 kB | 16/71 kB Progress (4): 42/49 kB | 49/98 kB | 716/782 kB | 16/71 kB Progress (4): 43/49 kB | 49/98 kB | 716/782 kB | 16/71 kB Progress (4): 43/49 kB | 49/98 kB | 732/782 kB | 16/71 kB Progress (4): 45/49 kB | 49/98 kB | 732/782 kB | 16/71 kB Progress (4): 45/49 kB | 49/98 kB | 749/782 kB | 16/71 kB Progress (5): 45/49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 1.4/11 kB Progress (5): 45/49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 2.8/11 kB Progress (5): 46/49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 2.8/11 kB Progress (5): 48/49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 2.8/11 kB Progress (5): 49/49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 2.8/11 kB Progress (5): 49/49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 4.1/11 kB Progress (5): 49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 4.1/11 kB Progress (5): 49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 5.5/11 kB Progress (5): 49 kB | 49/98 kB | 749/782 kB | 16/71 kB | 6.9/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 693 kB/s) 2024-02-23T06:36:22.909 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-02-23T06:36:22.909 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (4): 49/98 kB | 749/782 kB | 16/71 kB | 8.3/11 kB Progress (4): 49/98 kB | 749/782 kB | 16/71 kB | 9.7/11 kB Progress (4): 49/98 kB | 749/782 kB | 16/71 kB | 11/11 kB Progress (4): 49/98 kB | 749/782 kB | 16/71 kB | 11 kB Progress (4): 49/98 kB | 765/782 kB | 16/71 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 156 kB/s) 2024-02-23T06:36:22.909 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-02-23T06:36:22.910 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 49/98 kB | 765/782 kB | 33/71 kB Progress (3): 49/98 kB | 781/782 kB | 33/71 kB Progress (3): 49/98 kB | 782 kB | 33/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-02-23T06:36:22.910 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-02-23T06:36:22.913 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 49/98 kB | 49/71 kB Progress (2): 66/98 kB | 49/71 kB Progress (2): 82/98 kB | 49/71 kB Progress (2): 98 kB | 49/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.1 MB/s) 2024-02-23T06:36:22.913 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-02-23T06:36:22.916 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 784 kB/s) 2024-02-23T06:36:22.916 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-02-23T06:36:22.920 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/30 kB Progress (2): 16/30 kB | 16/81 kB Progress (3): 16/30 kB | 16/81 kB | 16/205 kB Progress (3): 16/30 kB | 33/81 kB | 16/205 kB Progress (3): 16/30 kB | 49/81 kB | 16/205 kB Progress (3): 30 kB | 49/81 kB | 16/205 kB Progress (3): 30 kB | 66/81 kB | 16/205 kB Progress (3): 30 kB | 81 kB | 16/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 328 kB/s) 2024-02-23T06:36:22.920 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-02-23T06:36:22.920 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 874 kB/s) 2024-02-23T06:36:22.920 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-02-23T06:36:22.933 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 125 kB/s) 2024-02-23T06:36:22.934 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-02-23T06:36:22.941 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 49/205 kB | 16/798 kB Progress (2): 49/205 kB | 33/798 kB Progress (2): 66/205 kB | 33/798 kB Progress (2): 66/205 kB | 49/798 kB Progress (3): 66/205 kB | 49/798 kB | 16/182 kB Progress (3): 66/205 kB | 49/798 kB | 33/182 kB Progress (3): 66/205 kB | 66/798 kB | 33/182 kB Progress (3): 66/205 kB | 66/798 kB | 49/182 kB Progress (3): 82/205 kB | 66/798 kB | 49/182 kB Progress (3): 82/205 kB | 66/798 kB | 66/182 kB Progress (3): 82/205 kB | 82/798 kB | 66/182 kB Progress (3): 82/205 kB | 82/798 kB | 82/182 kB Progress (3): 82/205 kB | 82/798 kB | 98/182 kB Progress (3): 82/205 kB | 82/798 kB | 115/182 kB Progress (3): 98/205 kB | 82/798 kB | 115/182 kB Progress (3): 98/205 kB | 82/798 kB | 131/182 kB Progress (3): 98/205 kB | 82/798 kB | 147/182 kB Progress (3): 98/205 kB | 82/798 kB | 164/182 kB Progress (4): 98/205 kB | 82/798 kB | 164/182 kB | 16/151 kB Progress (4): 98/205 kB | 82/798 kB | 180/182 kB | 16/151 kB Progress (4): 98/205 kB | 82/798 kB | 182 kB | 16/151 kB Progress (4): 98/205 kB | 98/798 kB | 182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-02-23T06:36:22.941 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-02-23T06:36:22.952 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 98/205 kB | 98/798 kB | 33/151 kB Progress (3): 98/205 kB | 98/798 kB | 49/151 kB Progress (3): 115/205 kB | 98/798 kB | 49/151 kB Progress (3): 115/205 kB | 115/798 kB | 49/151 kB Progress (3): 131/205 kB | 115/798 kB | 49/151 kB Progress (3): 131/205 kB | 131/798 kB | 49/151 kB Progress (3): 147/205 kB | 131/798 kB | 49/151 kB Progress (3): 164/205 kB | 131/798 kB | 49/151 kB Progress (3): 164/205 kB | 147/798 kB | 49/151 kB Progress (3): 164/205 kB | 164/798 kB | 49/151 kB Progress (3): 180/205 kB | 164/798 kB | 49/151 kB Progress (3): 180/205 kB | 180/798 kB | 49/151 kB Progress (3): 197/205 kB | 180/798 kB | 49/151 kB Progress (3): 197/205 kB | 197/798 kB | 49/151 kB Progress (3): 205 kB | 197/798 kB | 49/151 kB Progress (3): 205 kB | 213/798 kB | 49/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.6 MB/s) 2024-02-23T06:36:22.953 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-02-23T06:36:22.959 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 229/798 kB | 49/151 kB Progress (2): 246/798 kB | 49/151 kB Progress (2): 246/798 kB | 66/151 kB Progress (2): 256/798 kB | 66/151 kB Progress (2): 272/798 kB | 66/151 kB Progress (2): 272/798 kB | 82/151 kB Progress (2): 289/798 kB | 82/151 kB Progress (2): 289/798 kB | 98/151 kB Progress (2): 305/798 kB | 98/151 kB Progress (2): 305/798 kB | 115/151 kB Progress (3): 305/798 kB | 115/151 kB | 16/30 kB Progress (3): 305/798 kB | 115/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 229 kB/s) 2024-02-23T06:36:22.959 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-02-23T06:36:22.960 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 305/798 kB | 131/151 kB Progress (3): 305/798 kB | 131/151 kB | 16/27 kB Progress (3): 305/798 kB | 147/151 kB | 16/27 kB Progress (3): 305/798 kB | 151 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-02-23T06:36:22.961 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-02-23T06:36:22.961 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 305/798 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 204 kB/s) 2024-02-23T06:36:22.961 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-02-23T06:36:22.978 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 321/798 kB Progress (1): 338/798 kB Progress (1): 354/798 kB Progress (1): 370/798 kB Progress (1): 387/798 kB Progress (1): 403/798 kB Progress (1): 420/798 kB Progress (1): 436/798 kB Progress (1): 452/798 kB Progress (1): 469/798 kB Progress (1): 485/798 kB Progress (1): 502/798 kB Progress (1): 518/798 kB Progress (1): 534/798 kB Progress (1): 551/798 kB Progress (1): 567/798 kB Progress (1): 583/798 kB Progress (1): 600/798 kB Progress (1): 616/798 kB Progress (1): 633/798 kB Progress (1): 649/798 kB Progress (1): 665/798 kB Progress (1): 682/798 kB Progress (1): 698/798 kB Progress (2): 698/798 kB | 16/385 kB Progress (2): 698/798 kB | 32/385 kB Progress (2): 698/798 kB | 49/385 kB Progress (2): 698/798 kB | 65/385 kB Progress (2): 698/798 kB | 81/385 kB Progress (2): 698/798 kB | 98/385 kB Progress (2): 698/798 kB | 114/385 kB Progress (2): 698/798 kB | 130/385 kB Progress (2): 698/798 kB | 147/385 kB Progress (2): 698/798 kB | 163/385 kB Progress (2): 698/798 kB | 180/385 kB Progress (2): 698/798 kB | 196/385 kB Progress (2): 715/798 kB | 196/385 kB Progress (3): 715/798 kB | 196/385 kB | 13 kB Progress (3): 731/798 kB | 196/385 kB | 13 kB Progress (3): 731/798 kB | 212/385 kB | 13 kB Progress (3): 747/798 kB | 212/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 88 kB/s) 2024-02-23T06:36:22.978 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-02-23T06:36:22.980 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 747/798 kB | 229/385 kB Progress (2): 764/798 kB | 229/385 kB Progress (2): 780/798 kB | 229/385 kB Progress (2): 780/798 kB | 245/385 kB Progress (2): 796/798 kB | 245/385 kB Progress (2): 798 kB | 245/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.3 MB/s) 2024-02-23T06:36:22.980 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-02-23T06:36:22.982 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 245/385 kB | 16/75 kB Progress (2): 245/385 kB | 33/75 kB Progress (2): 245/385 kB | 49/75 kB Progress (2): 245/385 kB | 66/75 kB Progress (2): 245/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 487 kB/s) 2024-02-23T06:36:22.982 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-02-23T06:36:22.989 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 245/385 kB | 16/780 kB Progress (2): 245/385 kB | 32/780 kB Progress (2): 262/385 kB | 32/780 kB Progress (2): 278/385 kB | 32/780 kB Progress (2): 294/385 kB | 32/780 kB Progress (2): 311/385 kB | 32/780 kB Progress (2): 327/385 kB | 32/780 kB Progress (2): 343/385 kB | 32/780 kB Progress (2): 343/385 kB | 49/780 kB Progress (2): 360/385 kB | 49/780 kB Progress (2): 376/385 kB | 49/780 kB Progress (2): 385 kB | 49/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.4 MB/s) 2024-02-23T06:36:22.990 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-02-23T06:36:23.004 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 65/780 kB Progress (2): 65/780 kB | 16/329 kB Progress (2): 65/780 kB | 33/329 kB Progress (2): 65/780 kB | 49/329 kB Progress (2): 65/780 kB | 66/329 kB Progress (2): 65/780 kB | 82/329 kB Progress (2): 65/780 kB | 98/329 kB Progress (3): 65/780 kB | 98/329 kB | 16/501 kB Progress (3): 65/780 kB | 115/329 kB | 16/501 kB Progress (3): 65/780 kB | 115/329 kB | 33/501 kB Progress (3): 65/780 kB | 115/329 kB | 49/501 kB Progress (3): 65/780 kB | 131/329 kB | 49/501 kB Progress (3): 65/780 kB | 131/329 kB | 66/501 kB Progress (3): 65/780 kB | 147/329 kB | 66/501 kB Progress (3): 65/780 kB | 147/329 kB | 82/501 kB Progress (3): 65/780 kB | 164/329 kB | 82/501 kB Progress (3): 65/780 kB | 164/329 kB | 98/501 kB Progress (3): 65/780 kB | 180/329 kB | 98/501 kB Progress (3): 65/780 kB | 180/329 kB | 115/501 kB Progress (3): 65/780 kB | 180/329 kB | 131/501 kB Progress (3): 65/780 kB | 180/329 kB | 147/501 kB Progress (3): 65/780 kB | 197/329 kB | 147/501 kB Progress (3): 65/780 kB | 197/329 kB | 164/501 kB Progress (3): 65/780 kB | 213/329 kB | 164/501 kB Progress (3): 65/780 kB | 213/329 kB | 180/501 kB Progress (3): 65/780 kB | 229/329 kB | 180/501 kB Progress (3): 65/780 kB | 229/329 kB | 197/501 kB Progress (3): 65/780 kB | 229/329 kB | 213/501 kB Progress (3): 65/780 kB | 229/329 kB | 229/501 kB Progress (3): 65/780 kB | 229/329 kB | 246/501 kB Progress (3): 65/780 kB | 229/329 kB | 256/501 kB Progress (3): 65/780 kB | 246/329 kB | 256/501 kB Progress (3): 65/780 kB | 246/329 kB | 272/501 kB Progress (3): 65/780 kB | 262/329 kB | 272/501 kB Progress (3): 65/780 kB | 262/329 kB | 289/501 kB Progress (3): 65/780 kB | 279/329 kB | 289/501 kB Progress (3): 81/780 kB | 279/329 kB | 289/501 kB Progress (3): 81/780 kB | 279/329 kB | 305/501 kB Progress (3): 81/780 kB | 295/329 kB | 305/501 kB Progress (3): 81/780 kB | 295/329 kB | 321/501 kB Progress (4): 81/780 kB | 295/329 kB | 321/501 kB | 16/354 kB Progress (4): 81/780 kB | 295/329 kB | 338/501 kB | 16/354 kB Progress (4): 81/780 kB | 295/329 kB | 354/501 kB | 16/354 kB Progress (4): 81/780 kB | 295/329 kB | 354/501 kB | 32/354 kB Progress (4): 81/780 kB | 295/329 kB | 370/501 kB | 32/354 kB Progress (4): 81/780 kB | 295/329 kB | 387/501 kB | 32/354 kB Progress (4): 81/780 kB | 311/329 kB | 387/501 kB | 32/354 kB Progress (4): 81/780 kB | 311/329 kB | 403/501 kB | 32/354 kB Progress (4): 81/780 kB | 328/329 kB | 403/501 kB | 32/354 kB Progress (4): 81/780 kB | 328/329 kB | 420/501 kB | 32/354 kB Progress (4): 81/780 kB | 329 kB | 420/501 kB | 32/354 kB Progress (4): 81/780 kB | 329 kB | 436/501 kB | 32/354 kB Progress (4): 81/780 kB | 329 kB | 436/501 kB | 49/354 kB Progress (4): 81/780 kB | 329 kB | 452/501 kB | 49/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-02-23T06:36:23.004 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 98/780 kB | 452/501 kB | 49/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-02-23T06:36:23.005 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 98/780 kB | 452/501 kB | 65/354 kB Progress (3): 98/780 kB | 469/501 kB | 65/354 kB Progress (3): 114/780 kB | 469/501 kB | 65/354 kB Progress (3): 114/780 kB | 469/501 kB | 81/354 kB Progress (3): 114/780 kB | 485/501 kB | 81/354 kB Progress (3): 131/780 kB | 485/501 kB | 81/354 kB Progress (3): 131/780 kB | 485/501 kB | 98/354 kB Progress (3): 131/780 kB | 501 kB | 98/354 kB Progress (3): 147/780 kB | 501 kB | 98/354 kB Progress (3): 147/780 kB | 501 kB | 114/354 kB Progress (3): 163/780 kB | 501 kB | 114/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-02-23T06:36:23.005 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-02-23T06:36:23.006 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 163/780 kB | 130/354 kB Progress (2): 163/780 kB | 147/354 kB Progress (3): 163/780 kB | 147/354 kB | 16/41 kB Progress (3): 163/780 kB | 163/354 kB | 16/41 kB Progress (3): 180/780 kB | 163/354 kB | 16/41 kB Progress (3): 180/780 kB | 163/354 kB | 33/41 kB Progress (3): 180/780 kB | 180/354 kB | 33/41 kB Progress (3): 180/780 kB | 180/354 kB | 41 kB Progress (3): 196/780 kB | 180/354 kB | 41 kB Progress (3): 196/780 kB | 196/354 kB | 41 kB Progress (3): 196/780 kB | 212/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 231 kB/s) 2024-02-23T06:36:23.007 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-02-23T06:36:23.019 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 212/780 kB | 212/354 kB Progress (2): 229/780 kB | 212/354 kB Progress (2): 229/780 kB | 229/354 kB Progress (2): 229/780 kB | 245/354 kB Progress (2): 245/780 kB | 245/354 kB Progress (2): 245/780 kB | 262/354 kB Progress (2): 245/780 kB | 278/354 kB Progress (2): 245/780 kB | 294/354 kB Progress (2): 262/780 kB | 294/354 kB Progress (2): 262/780 kB | 311/354 kB Progress (2): 278/780 kB | 311/354 kB Progress (2): 278/780 kB | 327/354 kB Progress (2): 294/780 kB | 327/354 kB Progress (2): 294/780 kB | 343/354 kB Progress (2): 294/780 kB | 354 kB Progress (2): 311/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-02-23T06:36:23.019 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-02-23T06:36:23.020 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 327/780 kB Progress (2): 327/780 kB | 6.4 kB Progress (2): 344/780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 33 kB/s) 2024-02-23T06:36:23.020 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-02-23T06:36:23.033 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 360/780 kB Progress (1): 376/780 kB Progress (1): 393/780 kB Progress (1): 402/780 kB Progress (1): 418/780 kB Progress (1): 435/780 kB Progress (1): 451/780 kB Progress (2): 451/780 kB | 16/211 kB Progress (2): 468/780 kB | 16/211 kB Progress (2): 468/780 kB | 32/211 kB Progress (2): 468/780 kB | 49/211 kB Progress (3): 468/780 kB | 49/211 kB | 16/586 kB Progress (3): 468/780 kB | 65/211 kB | 16/586 kB Progress (3): 468/780 kB | 65/211 kB | 33/586 kB Progress (3): 468/780 kB | 81/211 kB | 33/586 kB Progress (3): 484/780 kB | 81/211 kB | 33/586 kB Progress (3): 484/780 kB | 81/211 kB | 49/586 kB Progress (3): 484/780 kB | 98/211 kB | 49/586 kB Progress (3): 484/780 kB | 98/211 kB | 66/586 kB Progress (3): 500/780 kB | 98/211 kB | 66/586 kB Progress (3): 500/780 kB | 114/211 kB | 66/586 kB Progress (3): 500/780 kB | 114/211 kB | 82/586 kB Progress (3): 500/780 kB | 130/211 kB | 82/586 kB Progress (3): 500/780 kB | 130/211 kB | 98/586 kB Progress (3): 500/780 kB | 147/211 kB | 98/586 kB Progress (3): 500/780 kB | 147/211 kB | 115/586 kB Progress (3): 500/780 kB | 163/211 kB | 115/586 kB Progress (3): 500/780 kB | 163/211 kB | 131/586 kB Progress (3): 500/780 kB | 180/211 kB | 131/586 kB Progress (3): 500/780 kB | 180/211 kB | 147/586 kB Progress (3): 500/780 kB | 196/211 kB | 147/586 kB Progress (3): 500/780 kB | 196/211 kB | 164/586 kB Progress (3): 500/780 kB | 211 kB | 164/586 kB Progress (3): 500/780 kB | 211 kB | 180/586 kB Progress (3): 500/780 kB | 211 kB | 197/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-02-23T06:36:23.033 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 500/780 kB | 213/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-02-23T06:36:23.035 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 500/780 kB | 229/586 kB Progress (2): 500/780 kB | 246/586 kB Progress (2): 500/780 kB | 256/586 kB Progress (2): 500/780 kB | 272/586 kB Progress (2): 500/780 kB | 289/586 kB Progress (2): 500/780 kB | 305/586 kB Progress (2): 517/780 kB | 305/586 kB Progress (2): 517/780 kB | 321/586 kB Progress (2): 517/780 kB | 338/586 kB Progress (2): 533/780 kB | 338/586 kB Progress (2): 533/780 kB | 354/586 kB Progress (2): 549/780 kB | 354/586 kB Progress (2): 549/780 kB | 370/586 kB Progress (2): 549/780 kB | 387/586 kB Progress (2): 566/780 kB | 387/586 kB Progress (2): 566/780 kB | 403/586 kB Progress (2): 582/780 kB | 403/586 kB Progress (2): 582/780 kB | 420/586 kB Progress (2): 582/780 kB | 436/586 kB Progress (2): 599/780 kB | 436/586 kB Progress (2): 599/780 kB | 452/586 kB Progress (2): 615/780 kB | 452/586 kB Progress (2): 615/780 kB | 469/586 kB Progress (2): 615/780 kB | 485/586 kB Progress (2): 631/780 kB | 485/586 kB Progress (2): 631/780 kB | 502/586 kB Progress (2): 648/780 kB | 502/586 kB Progress (2): 648/780 kB | 518/586 kB Progress (2): 648/780 kB | 534/586 kB Progress (2): 664/780 kB | 534/586 kB Progress (2): 664/780 kB | 551/586 kB Progress (2): 681/780 kB | 551/586 kB Progress (2): 681/780 kB | 567/586 kB Progress (2): 681/780 kB | 583/586 kB Progress (2): 681/780 kB | 586 kB Progress (2): 697/780 kB | 586 kB Progress (2): 713/780 kB | 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-02-23T06:36:23.035 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-02-23T06:36:23.036 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 730/780 kB Progress (2): 730/780 kB | 14 kB Progress (2): 746/780 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 69 kB/s) 2024-02-23T06:36:23.036 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-02-23T06:36:23.038 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 762/780 kB Progress (1): 779/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.7 MB/s) 2024-02-23T06:36:23.038 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-02-23T06:36:23.039 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 504 kB/s) 2024-02-23T06:36:23.039 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-02-23T06:36:23.045 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 31 kB/s) 2024-02-23T06:36:23.045 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-02-23T06:36:23.055 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (2): 180/245 kB | 15 kB Progress (3): 180/245 kB | 15 kB | 16/205 kB Progress (3): 197/245 kB | 15 kB | 16/205 kB Progress (3): 197/245 kB | 15 kB | 33/205 kB Progress (3): 213/245 kB | 15 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 67 kB/s) 2024-02-23T06:36:23.068 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 229/245 kB | 33/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-02-23T06:36:23.069 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 229/245 kB | 49/205 kB Progress (2): 245 kB | 49/205 kB Progress (2): 245 kB | 66/205 kB Progress (3): 245 kB | 66/205 kB | 6.4 kB Progress (3): 245 kB | 82/205 kB | 6.4 kB Progress (4): 245 kB | 82/205 kB | 6.4 kB | 16/16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-02-23T06:36:23.070 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 98/205 kB | 6.4 kB | 16/16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 26 kB/s) 2024-02-23T06:36:23.070 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-02-23T06:36:23.071 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 115/205 kB | 16/16 kB Progress (2): 131/205 kB | 16/16 kB Progress (2): 131/205 kB | 16 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-02-23T06:36:23.071 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 147/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 68 kB/s) 2024-02-23T06:36:23.071 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 164/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-02-23T06:36:23.073 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 180/205 kB Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 839 kB/s) 2024-02-23T06:36:23.087 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/23 kB Progress (2): 17 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 67 kB/s) 2024-02-23T06:36:23.087 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 88 kB/s) 2024-02-23T06:36:23.087 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 93 kB/s) 2024-02-23T06:36:23.092 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 696 kB/s) 2024-02-23T06:36:23.111 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:23.111 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-02-23T06:36:23.117 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-02-23T06:36:23.134 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-02-23T06:36:23.136 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-02-23T06:36:23.154 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 283 kB/s) 2024-02-23T06:36:23.156 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-02-23T06:36:23.173 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-02-23T06:36:23.177 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-02-23T06:36:23.194 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-02-23T06:36:23.199 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-02-23T06:36:23.220 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.3 MB/s) 2024-02-23T06:36:23.220 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-02-23T06:36:23.241 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 9.8 MB/s) 2024-02-23T06:36:23.277 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:23.277 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-02-23T06:36:23.280 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-02-23T06:36:23.296 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-02-23T06:36:23.298 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-02-23T06:36:23.315 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-02-23T06:36:23.318 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-02-23T06:36:23.336 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 487 kB/s) 2024-02-23T06:36:23.338 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-02-23T06:36:23.355 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.4 MB/s) 2024-02-23T06:36:23.358 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-02-23T06:36:23.375 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 355 kB/s) 2024-02-23T06:36:23.377 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-02-23T06:36:23.394 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-02-23T06:36:23.397 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-02-23T06:36:23.414 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 36 kB/s) 2024-02-23T06:36:23.416 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-02-23T06:36:23.433 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-02-23T06:36:23.434 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-02-23T06:36:23.451 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-02-23T06:36:23.454 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-02-23T06:36:23.470 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-02-23T06:36:23.472 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-02-23T06:36:23.488 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-02-23T06:36:23.490 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-02-23T06:36:23.507 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-02-23T06:36:23.509 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-02-23T06:36:23.526 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 471 kB/s) 2024-02-23T06:36:23.529 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-02-23T06:36:23.546 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.1 MB/s) 2024-02-23T06:36:23.550 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-02-23T06:36:23.567 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-02-23T06:36:23.568 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-02-23T06:36:23.585 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-02-23T06:36:23.589 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-02-23T06:36:23.606 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 300 kB/s) 2024-02-23T06:36:23.612 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-02-23T06:36:23.628 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-02-23T06:36:23.629 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-02-23T06:36:23.629 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-02-23T06:36:23.629 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-02-23T06:36:23.629 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-02-23T06:36:23.629 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-02-23T06:36:23.646 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (2): 2.5 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-02-23T06:36:23.646 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-02-23T06:36:23.646 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 41 kB Progress (2): 41 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-02-23T06:36:23.646 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 33/269 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-02-23T06:36:23.648 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 33/269 kB | 16/55 kB Progress (2): 49/269 kB | 16/55 kB Progress (2): 49/269 kB | 33/55 kB Progress (3): 49/269 kB | 33/55 kB | 8.5 kB Progress (3): 66/269 kB | 33/55 kB | 8.5 kB Progress (3): 66/269 kB | 49/55 kB | 8.5 kB Progress (3): 82/269 kB | 49/55 kB | 8.5 kB Progress (3): 82/269 kB | 55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 471 kB/s) 2024-02-23T06:36:23.648 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 98/269 kB | 55 kB Progress (2): 115/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-02-23T06:36:23.649 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-02-23T06:36:23.671 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 66/587 kB Progress (1): 82/587 kB Progress (1): 98/587 kB Progress (1): 115/587 kB Progress (2): 115/587 kB | 16/327 kB Progress (2): 131/587 kB | 16/327 kB Progress (2): 131/587 kB | 33/327 kB Progress (2): 147/587 kB | 33/327 kB Progress (2): 147/587 kB | 49/327 kB Progress (2): 164/587 kB | 49/327 kB Progress (2): 180/587 kB | 49/327 kB Progress (2): 197/587 kB | 49/327 kB Progress (2): 197/587 kB | 66/327 kB Progress (2): 213/587 kB | 66/327 kB Progress (2): 213/587 kB | 82/327 kB Progress (2): 229/587 kB | 82/327 kB Progress (2): 229/587 kB | 98/327 kB Progress (2): 246/587 kB | 98/327 kB Progress (2): 246/587 kB | 115/327 kB Progress (2): 256/587 kB | 115/327 kB Progress (2): 272/587 kB | 115/327 kB Progress (2): 289/587 kB | 115/327 kB Progress (2): 305/587 kB | 115/327 kB Progress (2): 321/587 kB | 115/327 kB Progress (2): 321/587 kB | 131/327 kB Progress (2): 338/587 kB | 131/327 kB Progress (2): 338/587 kB | 147/327 kB Progress (2): 354/587 kB | 147/327 kB Progress (2): 354/587 kB | 164/327 kB Progress (2): 370/587 kB | 164/327 kB Progress (2): 370/587 kB | 180/327 kB Progress (2): 387/587 kB | 180/327 kB Progress (2): 403/587 kB | 180/327 kB Progress (2): 420/587 kB | 180/327 kB Progress (2): 436/587 kB | 180/327 kB Progress (2): 436/587 kB | 197/327 kB Progress (2): 452/587 kB | 197/327 kB Progress (2): 452/587 kB | 213/327 kB Progress (2): 469/587 kB | 213/327 kB Progress (2): 469/587 kB | 229/327 kB Progress (2): 485/587 kB | 229/327 kB Progress (2): 485/587 kB | 246/327 kB Progress (2): 502/587 kB | 246/327 kB Progress (2): 502/587 kB | 262/327 kB Progress (2): 518/587 kB | 262/327 kB Progress (2): 518/587 kB | 279/327 kB Progress (2): 534/587 kB | 279/327 kB Progress (2): 534/587 kB | 295/327 kB Progress (2): 551/587 kB | 295/327 kB Progress (2): 551/587 kB | 311/327 kB Progress (2): 567/587 kB | 311/327 kB Progress (2): 567/587 kB | 327 kB Progress (2): 583/587 kB | 327 kB Progress (2): 587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.6 MB/s) 2024-02-23T06:36:23.671 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-02-23T06:36:23.701 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-02-23T06:36:23.701 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:23.701 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-02-23T06:36:23.705 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-02-23T06:36:23.725 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 226 kB/s) 2024-02-23T06:36:23.727 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-02-23T06:36:23.744 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-02-23T06:36:23.745 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-02-23T06:36:23.762 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.9 MB/s) 2024-02-23T06:36:23.764 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-02-23T06:36:23.780 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 873 kB/s) 2024-02-23T06:36:23.782 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-02-23T06:36:23.799 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 48 kB/s) 2024-02-23T06:36:23.801 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-02-23T06:36:23.818 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-02-23T06:36:23.819 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-02-23T06:36:23.836 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.1 MB/s) 2024-02-23T06:36:23.838 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-02-23T06:36:23.856 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-02-23T06:36:23.857 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-02-23T06:36:23.875 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-02-23T06:36:23.877 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-02-23T06:36:23.895 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 139 kB/s) 2024-02-23T06:36:23.896 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-02-23T06:36:23.913 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 664 kB/s) 2024-02-23T06:36:23.916 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-02-23T06:36:23.933 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-02-23T06:36:23.935 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-02-23T06:36:23.953 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-02-23T06:36:23.955 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-02-23T06:36:23.971 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-02-23T06:36:23.973 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-02-23T06:36:23.990 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-02-23T06:36:23.992 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-02-23T06:36:24.009 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-02-23T06:36:24.012 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-02-23T06:36:24.028 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-02-23T06:36:24.031 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-02-23T06:36:24.048 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-02-23T06:36:24.051 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-02-23T06:36:24.076 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 31 kB/s) 2024-02-23T06:36:24.078 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-02-23T06:36:24.095 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 355 kB/s) 2024-02-23T06:36:24.096 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-02-23T06:36:24.114 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-02-23T06:36:24.116 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-02-23T06:36:24.133 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 71 kB/s) 2024-02-23T06:36:24.134 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-02-23T06:36:24.151 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-02-23T06:36:24.157 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-02-23T06:36:24.174 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-02-23T06:36:24.174 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-02-23T06:36:24.174 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-02-23T06:36:24.174 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-02-23T06:36:24.174 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-02-23T06:36:24.174 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-02-23T06:36:24.195 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (3): 4.2 kB | 16/55 kB | 16/27 kB Progress (3): 4.2 kB | 16/55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 234 kB/s) 2024-02-23T06:36:24.195 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 16/55 kB | 27 kB | 16/122 kB Progress (3): 32/55 kB | 27 kB | 16/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-02-23T06:36:24.195 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-02-23T06:36:24.195 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 32/55 kB | 33/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-02-23T06:36:24.195 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 49/55 kB | 33/122 kB Progress (3): 49/55 kB | 33/122 kB | 16/334 kB Progress (3): 55 kB | 33/122 kB | 16/334 kB Progress (3): 55 kB | 33/122 kB | 33/334 kB Progress (3): 55 kB | 49/122 kB | 33/334 kB Progress (3): 55 kB | 49/122 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.9 MB/s) 2024-02-23T06:36:24.196 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-02-23T06:36:24.196 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 66/122 kB | 49/334 kB Progress (2): 66/122 kB | 66/334 kB Progress (2): 82/122 kB | 66/334 kB Progress (2): 82/122 kB | 82/334 kB Progress (2): 98/122 kB | 82/334 kB Progress (2): 98/122 kB | 98/334 kB Progress (2): 115/122 kB | 98/334 kB Progress (2): 115/122 kB | 115/334 kB Progress (2): 122 kB | 115/334 kB Progress (2): 122 kB | 131/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 5.8 MB/s) 2024-02-23T06:36:24.198 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 262/334 kB Progress (1): 279/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 328/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 14 MB/s) 2024-02-23T06:36:24.208 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/23 kB Progress (2): 4.7 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 137 kB/s) 2024-02-23T06:36:24.208 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 670 kB/s) 2024-02-23T06:36:24.213 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 6.9 MB/s) 2024-02-23T06:36:24.260 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Changes detected - recompiling the module! :source 2024-02-23T06:36:24.261 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-02-23T06:36:24.852 INFO:tasks.workunit.client.0.smithi142.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-02-23T06:36:24.852 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:24.853 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-02-23T06:36:24.855 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-02-23T06:36:24.855 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:24.855 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-02-23T06:36:24.859 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-02-23T06:36:24.859 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-02-23T06:36:25.011 INFO:tasks.workunit.client.0.smithi142.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-02-23T06:36:25.011 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:25.011 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-02-23T06:36:25.015 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-02-23T06:36:25.033 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 367 kB/s) 2024-02-23T06:36:25.036 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-02-23T06:36:25.057 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 168 kB/s) 2024-02-23T06:36:25.060 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-02-23T06:36:25.082 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 155 kB/s) 2024-02-23T06:36:25.085 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-02-23T06:36:25.110 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 162 kB/s) 2024-02-23T06:36:25.114 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-02-23T06:36:25.133 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 174 kB/s) 2024-02-23T06:36:25.136 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-02-23T06:36:25.153 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-02-23T06:36:25.157 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-02-23T06:36:25.174 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 98 kB/s) 2024-02-23T06:36:25.177 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-02-23T06:36:25.203 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 84 kB/s) 2024-02-23T06:36:25.204 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-02-23T06:36:25.232 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.1 MB/s) 2024-02-23T06:36:25.234 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-02-23T06:36:25.252 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 112 kB/s) 2024-02-23T06:36:25.255 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-02-23T06:36:25.285 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 193 kB/s) 2024-02-23T06:36:25.288 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-02-23T06:36:25.321 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 71 kB/s) 2024-02-23T06:36:25.323 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-02-23T06:36:25.340 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.2 MB/s) 2024-02-23T06:36:25.342 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-02-23T06:36:25.359 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-02-23T06:36:25.360 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-02-23T06:36:25.377 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 896 kB/s) 2024-02-23T06:36:25.379 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-02-23T06:36:25.396 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 509 kB/s) 2024-02-23T06:36:25.398 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-02-23T06:36:25.415 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.5 MB/s) 2024-02-23T06:36:25.419 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-02-23T06:36:25.437 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-02-23T06:36:25.440 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-02-23T06:36:25.457 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-02-23T06:36:25.460 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-02-23T06:36:25.477 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-02-23T06:36:25.480 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-02-23T06:36:25.512 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 47 kB/s) 2024-02-23T06:36:25.513 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-02-23T06:36:25.530 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 180 kB/s) 2024-02-23T06:36:25.531 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-02-23T06:36:25.547 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.3 MB/s) 2024-02-23T06:36:25.550 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-02-23T06:36:25.567 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 398 kB/s) 2024-02-23T06:36:25.569 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-02-23T06:36:25.585 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 798 kB/s) 2024-02-23T06:36:25.588 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-02-23T06:36:25.605 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 164 kB/s) 2024-02-23T06:36:25.607 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-02-23T06:36:25.624 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-02-23T06:36:25.625 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-02-23T06:36:25.642 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 494 kB/s) 2024-02-23T06:36:25.644 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-02-23T06:36:25.661 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 129 kB/s) 2024-02-23T06:36:25.663 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-02-23T06:36:25.680 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-02-23T06:36:25.683 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-02-23T06:36:25.701 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 168 kB/s) 2024-02-23T06:36:25.706 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-02-23T06:36:25.723 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 831 kB/s) 2024-02-23T06:36:25.725 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-02-23T06:36:25.743 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-02-23T06:36:25.745 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-02-23T06:36:25.762 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 790 kB/s) 2024-02-23T06:36:25.764 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-02-23T06:36:25.780 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-02-23T06:36:25.781 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-02-23T06:36:25.799 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 369 kB/s) 2024-02-23T06:36:25.800 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-02-23T06:36:25.818 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.8 MB/s) 2024-02-23T06:36:25.821 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-02-23T06:36:25.838 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-02-23T06:36:25.840 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-02-23T06:36:25.857 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-02-23T06:36:25.860 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-02-23T06:36:25.881 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 34 kB/s) 2024-02-23T06:36:25.883 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-02-23T06:36:25.899 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 283 kB/s) 2024-02-23T06:36:25.901 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-02-23T06:36:25.919 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 440 kB/s) 2024-02-23T06:36:25.921 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-02-23T06:36:25.939 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 166 kB/s) 2024-02-23T06:36:25.942 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-02-23T06:36:25.959 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-02-23T06:36:25.961 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-02-23T06:36:25.978 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-02-23T06:36:25.980 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-02-23T06:36:25.997 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-02-23T06:36:25.999 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-02-23T06:36:26.016 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-02-23T06:36:26.018 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-02-23T06:36:26.036 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 748 kB/s) 2024-02-23T06:36:26.038 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-02-23T06:36:26.055 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.1 MB/s) 2024-02-23T06:36:26.060 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-02-23T06:36:26.074 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 21 kB/s) 2024-02-23T06:36:26.075 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-02-23T06:36:26.093 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-02-23T06:36:26.094 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-02-23T06:36:26.112 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 408 kB/s) 2024-02-23T06:36:26.113 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-02-23T06:36:26.131 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 284 kB/s) 2024-02-23T06:36:26.133 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-02-23T06:36:26.151 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 406 kB/s) 2024-02-23T06:36:26.153 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-02-23T06:36:26.170 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-02-23T06:36:26.172 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-02-23T06:36:26.190 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-02-23T06:36:26.193 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-02-23T06:36:26.211 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-02-23T06:36:26.213 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-02-23T06:36:26.230 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-02-23T06:36:26.232 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-02-23T06:36:26.249 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-02-23T06:36:26.251 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-02-23T06:36:26.267 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 188 kB/s) 2024-02-23T06:36:26.268 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-02-23T06:36:26.286 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-02-23T06:36:26.288 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-02-23T06:36:26.320 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 74 kB/s) 2024-02-23T06:36:26.325 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-02-23T06:36:26.348 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 262/308 kB Progress (1): 279/308 kB Progress (1): 295/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 14 MB/s) 2024-02-23T06:36:26.349 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-02-23T06:36:26.349 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-02-23T06:36:26.349 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-02-23T06:36:26.349 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-02-23T06:36:26.349 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-02-23T06:36:26.365 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-02-23T06:36:26.366 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-02-23T06:36:26.368 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/118 kB Progress (1): 33/118 kB Progress (1): 49/118 kB Progress (2): 49/118 kB | 8.2 kB Progress (3): 49/118 kB | 8.2 kB | 16/26 kB Progress (3): 66/118 kB | 8.2 kB | 16/26 kB Progress (3): 66/118 kB | 8.2 kB | 26 kB Progress (3): 82/118 kB | 8.2 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-02-23T06:36:26.368 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 98/118 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-02-23T06:36:26.369 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 98/118 kB | 26 kB | 16/171 kB Progress (3): 115/118 kB | 26 kB | 16/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-02-23T06:36:26.369 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 118 kB | 16/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-02-23T06:36:26.369 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 118 kB | 33/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-02-23T06:36:26.369 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-02-23T06:36:26.370 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (1): 82/171 kB Progress (1): 98/171 kB Progress (1): 115/171 kB Progress (1): 131/171 kB Progress (1): 147/171 kB Progress (1): 164/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.8 MB/s) 2024-02-23T06:36:26.370 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-02-23T06:36:26.385 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 66/146 kB Progress (1): 82/146 kB Progress (2): 82/146 kB | 16/61 kB Progress (2): 98/146 kB | 16/61 kB Progress (2): 98/146 kB | 33/61 kB Progress (2): 115/146 kB | 33/61 kB Progress (2): 115/146 kB | 49/61 kB Progress (2): 131/146 kB | 49/61 kB Progress (2): 131/146 kB | 61 kB Progress (2): 146 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.1 MB/s) 2024-02-23T06:36:26.385 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.7 MB/s) 2024-02-23T06:36:26.385 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-02-23T06:36:26.385 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-02-23T06:36:26.387 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/136 kB Progress (1): 33/136 kB Progress (1): 49/136 kB Progress (1): 66/136 kB Progress (1): 82/136 kB Progress (1): 98/136 kB Progress (1): 115/136 kB Progress (2): 115/136 kB | 16/58 kB Progress (2): 131/136 kB | 16/58 kB Progress (2): 136 kB | 16/58 kB Progress (2): 136 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.6 MB/s) 2024-02-23T06:36:26.387 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 49/58 kB Progress (1): 58 kB Progress (2): 58 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.5 MB/s) 2024-02-23T06:36:26.394 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 33/501 kB Progress (1): 49/501 kB Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-02-23T06:36:26.402 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.3 MB/s) 2024-02-23T06:36:26.444 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 25 MB/s) 2024-02-23T06:36:26.527 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:26.527 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-02-23T06:36:26.530 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-02-23T06:36:26.547 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 249 kB/s) 2024-02-23T06:36:26.549 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-02-23T06:36:26.566 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 288 kB/s) 2024-02-23T06:36:26.567 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-02-23T06:36:26.598 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 1.5 MB/s) 2024-02-23T06:36:26.600 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-02-23T06:36:26.618 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.2 MB/s) 2024-02-23T06:36:26.620 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-02-23T06:36:26.637 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 305 kB/s) 2024-02-23T06:36:26.640 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-02-23T06:36:26.657 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 231 kB/s) 2024-02-23T06:36:26.659 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-02-23T06:36:26.677 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 334 kB/s) 2024-02-23T06:36:26.680 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-02-23T06:36:26.697 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 368 kB/s) 2024-02-23T06:36:26.700 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-02-23T06:36:26.717 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-02-23T06:36:26.720 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-02-23T06:36:26.737 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-02-23T06:36:26.739 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-02-23T06:36:26.756 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-02-23T06:36:26.759 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-02-23T06:36:26.775 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 483 kB/s) 2024-02-23T06:36:26.777 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-02-23T06:36:26.795 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-02-23T06:36:26.799 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-02-23T06:36:26.818 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.1 MB/s) 2024-02-23T06:36:26.818 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-02-23T06:36:26.818 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-02-23T06:36:26.818 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-02-23T06:36:26.818 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-02-23T06:36:26.818 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-02-23T06:36:26.836 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (2): 49/79 kB | 16/58 kB Progress (3): 49/79 kB | 16/58 kB | 16/26 kB Progress (3): 66/79 kB | 16/58 kB | 16/26 kB Progress (3): 66/79 kB | 33/58 kB | 16/26 kB Progress (3): 66/79 kB | 33/58 kB | 26 kB Progress (3): 79 kB | 33/58 kB | 26 kB Progress (3): 79 kB | 49/58 kB | 26 kB Progress (3): 79 kB | 58 kB | 26 kB Progress (4): 79 kB | 58 kB | 26 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-02-23T06:36:26.836 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.2 MB/s) 2024-02-23T06:36:26.836 INFO:tasks.workunit.client.0.smithi142.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-02-23T06:36:26.836 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-02-23T06:36:26.836 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-02-23T06:36:26.842 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 32/211 kB Progress (2): 32/211 kB | 0/1.0 MB Progress (2): 49/211 kB | 0/1.0 MB Progress (2): 49/211 kB | 0/1.0 MB Progress (2): 65/211 kB | 0/1.0 MB Progress (2): 65/211 kB | 0/1.0 MB Progress (2): 65/211 kB | 0.1/1.0 MB Progress (2): 65/211 kB | 0.1/1.0 MB Progress (2): 81/211 kB | 0.1/1.0 MB Progress (2): 81/211 kB | 0.1/1.0 MB Progress (2): 81/211 kB | 0.1/1.0 MB Progress (2): 98/211 kB | 0.1/1.0 MB Progress (2): 98/211 kB | 0.1/1.0 MB Progress (2): 114/211 kB | 0.1/1.0 MB Progress (2): 114/211 kB | 0.1/1.0 MB Progress (2): 114/211 kB | 0.2/1.0 MB Progress (2): 130/211 kB | 0.2/1.0 MB Progress (2): 130/211 kB | 0.2/1.0 MB Progress (2): 130/211 kB | 0.2/1.0 MB Progress (2): 130/211 kB | 0.2/1.0 MB Progress (2): 147/211 kB | 0.2/1.0 MB Progress (2): 147/211 kB | 0.2/1.0 MB Progress (2): 147/211 kB | 0.2/1.0 MB Progress (2): 163/211 kB | 0.2/1.0 MB Progress (2): 163/211 kB | 0.3/1.0 MB Progress (2): 163/211 kB | 0.3/1.0 MB Progress (2): 180/211 kB | 0.3/1.0 MB Progress (2): 180/211 kB | 0.3/1.0 MB Progress (2): 196/211 kB | 0.3/1.0 MB Progress (2): 196/211 kB | 0.3/1.0 MB Progress (2): 196/211 kB | 0.3/1.0 MB Progress (2): 196/211 kB | 0.3/1.0 MB Progress (2): 196/211 kB | 0.4/1.0 MB Progress (2): 196/211 kB | 0.4/1.0 MB Progress (2): 196/211 kB | 0.4/1.0 MB Progress (2): 211 kB | 0.4/1.0 MB Progress (2): 211 kB | 0.4/1.0 MB Progress (2): 211 kB | 0.4/1.0 MB Progress (2): 211 kB | 0.4/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 8.8 MB/s) 2024-02-23T06:36:26.850 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 31 MB/s) 2024-02-23T06:36:26.858 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/116 kB Progress (1): 33/116 kB Progress (1): 49/116 kB Progress (1): 66/116 kB Progress (1): 82/116 kB Progress (1): 98/116 kB Progress (2): 98/116 kB | 16/267 kB Progress (2): 115/116 kB | 16/267 kB Progress (2): 116 kB | 16/267 kB Progress (2): 116 kB | 33/267 kB Progress (2): 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.0 MB/s) 2024-02-23T06:36:26.860 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.2 MB/s) 2024-02-23T06:36:26.980 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-02-23T06:36:27.005 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------------------------ 2024-02-23T06:36:27.005 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] BUILD SUCCESS 2024-02-23T06:36:27.005 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------------------------ 2024-02-23T06:36:27.006 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Total time: 6.463 s 2024-02-23T06:36:27.006 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Finished at: 2024-02-23T06:36:27Z 2024-02-23T06:36:27.006 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------------------------ 2024-02-23T06:36:27.030 INFO:tasks.workunit.client.0.smithi142.stderr:+ ./mvnw test -Dtest=PutObjects 2024-02-23T06:36:27.039 INFO:tasks.workunit.client.0.smithi142.stdout:Warning: JAVA_HOME environment variable is not set. 2024-02-23T06:36:28.109 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Scanning for projects... 2024-02-23T06:36:28.216 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:28.217 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-02-23T06:36:28.217 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Building jcksum 1.0 2024-02-23T06:36:28.217 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] from pom.xml 2024-02-23T06:36:28.217 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-02-23T06:36:28.541 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:28.541 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-02-23T06:36:28.630 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-02-23T06:36:28.631 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:28.631 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-02-23T06:36:28.723 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Nothing to compile - all classes are up to date 2024-02-23T06:36:28.723 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:28.723 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-02-23T06:36:28.725 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-02-23T06:36:28.725 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:28.725 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-02-23T06:36:28.729 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Nothing to compile - all classes are up to date 2024-02-23T06:36:28.730 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:28.730 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-02-23T06:36:28.931 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-02-23T06:36:29.124 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-02-23T06:36:29.323 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-02-23T06:36:29.331 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-02-23T06:36:29.351 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-02-23T06:36:29.356 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-02-23T06:36:29.377 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 134 kB/s) 2024-02-23T06:36:29.382 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-02-23T06:36:29.400 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-02-23T06:36:29.403 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-02-23T06:36:29.421 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-02-23T06:36:29.423 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-02-23T06:36:29.441 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 94 kB/s) 2024-02-23T06:36:29.443 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-02-23T06:36:29.461 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-02-23T06:36:29.466 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-02-23T06:36:29.490 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-02-23T06:36:29.492 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-02-23T06:36:29.492 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-02-23T06:36:29.492 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-02-23T06:36:29.492 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-02-23T06:36:29.493 INFO:tasks.workunit.client.0.smithi142.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-02-23T06:36:29.514 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 763 kB/s) 2024-02-23T06:36:29.553 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/169 kB Progress (3): 1.4/7.7 kB | 1.4/169 kB | 1.4/189 kB Progress (3): 1.4/7.7 kB | 2.8/169 kB | 1.4/189 kB Progress (3): 2.8/7.7 kB | 2.8/169 kB | 1.4/189 kB Progress (3): 2.8/7.7 kB | 4.1/169 kB | 1.4/189 kB Progress (3): 4.1/7.7 kB | 4.1/169 kB | 1.4/189 kB Progress (3): 5.5/7.7 kB | 4.1/169 kB | 1.4/189 kB Progress (3): 5.5/7.7 kB | 4.1/169 kB | 2.8/189 kB Progress (3): 6.9/7.7 kB | 4.1/169 kB | 2.8/189 kB Progress (4): 6.9/7.7 kB | 4.1/169 kB | 2.8/189 kB | 16/103 kB Progress (4): 6.9/7.7 kB | 5.5/169 kB | 2.8/189 kB | 16/103 kB Progress (4): 7.7 kB | 5.5/169 kB | 2.8/189 kB | 16/103 kB Progress (4): 7.7 kB | 5.5/169 kB | 4.1/189 kB | 16/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 4.1/189 kB | 16/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 5.5/189 kB | 16/103 kB Progress (4): 7.7 kB | 8.3/169 kB | 5.5/189 kB | 16/103 kB Progress (4): 7.7 kB | 8.3/169 kB | 6.9/189 kB | 16/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 125 kB/s) 2024-02-23T06:36:29.588 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (3): 8.3/169 kB | 8.3/189 kB | 16/103 kB Progress (3): 9.7/169 kB | 8.3/189 kB | 16/103 kB Progress (3): 9.7/169 kB | 9.7/189 kB | 16/103 kB Progress (3): 11/169 kB | 9.7/189 kB | 16/103 kB Progress (3): 11/169 kB | 11/189 kB | 16/103 kB Progress (3): 12/169 kB | 11/189 kB | 16/103 kB Progress (3): 12/169 kB | 12/189 kB | 16/103 kB Progress (3): 14/169 kB | 12/189 kB | 16/103 kB Progress (3): 14/169 kB | 14/189 kB | 16/103 kB Progress (3): 15/169 kB | 14/189 kB | 16/103 kB Progress (3): 15/169 kB | 15/189 kB | 16/103 kB Progress (3): 17/169 kB | 15/189 kB | 16/103 kB Progress (3): 17/169 kB | 17/189 kB | 16/103 kB Progress (3): 18/169 kB | 17/189 kB | 16/103 kB Progress (3): 18/169 kB | 18/189 kB | 16/103 kB Progress (3): 19/169 kB | 18/189 kB | 16/103 kB Progress (3): 19/169 kB | 19/189 kB | 16/103 kB Progress (3): 21/169 kB | 19/189 kB | 16/103 kB Progress (3): 21/169 kB | 21/189 kB | 16/103 kB Progress (3): 22/169 kB | 21/189 kB | 16/103 kB Progress (3): 22/169 kB | 22/189 kB | 16/103 kB Progress (3): 23/169 kB | 22/189 kB | 16/103 kB Progress (3): 23/169 kB | 23/189 kB | 16/103 kB Progress (3): 25/169 kB | 23/189 kB | 16/103 kB Progress (3): 25/169 kB | 25/189 kB | 16/103 kB Progress (3): 26/169 kB | 25/189 kB | 16/103 kB Progress (3): 26/169 kB | 26/189 kB | 16/103 kB Progress (3): 28/169 kB | 26/189 kB | 16/103 kB Progress (3): 28/169 kB | 28/189 kB | 16/103 kB Progress (3): 29/169 kB | 28/189 kB | 16/103 kB Progress (3): 29/169 kB | 29/189 kB | 16/103 kB Progress (3): 30/169 kB | 29/189 kB | 16/103 kB Progress (3): 30/169 kB | 30/189 kB | 16/103 kB Progress (3): 32/169 kB | 30/189 kB | 16/103 kB Progress (3): 32/169 kB | 32/189 kB | 16/103 kB Progress (3): 33/169 kB | 32/189 kB | 16/103 kB Progress (3): 33/169 kB | 33/189 kB | 16/103 kB Progress (3): 33/169 kB | 33/189 kB | 33/103 kB Progress (3): 33/169 kB | 34/189 kB | 33/103 kB Progress (3): 34/169 kB | 34/189 kB | 33/103 kB Progress (3): 34/169 kB | 36/189 kB | 33/103 kB Progress (3): 36/169 kB | 36/189 kB | 33/103 kB Progress (3): 36/169 kB | 37/189 kB | 33/103 kB Progress (3): 37/169 kB | 37/189 kB | 33/103 kB Progress (3): 37/169 kB | 39/189 kB | 33/103 kB Progress (3): 37/169 kB | 39/189 kB | 49/103 kB Progress (3): 37/169 kB | 40/189 kB | 49/103 kB Progress (3): 39/169 kB | 40/189 kB | 49/103 kB Progress (3): 39/169 kB | 41/189 kB | 49/103 kB Progress (3): 40/169 kB | 41/189 kB | 49/103 kB Progress (3): 40/169 kB | 43/189 kB | 49/103 kB Progress (3): 41/169 kB | 43/189 kB | 49/103 kB Progress (3): 41/169 kB | 44/189 kB | 49/103 kB Progress (3): 43/169 kB | 44/189 kB | 49/103 kB Progress (3): 43/169 kB | 46/189 kB | 49/103 kB Progress (3): 44/169 kB | 46/189 kB | 49/103 kB Progress (3): 44/169 kB | 47/189 kB | 49/103 kB Progress (3): 46/169 kB | 47/189 kB | 49/103 kB Progress (3): 46/169 kB | 48/189 kB | 49/103 kB Progress (3): 47/169 kB | 48/189 kB | 49/103 kB Progress (3): 47/169 kB | 50/189 kB | 49/103 kB Progress (3): 48/169 kB | 50/189 kB | 49/103 kB Progress (3): 48/169 kB | 51/189 kB | 49/103 kB Progress (3): 50/169 kB | 51/189 kB | 49/103 kB Progress (3): 50/169 kB | 52/189 kB | 49/103 kB Progress (3): 51/169 kB | 52/189 kB | 49/103 kB Progress (3): 51/169 kB | 54/189 kB | 49/103 kB Progress (3): 52/169 kB | 54/189 kB | 49/103 kB Progress (3): 54/169 kB | 54/189 kB | 49/103 kB Progress (3): 55/169 kB | 54/189 kB | 49/103 kB Progress (3): 57/169 kB | 54/189 kB | 49/103 kB Progress (3): 58/169 kB | 54/189 kB | 49/103 kB Progress (3): 59/169 kB | 54/189 kB | 49/103 kB Progress (3): 61/169 kB | 54/189 kB | 49/103 kB Progress (3): 62/169 kB | 54/189 kB | 49/103 kB Progress (3): 63/169 kB | 54/189 kB | 49/103 kB Progress (3): 65/169 kB | 54/189 kB | 49/103 kB Progress (3): 65/169 kB | 54/189 kB | 66/103 kB Progress (3): 65/169 kB | 70/189 kB | 66/103 kB Progress (3): 81/169 kB | 70/189 kB | 66/103 kB Progress (3): 81/169 kB | 70/189 kB | 82/103 kB Progress (3): 81/169 kB | 86/189 kB | 82/103 kB Progress (3): 97/169 kB | 86/189 kB | 82/103 kB Progress (3): 97/169 kB | 86/189 kB | 98/103 kB Progress (3): 97/169 kB | 103/189 kB | 98/103 kB Progress (3): 97/169 kB | 103/189 kB | 103 kB Progress (3): 114/169 kB | 103/189 kB | 103 kB Progress (3): 130/169 kB | 103/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-02-23T06:36:29.593 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (2): 147/169 kB | 103/189 kB Progress (2): 163/169 kB | 103/189 kB Progress (2): 169 kB | 103/189 kB Progress (2): 169 kB | 119/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-02-23T06:36:29.597 INFO:tasks.workunit.client.0.smithi142.stdout:Progress (1): 135/189 kB Progress (1): 152/189 kB Progress (1): 168/189 kB Progress (1): 185/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-02-23T06:36:29.617 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:29.617 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------- 2024-02-23T06:36:29.617 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] T E S T S 2024-02-23T06:36:29.617 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------- 2024-02-23T06:36:30.101 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-02-23T06:36:30.214 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjects.java: starting test run: 2024-02-23T06:36:30.214 INFO:tasks.workunit.client.0.smithi142.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-02-23T06:36:30.214 INFO:tasks.workunit.client.0.smithi142.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-02-23T06:36:30.214 INFO:tasks.workunit.client.0.smithi142.stdout: EndpointUrl=http://smithi142.front.sepia.ceph.com:80 2024-02-23T06:36:30.215 INFO:tasks.workunit.client.0.smithi142.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-02-23T06:36:30.311 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Environment Variables Read 2024-02-23T06:36:30.612 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: S3 Client Initialized 2024-02-23T06:36:30.613 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generating File 2024-02-23T06:36:30.613 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: File Generated 2024-02-23T06:36:30.613 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generating File 2024-02-23T06:36:30.613 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: File Generated 2024-02-23T06:36:30.613 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generating File 2024-02-23T06:36:30.712 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: File Generated 2024-02-23T06:36:30.712 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generating File 2024-02-23T06:36:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: File Generated 2024-02-23T06:36:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generating File 2024-02-23T06:36:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: File Generated 2024-02-23T06:36:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generating File 2024-02-23T06:36:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: File Generated 2024-02-23T06:36:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Generated Big Files 2024-02-23T06:36:30.819 INFO:tasks.workunit.client.0.smithi142.stdout:HeadBucketResponse() 2024-02-23T06:36:30.820 INFO:tasks.workunit.client.0.smithi142.stdout:sheik is ready 2024-02-23T06:36:30.820 INFO:tasks.workunit.client.0.smithi142.stdout:DEBUG: Test Bucket Created 2024-02-23T06:36:30.919 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-0b 2024-02-23T06:36:31.019 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-8b 2024-02-23T06:36:31.084 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-200b 2024-02-23T06:36:31.115 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-21983b 2024-02-23T06:36:31.119 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-5519b 2024-02-23T06:36:31.211 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-204329b 2024-02-23T06:36:31.219 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-256k 2024-02-23T06:36:31.290 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-1m 2024-02-23T06:36:31.320 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-02-23T06:36:31.420 INFO:tasks.workunit.client.0.smithi142.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-02-23T06:36:33.523 INFO:tasks.workunit.client.0.smithi142.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-02-23T06:36:33.824 INFO:tasks.workunit.client.0.smithi142.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-02-23T06:36:35.657 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-0b 2024-02-23T06:36:35.658 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-8b 2024-02-23T06:36:35.659 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-200b 2024-02-23T06:36:35.660 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-21983b 2024-02-23T06:36:35.661 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-5519b 2024-02-23T06:36:35.662 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-204329b 2024-02-23T06:36:35.663 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-256k 2024-02-23T06:36:35.664 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-1m 2024-02-23T06:36:35.665 INFO:tasks.workunit.client.0.smithi142.stdout:arg: file-1038757b 2024-02-23T06:36:35.698 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-0b 2024-02-23T06:36:35.698 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:35.727 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-8b 2024-02-23T06:36:35.727 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:35.814 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-200b 2024-02-23T06:36:35.815 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:35.828 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-21983b 2024-02-23T06:36:35.877 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:35.928 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-5519b 2024-02-23T06:36:35.928 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:36.004 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-204329b 2024-02-23T06:36:36.004 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:36.028 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-256k 2024-02-23T06:36:36.028 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:36.066 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-1m 2024-02-23T06:36:36.066 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:36.106 INFO:tasks.workunit.client.0.smithi142.stdout:putObjectFromFileCksum called with file-1038757b 2024-02-23T06:36:36.106 INFO:tasks.workunit.client.0.smithi142.stdout:PutObjectResponse 2024-02-23T06:36:36.128 INFO:tasks.workunit.client.0.smithi142.stdout:mpuObjectFromFileCksum called with file-5m 2024-02-23T06:36:36.328 INFO:tasks.workunit.client.0.smithi142.stdout:mpuObjectFromFileCksum called with file-10m 2024-02-23T06:36:36.729 INFO:tasks.workunit.client.0.smithi142.stdout:mpuObjectFromFileCksum called with file-100m 2024-02-23T06:36:40.555 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.45 s -- in io.ceph.jcksum.PutObjects 2024-02-23T06:36:40.569 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:40.569 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Results: 2024-02-23T06:36:40.569 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:40.569 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-02-23T06:36:40.569 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] 2024-02-23T06:36:40.571 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------------------------ 2024-02-23T06:36:40.571 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] BUILD SUCCESS 2024-02-23T06:36:40.571 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------------------------ 2024-02-23T06:36:40.572 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Total time: 12.487 s 2024-02-23T06:36:40.572 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] Finished at: 2024-02-23T06:36:40Z 2024-02-23T06:36:40.572 INFO:tasks.workunit.client.0.smithi142.stdout:[INFO] ------------------------------------------------------------------------ 2024-02-23T06:36:40.596 INFO:tasks.workunit.client.0.smithi142.stderr:+ exit 2024-02-23T06:36:40.596 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:36:40.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:36:40.676 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-02-23T06:36:40.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-23T06:36:41.020 DEBUG:teuthology.parallel:result is None 2024-02-23T06:36:41.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:36:41.060 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:36:41.060 DEBUG:teuthology.orchestra.run.smithi142:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:36:41.127 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:36:41.127 INFO:teuthology.run_tasks:Running task workunit... 2024-02-23T06:36:41.140 INFO:tasks.workunit:Pulling workunits from ref 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:36:41.141 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-23T06:36:41.141 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:36:41.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:36:41.195 INFO:teuthology.orchestra.run.smithi142.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-23T06:36:41.195 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:36:41.263 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-23T06:36:41.263 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-23T06:36:41.331 INFO:tasks.workunit:timeout=3h 2024-02-23T06:36:41.331 INFO:tasks.workunit:cleanup=True 2024-02-23T06:36:41.332 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:36:41.400 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-23T06:37:56.395 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'. 2024-02-23T06:37:56.395 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-02-23T06:37:56.396 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.397 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-23T06:37:56.397 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:37:56.397 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at 1fb7413ec44 Merge branches 'pr-55565', 'pr-55627' and 'wip-64543' into wip-cbodley-testing 2024-02-23T06:37:56.398 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-23T06:37:56.426 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-23T06:37:56.428 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:37:56.428 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-23T06:37:56.477 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-23T06:37:56.525 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-23T06:37:56.564 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:37:56.565 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:37:56.565 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-23T06:37:56.604 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:37:56.607 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:37:56.607 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-23T06:37:56.675 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-02-23T06:37:56.676 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-02-23T06:37:56.677 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-02-23T06:37:56.749 INFO:tasks.workunit.client.0.smithi142.stdout:INFO: fully qualified domain name: smithi142.front.sepia.ceph.com 2024-02-23T06:37:56.749 INFO:tasks.workunit.client.0.smithi142.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-02-23T06:37:56.749 INFO:tasks.workunit.client.0.smithi142.stdout:== TESTING VERSIONED BUCKET == 2024-02-23T06:37:59.358 INFO:tasks.workunit.client.0.smithi142.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-02-23T06:37:59.558 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting pip 2024-02-23T06:37:59.564 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-02-23T06:37:59.611 INFO:tasks.workunit.client.0.smithi142.stdout:Installing collected packages: pip 2024-02-23T06:37:59.611 INFO:tasks.workunit.client.0.smithi142.stdout: Attempting uninstall: pip 2024-02-23T06:37:59.611 INFO:tasks.workunit.client.0.smithi142.stdout: Found existing installation: pip 21.2.3 2024-02-23T06:37:59.761 INFO:tasks.workunit.client.0.smithi142.stdout: Uninstalling pip-21.2.3: 2024-02-23T06:37:59.767 INFO:tasks.workunit.client.0.smithi142.stdout: Successfully uninstalled pip-21.2.3 2024-02-23T06:38:00.736 INFO:tasks.workunit.client.0.smithi142.stdout:Successfully installed pip-24.0 2024-02-23T06:38:01.721 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting boto3 2024-02-23T06:38:01.723 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached boto3-1.34.48-py3-none-any.whl.metadata (6.6 kB) 2024-02-23T06:38:02.355 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting botocore<1.35.0,>=1.34.48 (from boto3) 2024-02-23T06:38:02.356 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached botocore-1.34.48-py3-none-any.whl.metadata (5.7 kB) 2024-02-23T06:38:02.419 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-02-23T06:38:02.420 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-02-23T06:38:02.474 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-02-23T06:38:02.475 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-02-23T06:38:02.540 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:38:02.541 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2024-02-23T06:38:02.624 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:38:02.625 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-02-23T06:38:02.838 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:38:02.839 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-02-23T06:38:02.862 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached boto3-1.34.48-py3-none-any.whl (139 kB) 2024-02-23T06:38:02.863 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached botocore-1.34.48-py3-none-any.whl (12.0 MB) 2024-02-23T06:38:02.884 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-02-23T06:38:02.885 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-02-23T06:38:02.886 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-02-23T06:38:02.986 INFO:tasks.workunit.client.0.smithi142.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-02-23T06:38:04.020 INFO:tasks.workunit.client.0.smithi142.stdout:Successfully installed boto3-1.34.48 botocore-1.34.48 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-02-23T06:38:04.468 INFO:tasks.workunit.client.0.smithi142.stdout:INFO: creating user 2024-02-23T06:38:04.571 INFO:tasks.workunit.client.0.smithi142.stdout:{ 2024-02-23T06:38:04.571 INFO:tasks.workunit.client.0.smithi142.stdout: "user_id": "testid", 2024-02-23T06:38:04.571 INFO:tasks.workunit.client.0.smithi142.stdout: "display_name": "M. Tester", 2024-02-23T06:38:04.571 INFO:tasks.workunit.client.0.smithi142.stdout: "email": "tester@ceph.com", 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "suspended": 0, 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "max_buckets": 1000, 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "subusers": [], 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "keys": [ 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: { 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "user": "testid", 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "access_key": "0555b35654ad1656d804", 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "active": true 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: } 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: ], 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "swift_keys": [], 2024-02-23T06:38:04.572 INFO:tasks.workunit.client.0.smithi142.stdout: "caps": [], 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "op_mask": "read, write, delete", 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "default_placement": "", 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "default_storage_class": "", 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "placement_tags": [], 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "bucket_quota": { 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "enabled": false, 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size": -1, 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "max_objects": -1 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "user_quota": { 2024-02-23T06:38:04.573 INFO:tasks.workunit.client.0.smithi142.stdout: "enabled": false, 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size": -1, 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "max_objects": -1 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: }, 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "temp_url_keys": [], 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "type": "rgw", 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: "mfa_ids": [] 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout:} 2024-02-23T06:38:04.574 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-02-23T06:38:04.821 INFO:tasks.workunit.client.0.smithi142.stderr:5+0 records in 2024-02-23T06:38:04.822 INFO:tasks.workunit.client.0.smithi142.stderr:5+0 records out 2024-02-23T06:38:04.822 INFO:tasks.workunit.client.0.smithi142.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0143162 s, 366 MB/s 2024-02-23T06:38:05.875 INFO:tasks.workunit.client.0.smithi142.stdout:bucket nams is reupload-bkt-121300 2024-02-23T06:38:05.875 INFO:tasks.workunit.client.0.smithi142.stdout:endpoint is http://smithi142.front.sepia.ceph.com:80 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:start UploadId=2~uL72ECPrT_dGvrTZA7fyz5kWlFUsx1U 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 1 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 1 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 2} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.876 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.881 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.881 INFO:tasks.workunit.client.0.smithi142.stdout:phase 2 uploaded part {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1} 2024-02-23T06:38:05.881 INFO:tasks.workunit.client.0.smithi142.stdout:completing multipart upload, parts=[{'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 1}, {'ETag': '"bd6e71db888659124de7ddffd26bb028"', 'PartNumber': 2}] 2024-02-23T06:38:07.280 INFO:tasks.workunit.client.0.smithi142.stdout:radosgw-admin bucket radoslist: 2024-02-23T06:38:07.281 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3__:09p14ksR7UECIeITMNCdjsto2d-aNHE_mpu_test4 2024-02-23T06:38:07.281 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3_mpu_test4 2024-02-23T06:38:07.281 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3__multipart_mpu_test4.2~uL72ECPrT_dGvrTZA7fyz5kWlFUsx1U.2 2024-02-23T06:38:07.281 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3__multipart_mpu_test4.QsUdgOO-mkAO8F0RquXdVHplkP83yuAo.1 2024-02-23T06:38:07.338 INFO:tasks.workunit.client.0.smithi142.stdout:rados ls: 2024-02-23T06:38:07.339 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3__:09p14ksR7UECIeITMNCdjsto2d-aNHE_mpu_test4 2024-02-23T06:38:07.339 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3_mpu_test4 2024-02-23T06:38:07.339 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3__multipart_mpu_test4.2~uL72ECPrT_dGvrTZA7fyz5kWlFUsx1U.2 2024-02-23T06:38:07.339 INFO:tasks.workunit.client.0.smithi142.stdout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3__multipart_mpu_test4.QsUdgOO-mkAO8F0RquXdVHplkP83yuAo.1 2024-02-23T06:38:07.356 INFO:tasks.workunit.client.0.smithi142.stdout:== PASSED == 2024-02-23T06:38:07.357 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:38:07.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:38:07.437 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-02-23T06:38:07.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-23T06:38:07.783 DEBUG:teuthology.parallel:result is None 2024-02-23T06:38:07.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:38:07.823 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:38:07.823 DEBUG:teuthology.orchestra.run.smithi142:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:38:07.890 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:38:07.890 INFO:teuthology.run_tasks:Running task ragweed... 2024-02-23T06:38:07.933 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-02-23T06:38:07.934 INFO:tasks.ragweed:Downloading ragweed... 2024-02-23T06:38:07.934 INFO:tasks.ragweed:Using branch 'wip-cbodley-testing' for ragweed 2024-02-23T06:38:07.934 DEBUG:teuthology.orchestra.run.smithi142:> git clone -b wip-cbodley-testing https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-02-23T06:38:07.961 INFO:teuthology.orchestra.run.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-02-23T06:38:08.004 INFO:teuthology.orchestra.run.smithi142.stderr:fatal: Remote branch wip-cbodley-testing not found in upstream origin 2024-02-23T06:38:08.005 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-02-23T06:38:08.006 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-02-23T06:38:08.006 DEBUG:teuthology.orchestra.run.smithi142:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-02-23T06:38:08.073 INFO:teuthology.orchestra.run.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-02-23T06:38:08.227 INFO:tasks.ragweed:Creating rgw users... 2024-02-23T06:38:08.228 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-02-23T06:38:08.228 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PPYCJFDXQMSOMCJBQWMP --secret Cp1IWTUpzQQaouHZrjXFzrEgzzSSy3ylU6Ngmp4vrZE6qZDPz25uCA== --email ragweed.client.0+test@test.test --system false 2024-02-23T06:38:08.331 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:38:08.331 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:38:08.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.360+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 realm 2024-02-23T06:38:08.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:38:08.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.362+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.363+0000 7f35bc816800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:08.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.363+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.363+0000 7f35bc816800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:38:08.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.363+0000 7f35bc816800 20 searching for the correct realm 2024-02-23T06:38:08.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.367+0000 7f35b844c640 0 -- 172.21.15.142:0/994041727 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f35a0093400 msgr2=0x7f35a0093880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:08.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.573+0000 7f35b7c4b640 0 -- 172.21.15.142:0/994041727 >> [v2:172.21.15.152:6824/160508611,v1:172.21.15.152:6825/160508611] conn(0x55e88d050ec0 msgr2=0x55e88d0532f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:08.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.576+0000 7f35bc816800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:08.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:38:08.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 zone default found 2024-02-23T06:38:08.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 4 Realm: () 2024-02-23T06:38:08.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:38:08.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:38:08.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:38:08.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 zonegroup default 2024-02-23T06:38:08.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.577+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.578+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.578+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.578+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.578+0000 7f35bc816800 20 started sync module instance, tier type = 2024-02-23T06:38:08.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.578+0000 7f35bc816800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:38:08.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=0 2024-02-23T06:38:08.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=1 2024-02-23T06:38:08.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=2 2024-02-23T06:38:08.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=3 2024-02-23T06:38:08.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=4 2024-02-23T06:38:08.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=5 2024-02-23T06:38:08.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.588+0000 7f35bc816800 20 add_watcher() i=6 2024-02-23T06:38:08.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.589+0000 7f35bc816800 20 add_watcher() i=7 2024-02-23T06:38:08.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.589+0000 7f35bc816800 2 all 8 watchers are set, enabling cache 2024-02-23T06:38:08.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.590+0000 7f346dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:08.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.590+0000 7f35bc816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.590+0000 7f35bc816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.590+0000 7f35bc816800 5 note: GC not initialized 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.591+0000 7f346cfe1640 20 reqs_thread_entry: start 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.591+0000 7f35bc816800 20 init_complete bucket index max shards: 11 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.591+0000 7f35bc816800 20 Filter name: none 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.591+0000 7f33e67fc640 20 reqs_thread_entry: start 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.591+0000 7f35bc816800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.591+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-02-23T06:38:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache get: name=default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP : miss 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache put: name=default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP info.flags=0x0 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 adding default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP to cache LRU end 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache get: name=default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP : hit (negative entry) 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.592+0000 7f35bc816800 10 cache get: name=default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP : hit (negative entry) 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.594+0000 7f35bc816800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.594+0000 7f35bc816800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.594+0000 7f35bc816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.594+0000 7f3496ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889426 cookie 94457286701072 notifier 5624 bl.length()=642 2024-02-23T06:38:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.594+0000 7f3496ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-02-23T06:38:08.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.594+0000 7f3496ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.596+0000 7f35bc816800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.596+0000 7f35bc816800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.596+0000 7f35bc816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.596+0000 7f3496ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889417 cookie 94457286697168 notifier 5624 bl.length()=202 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.596+0000 7f3496ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.596+0000 7f3496ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.598+0000 7f35bc816800 10 cache put: name=default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP info.flags=0x7 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.598+0000 7f35bc816800 10 moving default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP to cache LRU end 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.598+0000 7f35bc816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:PPYCJFDXQMSOMCJBQWMP, ofs0, ns] 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.598+0000 7f34967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889461 cookie 94457286727776 notifier 5624 bl.length()=190 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.598+0000 7f34967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP info.flags=0x7 2024-02-23T06:38:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.598+0000 7f34967fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PPYCJFDXQMSOMCJBQWMP to cache LRU end 2024-02-23T06:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-02-23T06:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "user_id": "ragweed.client.0", 2024-02-23T06:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "display_name": "Mr. ragweed.client.0", 2024-02-23T06:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "email": "ragweed.client.0+test@test.test", 2024-02-23T06:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "suspended": 0, 2024-02-23T06:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "max_buckets": 1000, 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "subusers": [], 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "keys": [ 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "user": "ragweed.client.0", 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "access_key": "PPYCJFDXQMSOMCJBQWMP", 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "secret_key": "Cp1IWTUpzQQaouHZrjXFzrEgzzSSy3ylU6Ngmp4vrZE6qZDPz25uCA==", 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "active": true 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "swift_keys": [], 2024-02-23T06:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": [], 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "op_mask": "read, write, delete", 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "default_placement": "", 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "default_storage_class": "", 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "placement_tags": [], 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "bucket_quota": { 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": false, 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size": -1, 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "max_objects": -1 2024-02-23T06:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "user_quota": { 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": false, 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size": -1, 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "max_objects": -1 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "temp_url_keys": [], 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "rgw", 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "mfa_ids": [] 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-02-23T06:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:38:08.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.600+0000 7f346dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:08.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.602+0000 7f35bc816800 20 remove_watcher() i=0 2024-02-23T06:38:08.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.602+0000 7f35bc816800 2 removed watcher, disabling cache 2024-02-23T06:38:08.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.603+0000 7f35bc816800 20 remove_watcher() i=1 2024-02-23T06:38:08.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.604+0000 7f35bc816800 20 remove_watcher() i=2 2024-02-23T06:38:08.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.605+0000 7f35bc816800 20 remove_watcher() i=3 2024-02-23T06:38:08.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.606+0000 7f35bc816800 20 remove_watcher() i=4 2024-02-23T06:38:08.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.607+0000 7f35bc816800 20 remove_watcher() i=5 2024-02-23T06:38:08.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.608+0000 7f35bc816800 20 remove_watcher() i=6 2024-02-23T06:38:08.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.608+0000 7f35bc816800 20 remove_watcher() i=7 2024-02-23T06:38:08.620 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-02-23T06:38:08.621 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key CXCMYZYGENYUHMNCXDRR --secret hh39ucDWYPNbljItRdLfcB6xvx/nQ34/Ut5NQlpgCUCPzmXswSNqag== --email sysuser.client.0+test@test.test --system true 2024-02-23T06:38:08.684 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:38:08.685 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:38:08.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.715+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 realm 2024-02-23T06:38:08.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:38:08.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.716+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.717+0000 7fcfcc642800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:08.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.717+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.718+0000 7fcfcc642800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:38:08.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.718+0000 7fcfcc642800 20 searching for the correct realm 2024-02-23T06:38:08.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.721+0000 7fcfca744640 0 -- 172.21.15.142:0/3780318088 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fcfc009c040 msgr2=0x7fcfc0051310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:08.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.724+0000 7fcfc9f43640 0 -- 172.21.15.142:0/3780318088 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fcfc0037040 msgr2=0x7fcfc008aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:08.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:38:08.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:38:08.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:38:08.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:38:08.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:38:08.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:38:08.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:08.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 zone default found 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 4 Realm: () 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:38:08.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 zonegroup default 2024-02-23T06:38:08.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.729+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 started sync module instance, tier type = 2024-02-23T06:38:08.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.730+0000 7fcfcc642800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:38:08.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=0 2024-02-23T06:38:08.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=1 2024-02-23T06:38:08.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=2 2024-02-23T06:38:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=3 2024-02-23T06:38:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=4 2024-02-23T06:38:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=5 2024-02-23T06:38:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=6 2024-02-23T06:38:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 20 add_watcher() i=7 2024-02-23T06:38:08.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.740+0000 7fcfcc642800 2 all 8 watchers are set, enabling cache 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.742+0000 7fce7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.742+0000 7fcfcc642800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.742+0000 7fcfcc642800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.742+0000 7fcfcc642800 5 note: GC not initialized 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fce7a7fc640 20 reqs_thread_entry: start 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 20 init_complete bucket index max shards: 11 2024-02-23T06:38:08.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 20 Filter name: none 2024-02-23T06:38:08.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcdebfff640 20 reqs_thread_entry: start 2024-02-23T06:38:08.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-02-23T06:38:08.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-02-23T06:38:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-02-23T06:38:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-02-23T06:38:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.743+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 cache get: name=default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR : miss 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 20 rados->read ofs=0 len=0 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 cache put: name=default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR info.flags=0x0 2024-02-23T06:38:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 adding default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR to cache LRU end 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 cache get: name=default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR : hit (negative entry) 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.744+0000 7fcfcc642800 10 cache get: name=default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR : hit (negative entry) 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.745+0000 7fcfcc642800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.745+0000 7fcfcc642800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.745+0000 7fcfcc642800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.745+0000 7fcead7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889418 cookie 94660378735232 notifier 5639 bl.length()=642 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.745+0000 7fcead7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-02-23T06:38:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.745+0000 7fcead7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-02-23T06:38:08.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.747+0000 7fcfcc642800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-02-23T06:38:08.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.747+0000 7fcfcc642800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-02-23T06:38:08.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.747+0000 7fcfcc642800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-02-23T06:38:08.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.747+0000 7fcead7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889427 cookie 94660378738560 notifier 5639 bl.length()=202 2024-02-23T06:38:08.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.747+0000 7fcead7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.747+0000 7fcead7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.749+0000 7fcfcc642800 10 cache put: name=default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR info.flags=0x7 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.749+0000 7fcfcc642800 10 moving default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR to cache LRU end 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.749+0000 7fcfcc642800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:CXCMYZYGENYUHMNCXDRR, ofs0, ns] 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.749+0000 7fceacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889462 cookie 94660378745680 notifier 5639 bl.length()=190 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.749+0000 7fceacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR info.flags=0x7 2024-02-23T06:38:08.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.749+0000 7fceacff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CXCMYZYGENYUHMNCXDRR to cache LRU end 2024-02-23T06:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-02-23T06:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "user_id": "sysuser.client.0", 2024-02-23T06:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "display_name": "Mr. sysuser.client.0", 2024-02-23T06:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "email": "sysuser.client.0+test@test.test", 2024-02-23T06:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "suspended": 0, 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "max_buckets": 1000, 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "subusers": [], 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "keys": [ 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "user": "sysuser.client.0", 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "access_key": "CXCMYZYGENYUHMNCXDRR", 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "secret_key": "hh39ucDWYPNbljItRdLfcB6xvx/nQ34/Ut5NQlpgCUCPzmXswSNqag==", 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "active": true 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-02-23T06:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "swift_keys": [], 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": [], 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "op_mask": "read, write, delete", 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "system": true, 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "default_placement": "", 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "default_storage_class": "", 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "placement_tags": [], 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "bucket_quota": { 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": false, 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size": -1, 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "max_objects": -1 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "user_quota": { 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": false, 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size": -1, 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "max_objects": -1 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "temp_url_keys": [], 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "rgw", 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "mfa_ids": [] 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-02-23T06:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:38:08.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.751+0000 7fce7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.753+0000 7fcfcc642800 20 remove_watcher() i=0 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.753+0000 7fcfcc642800 2 removed watcher, disabling cache 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.754+0000 7fcfcc642800 20 remove_watcher() i=1 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.755+0000 7fcfcc642800 20 remove_watcher() i=2 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.756+0000 7fcfcc642800 20 remove_watcher() i=3 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.757+0000 7fcfcc642800 20 remove_watcher() i=4 2024-02-23T06:38:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.758+0000 7fcfcc642800 20 remove_watcher() i=5 2024-02-23T06:38:08.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.759+0000 7fcfcc642800 20 remove_watcher() i=6 2024-02-23T06:38:08.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:08.760+0000 7fcfcc642800 20 remove_watcher() i=7 2024-02-23T06:38:08.771 INFO:tasks.ragweed:Configuring ragweed... 2024-02-23T06:38:08.771 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:38:08.771 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-02-23T06:38:08.799 INFO:tasks.ragweed:Configuring boto... 2024-02-23T06:38:08.799 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:38:08.799 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-02-23T06:38:08.866 DEBUG:teuthology.orchestra.run.smithi142:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-02-23T06:38:09.048 INFO:teuthology.orchestra.run.smithi142.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-02-23T06:38:09.215 INFO:teuthology.orchestra.run.smithi142.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-02-23T06:38:09.680 INFO:teuthology.orchestra.run.smithi142.stdout:py installdeps: -rrequirements.txt 2024-02-23T06:38:16.572 INFO:teuthology.orchestra.run.smithi142.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-02-23T06:38:18.625 INFO:teuthology.orchestra.run.smithi142.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==24.2.1,google-auth==2.27.0,gpg==1.15.1,greenlet==3.0.3,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.4.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.0.1,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=3613d85bfb0edc977bc2b498939188c2d8eb9ce87437f0cd8fa42e1d64096293,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.2 2024-02-23T06:38:18.625 INFO:teuthology.orchestra.run.smithi142.stdout:py run-test-pre: PYTHONHASHSEED='3273630993' 2024-02-23T06:38:18.625 INFO:teuthology.orchestra.run.smithi142.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-02-23T06:38:18.832 INFO:teuthology.orchestra.run.smithi142.stdout:============================= test session starts ============================== 2024-02-23T06:38:18.832 INFO:teuthology.orchestra.run.smithi142.stdout:platform linux -- Python 3.9.17, pytest-8.0.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-02-23T06:38:18.832 INFO:teuthology.orchestra.run.smithi142.stdout:cachedir: .tox/py/.pytest_cache 2024-02-23T06:38:18.833 INFO:teuthology.orchestra.run.smithi142.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-02-23T06:38:18.833 INFO:teuthology.orchestra.run.smithi142.stdout:configfile: pytest.ini 2024-02-23T06:38:18.932 INFO:teuthology.orchestra.run.smithi142.stdout:collecting ... collected 9 items 2024-02-23T06:38:18.932 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:38:19.410 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-02-23T06:38:19.905 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-02-23T06:38:20.379 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-02-23T06:38:20.986 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-02-23T06:38:21.522 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-02-23T06:38:27.750 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-02-23T06:38:29.031 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-02-23T06:38:30.203 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-02-23T06:38:32.380 INFO:teuthology.orchestra.run.smithi142.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-02-23T06:38:32.380 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:38:32.380 INFO:teuthology.orchestra.run.smithi142.stdout:=============================== warnings summary =============================== 2024-02-23T06:38:32.381 INFO:teuthology.orchestra.run.smithi142.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-02-23T06:38:32.381 INFO:teuthology.orchestra.run.smithi142.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-02-23T06:38:32.381 INFO:teuthology.orchestra.run.smithi142.stdout: import imp 2024-02-23T06:38:32.381 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:38:32.381 INFO:teuthology.orchestra.run.smithi142.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-02-23T06:38:32.381 INFO:teuthology.orchestra.run.smithi142.stdout:======================== 9 passed, 1 warning in 13.55s ========================= 2024-02-23T06:38:32.414 INFO:teuthology.orchestra.run.smithi142.stdout:___________________________________ summary ____________________________________ 2024-02-23T06:38:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: py: commands succeeded 2024-02-23T06:38:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: congratulations :) 2024-02-23T06:38:32.429 INFO:tasks.ragweed:Cleaning up boto... 2024-02-23T06:38:32.429 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-02-23T06:38:32.456 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-02-23T06:38:32.550 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:38:32.550 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:38:32.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.579+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 realm 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.580+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.581+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:32.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.581+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.582+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:38:32.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.582+0000 7f2d18816800 20 searching for the correct realm 2024-02-23T06:38:32.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.585+0000 7f2d1444c640 0 -- 172.21.15.142:0/913934793 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x561726c43360 msgr2=0x561726c45800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:32.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.589+0000 7f2d13c4b640 0 -- 172.21.15.142:0/913934793 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f2d080a4410 msgr2=0x7f2d080a4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:32.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.794+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 zone default found 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 4 Realm: () 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 zonegroup default 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.795+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.796+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.796+0000 7f2d18816800 20 started sync module instance, tier type = 2024-02-23T06:38:32.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.796+0000 7f2d18816800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=0 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=1 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=2 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=3 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=4 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=5 2024-02-23T06:38:32.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.805+0000 7f2d18816800 20 add_watcher() i=6 2024-02-23T06:38:32.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.806+0000 7f2d18816800 20 add_watcher() i=7 2024-02-23T06:38:32.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.806+0000 7f2d18816800 2 all 8 watchers are set, enabling cache 2024-02-23T06:38:32.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.808+0000 7f2bc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:32.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.808+0000 7f2d18816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:38:32.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.808+0000 7f2d18816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:38:32.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.846+0000 7f2bc8fe1640 20 reqs_thread_entry: start 2024-02-23T06:38:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.846+0000 7f2d18816800 20 init_complete bucket index max shards: 11 2024-02-23T06:38:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.846+0000 7f2d18816800 20 Filter name: none 2024-02-23T06:38:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.846+0000 7f2b427fc640 20 reqs_thread_entry: start 2024-02-23T06:38:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.846+0000 7f2d18816800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-02-23T06:38:32.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.846+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.847+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=453 2024-02-23T06:38:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.847+0000 7f2d18816800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-02-23T06:38:32.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.847+0000 7f2d18816800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-02-23T06:38:32.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.847+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.847+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 : miss 2024-02-23T06:38:32.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.847+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.848+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.848+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 info.flags=0x17 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.848+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 to cache LRU end 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.848+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.848+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.848+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.849+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.849+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.849+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-02-23T06:38:32.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.850+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-02-23T06:38:32.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.850+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-02-23T06:38:32.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.850+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-02-23T06:38:32.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.850+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-02-23T06:38:32.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.851+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-02-23T06:38:32.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.851+0000 7f2d18816800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-02-23T06:38:32.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.852+0000 7f2d18816800 20 get_obj_state: octx=0x561726bf4510 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x561726d0bbd8 s->prefetch_data=0 2024-02-23T06:38:32.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.853+0000 7f2d18816800 10 manifest: total_size = 5242 2024-02-23T06:38:32.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.853+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6657006185926036815 2024-02-23T06:38:32.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.853+0000 7f2d18816800 20 get_obj_state: octx=0x561726bf4510 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x561726d0bbd8 s->prefetch_data=0 2024-02-23T06:38:32.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.853+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0bbd8 2024-02-23T06:38:32.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.853+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.1 2024-02-23T06:38:32.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242 stripe_ofs=5242 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6657006185926036815 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.cMF-Jb_03_yGpfY5CXX17bITqEqwsa9_0 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.855+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6657006185926036815 2024-02-23T06:38:32.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.856+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-02-23T06:38:32.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.857+0000 7f2d18816800 20 get_obj_state: octx=0x561726bf4510 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x561726d0b6b8 s->prefetch_data=0 2024-02-23T06:38:32.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.857+0000 7f2d18816800 10 manifest: total_size = 4795 2024-02-23T06:38:32.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.857+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10634783006803500938 2024-02-23T06:38:32.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.857+0000 7f2d18816800 20 get_obj_state: octx=0x561726bf4510 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x561726d0b6b8 s->prefetch_data=0 2024-02-23T06:38:32.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.857+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b6b8 2024-02-23T06:38:32.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.857+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.2 2024-02-23T06:38:32.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=4795 stripe_ofs=4795 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10634783006803500938 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.jMismdTMrQ5WSCXcxXHe90-0L4QLbbk_0 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.860+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10634783006803500938 2024-02-23T06:38:32.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.861+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-02-23T06:38:32.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.861+0000 7f2d18816800 20 get_obj_state: octx=0x561726bf4510 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.862+0000 7f2d18816800 10 manifest: total_size = 7605 2024-02-23T06:38:32.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.862+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16787921910888933228 2024-02-23T06:38:32.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.862+0000 7f2d18816800 20 get_obj_state: octx=0x561726bf4510 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.862+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.862+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.2 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7605 stripe_ofs=7605 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16787921910888933228 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.GtOW_8Ymjm-AjMz7GVpM8xytue3zrqW_0 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.864+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16787921910888933228 2024-02-23T06:38:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.865+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-02-23T06:38:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.866+0000 7f2d18816800 20 get_obj_state: octx=0x561726c5d6f0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.866+0000 7f2d18816800 10 manifest: total_size = 4909 2024-02-23T06:38:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.866+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2993556332735344771 2024-02-23T06:38:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.866+0000 7f2d18816800 20 get_obj_state: octx=0x561726c5d6f0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.866+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.866+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.3 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=4909 stripe_ofs=4909 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2993556332735344771 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.FP8DAXpPnxvQ1z2hQzgkt3tuhaaaHJm_0 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.868+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2993556332735344771 2024-02-23T06:38:32.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.869+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-02-23T06:38:32.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.870+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401d190 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.870+0000 7f2d18816800 10 manifest: total_size = 7550 2024-02-23T06:38:32.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.870+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6602948198557076738 2024-02-23T06:38:32.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.870+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401d190 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.870+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.870+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.4 2024-02-23T06:38:32.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7550 stripe_ofs=7550 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6602948198557076738 2024-02-23T06:38:32.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.AmmueiEjBZE_A-W0JG9-oVY0ydEy3fq_0 2024-02-23T06:38:32.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:32.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.873+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6602948198557076738 2024-02-23T06:38:32.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.874+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-02-23T06:38:32.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.874+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08089f80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.875+0000 7f2d18816800 10 manifest: total_size = 4883 2024-02-23T06:38:32.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.875+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7440375449257695044 2024-02-23T06:38:32.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.875+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08089f80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.875+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.875+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.4 2024-02-23T06:38:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=4883 stripe_ofs=4883 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7440375449257695044 2024-02-23T06:38:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.ytAZNt40_89knic5AYbxRyhH59FJ_wC_0 2024-02-23T06:38:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:32.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.877+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7440375449257695044 2024-02-23T06:38:32.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-02-23T06:38:32.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2d18816800 20 get_obj_state: octx=0x561726c967b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2d18816800 10 manifest: total_size = 4808 2024-02-23T06:38:32.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.232369318008395379 2024-02-23T06:38:32.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2d18816800 20 get_obj_state: octx=0x561726c967b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.878+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.5 2024-02-23T06:38:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=4808 stripe_ofs=4808 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.232369318008395379 2024-02-23T06:38:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.85GlJmzs3QMi8JUvuaEcgV8g_obZKjP_0 2024-02-23T06:38:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-02-23T06:38:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.881+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.232369318008395379 2024-02-23T06:38:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-02-23T06:38:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401de40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2d18816800 10 manifest: total_size = 7713 2024-02-23T06:38:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8805735857579422730 2024-02-23T06:38:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401de40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.882+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.7 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7713 stripe_ofs=7713 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8805735857579422730 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.jmMkelkTVoY_8P4usmzwCmK5C_3Txeq_0 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.885+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8805735857579422730 2024-02-23T06:38:32.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.886+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-02-23T06:38:32.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.886+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401de40 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.887+0000 7f2d18816800 10 manifest: total_size = 8641 2024-02-23T06:38:32.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.887+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1230334010915597612 2024-02-23T06:38:32.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.887+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401de40 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x561726d0b308 s->prefetch_data=0 2024-02-23T06:38:32.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.887+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b308 2024-02-23T06:38:32.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.887+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4.8 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=8641 stripe_ofs=8641 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1230334010915597612 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.CkQbi4Ea8g04K2wIzjD_B1d2sYC81FH_0 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.890+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1230334010915597612 2024-02-23T06:38:32.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.891+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-02-23T06:38:32.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.891+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:32.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.891+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:32.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.892+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:32.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.892+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:32.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.892+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:32.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.892+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:32.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.892+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:32.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.894+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-02-23T06:38:32.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.894+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.894+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=204 2024-02-23T06:38:32.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.894+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-02-23T06:38:32.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.894+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-02-23T06:38:32.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.895+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-02-23T06:38:32.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.895+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-02-23T06:38:32.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.895+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693212 cookie 94657434634848 notifier 5666 bl.length()=162 2024-02-23T06:38:32.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.897+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 from cache 2024-02-23T06:38:32.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.897+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4, ofs0, ns] 2024-02-23T06:38:32.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.898+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693245 cookie 94657434689824 notifier 5666 bl.length()=219 2024-02-23T06:38:32.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.900+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 : miss 2024-02-23T06:38:32.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.900+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.901+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.901+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 info.flags=0x0 2024-02-23T06:38:32.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.901+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4 to cache LRU end 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.902+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 : miss 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.902+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.903+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=409 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.903+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 info.flags=0x17 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.903+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 to cache LRU end 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.903+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.903+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:32.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.903+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 2024-02-23T06:38:32.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo 2024-02-23T06:38:32.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x561726d0b2d8 s->prefetch_data=0 2024-02-23T06:38:32.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 10 manifest: total_size = 26081 2024-02-23T06:38:32.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17856747914620662692 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x561726d0b2d8 s->prefetch_data=0 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726d0b2d8 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.907+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11.10 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7672 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7671 2024-02-23T06:38:32.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=7671 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6314470 part_ofs=23014 rule->part_size=3067 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17856747914620662692 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.1 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.2 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.3 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-02-23T06:38:32.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.4 2024-02-23T06:38:32.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-02-23T06:38:32.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.910+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17856747914620662692 2024-02-23T06:38:32.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.911+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:32.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.911+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:32.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.911+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.912+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.912+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.912+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.912+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.912+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.913+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.913+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.914+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=235 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.914+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-02-23T06:38:32.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.914+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-02-23T06:38:32.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.915+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-02-23T06:38:32.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.915+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-02-23T06:38:32.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.915+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693235 cookie 94657434632640 notifier 5666 bl.length()=191 2024-02-23T06:38:32.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.917+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 from cache 2024-02-23T06:38:32.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.917+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11, ofs0, ns] 2024-02-23T06:38:32.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.917+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693236 cookie 94657434632640 notifier 5666 bl.length()=249 2024-02-23T06:38:32.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.920+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 : miss 2024-02-23T06:38:32.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.920+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.920+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.920+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 info.flags=0x0 2024-02-23T06:38:32.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.920+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11 to cache LRU end 2024-02-23T06:38:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.922+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 : miss 2024-02-23T06:38:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.922+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.923+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=416 2024-02-23T06:38:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.923+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 info.flags=0x17 2024-02-23T06:38:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.923+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 to cache LRU end 2024-02-23T06:38:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.923+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.923+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.923+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 2024-02-23T06:38:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo 2024-02-23T06:38:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 20 get_obj_state: octx=0x561726c34450 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x561726c8cbd8 s->prefetch_data=0 2024-02-23T06:38:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 10 manifest: total_size = 886297 2024-02-23T06:38:32.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7516980728936741526 2024-02-23T06:38:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 20 get_obj_state: octx=0x561726c34450 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x561726c8cbd8 s->prefetch_data=0 2024-02-23T06:38:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c8cbd8 2024-02-23T06:38:32.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.927+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12.10 2024-02-23T06:38:32.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-02-23T06:38:32.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-02-23T06:38:32.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-02-23T06:38:32.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-02-23T06:38:32.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-02-23T06:38:32.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7516980728936741526 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.1 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.2 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.3 2024-02-23T06:38:32.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-02-23T06:38:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.4 2024-02-23T06:38:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-02-23T06:38:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.930+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7516980728936741526 2024-02-23T06:38:32.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.931+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.931+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.931+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.932+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.932+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.932+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.932+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.932+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:32.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.933+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-02-23T06:38:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.933+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.934+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=242 2024-02-23T06:38:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.934+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-02-23T06:38:32.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.934+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-02-23T06:38:32.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.935+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-02-23T06:38:32.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.935+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-02-23T06:38:32.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.936+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 94657434680208 notifier 5666 bl.length()=198 2024-02-23T06:38:32.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.937+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 from cache 2024-02-23T06:38:32.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.937+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12, ofs0, ns] 2024-02-23T06:38:32.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.937+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693246 cookie 94657434692096 notifier 5666 bl.length()=256 2024-02-23T06:38:32.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.940+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 : miss 2024-02-23T06:38:32.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.940+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.940+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.940+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 info.flags=0x0 2024-02-23T06:38:32.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.941+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12 to cache LRU end 2024-02-23T06:38:32.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.942+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 : miss 2024-02-23T06:38:32.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=411 2024-02-23T06:38:32.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 info.flags=0x17 2024-02-23T06:38:32.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 to cache LRU end 2024-02-23T06:38:32.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:32.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.943+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 2024-02-23T06:38:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.947+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo[XOGxiRyfXfsWumEVEYO5AyWycdiJCYf] 2024-02-23T06:38:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.947+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10.10 2024-02-23T06:38:32.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.947+0000 7f2d18816800 20 get_obj_state: octx=0x561726ca16c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x561726c4d088 s->prefetch_data=0 2024-02-23T06:38:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.948+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 2vr5exzgakcuwovekc00xyu90if6kpdh 2024-02-23T06:38:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.948+0000 7f2d18816800 20 get_obj_state_impl: setting s->olh_tag to 3h69sb9yis8dgmtlr9tctbmakc2ty7uh 2024-02-23T06:38:32.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.948+0000 7f2d18816800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3h69sb9yis8dgmtlr9tctbmakc2ty7uh 2024-02-23T06:38:32.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.949+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10.10 2024-02-23T06:38:32.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.950+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10.10 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.950+0000 7f2d18816800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.950+0000 7f2d18816800 20 olh_log_entry: epoch=3 op=3 key=foo[XOGxiRyfXfsWumEVEYO5AyWycdiJCYf] 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.950+0000 7f2d18816800 20 get_obj_state: octx=0x561726ca16c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:XOGxiRyfXfsWumEVEYO5AyWycdiJCYf_foo state=0x561726c90998 s->prefetch_data=0 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.951+0000 7f2d18816800 10 manifest: total_size = 18874368 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.951+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12273871392820477837 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.951+0000 7f2d18816800 20 get_obj_state: octx=0x561726ca16c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:XOGxiRyfXfsWumEVEYO5AyWycdiJCYf_foo state=0x561726c90998 s->prefetch_data=0 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.951+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c90998 2024-02-23T06:38:32.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.951+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10.10 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-02-23T06:38:32.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12273871392820477837 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.1 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.2 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.3 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.4 2024-02-23T06:38:32.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-02-23T06:38:32.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.953+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12273871392820477837 2024-02-23T06:38:32.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.954+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo[XOGxiRyfXfsWumEVEYO5AyWycdiJCYf] 2024-02-23T06:38:32.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.955+0000 7f2d18816800 20 get_obj_state: octx=0x561726ca16c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x561726c4d088 s->prefetch_data=0 2024-02-23T06:38:32.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.957+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10.10 2024-02-23T06:38:32.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10.10 2024-02-23T06:38:32.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:32.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:32.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:32.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:32.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:32.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:32.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.958+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:32.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.960+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-02-23T06:38:32.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.960+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.961+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=237 2024-02-23T06:38:32.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.961+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-02-23T06:38:32.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.961+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-02-23T06:38:32.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.961+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-02-23T06:38:32.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.961+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-02-23T06:38:32.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.962+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 94657434680208 notifier 5666 bl.length()=193 2024-02-23T06:38:32.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.963+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 from cache 2024-02-23T06:38:32.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.963+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10, ofs0, ns] 2024-02-23T06:38:32.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.964+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693213 cookie 94657434681392 notifier 5666 bl.length()=251 2024-02-23T06:38:32.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.966+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 : miss 2024-02-23T06:38:32.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.966+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.967+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.967+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 info.flags=0x0 2024-02-23T06:38:32.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.967+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10 to cache LRU end 2024-02-23T06:38:32.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.968+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 : miss 2024-02-23T06:38:32.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.968+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.969+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=399 2024-02-23T06:38:32.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.969+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 info.flags=0x17 2024-02-23T06:38:32.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.969+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 to cache LRU end 2024-02-23T06:38:32.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.969+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.969+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:32.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.969+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 2024-02-23T06:38:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo 2024-02-23T06:38:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 20 get_obj_state: octx=0x561726c95a60 obj=test-client.0-r-test-multipart-simple.1:foo state=0x561726c4d088 s->prefetch_data=0 2024-02-23T06:38:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 10 manifest: total_size = 886297 2024-02-23T06:38:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1610976608645282495 2024-02-23T06:38:32.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 20 get_obj_state: octx=0x561726c95a60 obj=test-client.0-r-test-multipart-simple.1:foo state=0x561726c4d088 s->prefetch_data=0 2024-02-23T06:38:32.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c4d088 2024-02-23T06:38:32.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.973+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9.10 2024-02-23T06:38:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-02-23T06:38:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-02-23T06:38:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-02-23T06:38:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-02-23T06:38:32.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.975+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1610976608645282495 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.1 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.2 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.3 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.4 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-02-23T06:38:32.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.976+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1610976608645282495 2024-02-23T06:38:32.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.977+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.977+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.977+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.978+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.978+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.978+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.978+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.978+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:32.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.980+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-02-23T06:38:32.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.980+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.980+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=225 2024-02-23T06:38:32.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.980+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-02-23T06:38:32.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.980+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-02-23T06:38:32.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.981+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-02-23T06:38:32.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.981+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-02-23T06:38:32.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.981+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693214 cookie 94657434681392 notifier 5666 bl.length()=183 2024-02-23T06:38:32.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.983+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 from cache 2024-02-23T06:38:32.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.983+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9, ofs0, ns] 2024-02-23T06:38:32.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.983+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693204 cookie 94657434684432 notifier 5666 bl.length()=240 2024-02-23T06:38:32.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.986+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 : miss 2024-02-23T06:38:32.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.986+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.986+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:32.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.986+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 info.flags=0x0 2024-02-23T06:38:32.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.986+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9 to cache LRU end 2024-02-23T06:38:32.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 : miss 2024-02-23T06:38:32.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=407 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 info.flags=0x17 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 to cache LRU end 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.988+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 2024-02-23T06:38:32.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.989+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-02-23T06:38:32.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.989+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-02-23T06:38:32.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.989+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-02-23T06:38:32.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.990+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-02-23T06:38:32.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.990+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-02-23T06:38:32.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.990+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-02-23T06:38:32.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.991+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-02-23T06:38:32.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.991+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-02-23T06:38:32.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.991+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-02-23T06:38:32.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.991+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-02-23T06:38:32.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.991+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-02-23T06:38:32.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-02-23T06:38:32.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 20 get_obj_state: octx=0x5617269ebe90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:32.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 10 manifest: total_size = 27195 2024-02-23T06:38:32.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _XU4mGUJNa97bIvisseAXVo3JxbLRCVN 2024-02-23T06:38:32.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 20 get_obj_state: octx=0x5617269ebe90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:32.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:32.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.992+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.0 2024-02-23T06:38:32.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:32.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-02-23T06:38:32.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _XU4mGUJNa97bIvisseAXVo3JxbLRCVN 2024-02-23T06:38:32.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:32.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.oMgPJamIc5TSWYyrG9Eger3KYGUBUxe_0 2024-02-23T06:38:32.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-02-23T06:38:32.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:32.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.995+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _XU4mGUJNa97bIvisseAXVo3JxbLRCVN 2024-02-23T06:38:32.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.996+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-02-23T06:38:32.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.996+0000 7f2d18816800 20 get_obj_state: octx=0x561726c98550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:32.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.997+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:32.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.997+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _g4_PDrqelXMREOH5wE4h-Lnz3hevzRz 2024-02-23T06:38:32.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.997+0000 7f2d18816800 20 get_obj_state: octx=0x561726c98550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:32.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.997+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:32.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.997+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.2 2024-02-23T06:38:33.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _g4_PDrqelXMREOH5wE4h-Lnz3hevzRz 2024-02-23T06:38:33.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.n1fLNEN-JAwzQGIqxf0L8Gx0OQuu347_0 2024-02-23T06:38:33.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-02-23T06:38:33.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:32.999+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _g4_PDrqelXMREOH5wE4h-Lnz3hevzRz 2024-02-23T06:38:33.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.000+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-02-23T06:38:33.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.000+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04056500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.001+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.001+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12672564331011346497 2024-02-23T06:38:33.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.001+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04056500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.001+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.001+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.3 2024-02-23T06:38:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12672564331011346497 2024-02-23T06:38:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_0 2024-02-23T06:38:33.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-02-23T06:38:33.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.003+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12672564331011346497 2024-02-23T06:38:33.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-02-23T06:38:33.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2d18816800 20 get_obj_state: octx=0x561726c93980 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _zi_eTFATVU7lb0XKPzsPH1WfY-fYj33 2024-02-23T06:38:33.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2d18816800 20 get_obj_state: octx=0x561726c93980 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.004+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.5 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _zi_eTFATVU7lb0XKPzsPH1WfY-fYj33 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.Zjt9Xc-3wfFdciaDOR_OLfXRvk94-BC_0 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-02-23T06:38:33.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.007+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _zi_eTFATVU7lb0XKPzsPH1WfY-fYj33 2024-02-23T06:38:33.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-02-23T06:38:33.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2d18816800 20 get_obj_state: octx=0x561726c8d450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _z5QTebImEdS1yM7UWwCTUaRN-kUb6_F 2024-02-23T06:38:33.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2d18816800 20 get_obj_state: octx=0x561726c8d450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.008+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.5 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _z5QTebImEdS1yM7UWwCTUaRN-kUb6_F 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.VebeH0ywJEvG41SKrRR7IY7xwuQ3xQ8_0 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.010+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _z5QTebImEdS1yM7UWwCTUaRN-kUb6_F 2024-02-23T06:38:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.011+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-02-23T06:38:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.012+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04056500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.012+0000 7f2d18816800 10 manifest: total_size = 27195 2024-02-23T06:38:33.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.012+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3905039273267040397 2024-02-23T06:38:33.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.012+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04056500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.012+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.012+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.5 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3905039273267040397 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_0 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-02-23T06:38:33.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.014+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3905039273267040397 2024-02-23T06:38:33.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.015+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-02-23T06:38:33.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.016+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.016+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.016+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _62wvrZD6VPfE57W2oTm_1mtkUfN26R- 2024-02-23T06:38:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.016+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.016+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.016+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.7 2024-02-23T06:38:33.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _62wvrZD6VPfE57W2oTm_1mtkUfN26R- 2024-02-23T06:38:33.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.qD4vNcXjo1mUjD_DUJtgmADbfZzx6yI_0 2024-02-23T06:38:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-02-23T06:38:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.018+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _62wvrZD6VPfE57W2oTm_1mtkUfN26R- 2024-02-23T06:38:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-02-23T06:38:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11495236592740289971 2024-02-23T06:38:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.020+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.7 2024-02-23T06:38:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11495236592740289971 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_0 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.023+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11495236592740289971 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.024+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-02-23T06:38:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.024+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04056500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 10 manifest: total_size = 27195 2024-02-23T06:38:33.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 10 generate_fake_tag new tag=7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_1_4e473e926fc6451890b2ad9bed6fbbcf 2024-02-23T06:38:33.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_1_4e473e926fc6451890b2ad9bed6fbbcf 2024-02-23T06:38:33.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04056500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.025+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.7 2024-02-23T06:38:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_1_4e473e926fc6451890b2ad9bed6fbbcf 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_0 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 389 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.027+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_1_4e473e926fc6451890b2ad9bed6fbbcf 2024-02-23T06:38:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.028+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-02-23T06:38:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 10 generate_fake_tag new tag=7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_1_6831f058432f212db9b7b96b44594d7f 2024-02-23T06:38:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_1_6831f058432f212db9b7b96b44594d7f 2024-02-23T06:38:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.029+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.8 2024-02-23T06:38:33.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_1_6831f058432f212db9b7b96b44594d7f 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_0 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.031+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_1_6831f058432f212db9b7b96b44594d7f 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.032+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.032+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.033+0000 7f2d18816800 10 manifest: total_size = 27195 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.033+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _F9GdTqnD1bWq7BC7_DyILKixADQHNvE 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.033+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.033+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.033+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.8 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _F9GdTqnD1bWq7BC7_DyILKixADQHNvE 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.ONtuVYkeWCS6HqyJBENV6VI14gbvr9y_0 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.035+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _F9GdTqnD1bWq7BC7_DyILKixADQHNvE 2024-02-23T06:38:33.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-02-23T06:38:33.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 10 manifest: total_size = 5242880 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 10 generate_fake_tag new tag=7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_1_d023ea62a1fa31314d8e7f97bd237367 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_1_d023ea62a1fa31314d8e7f97bd237367 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.037+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15.9 2024-02-23T06:38:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_1_d023ea62a1fa31314d8e7f97bd237367 2024-02-23T06:38:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_0 2024-02-23T06:38:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-02-23T06:38:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.039+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_1_d023ea62a1fa31314d8e7f97bd237367 2024-02-23T06:38:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.040+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-02-23T06:38:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.040+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.040+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.041+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.041+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.041+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.041+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.041+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.043+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-02-23T06:38:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.043+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.043+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=233 2024-02-23T06:38:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.043+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-02-23T06:38:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.043+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-02-23T06:38:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.044+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-02-23T06:38:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.044+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-02-23T06:38:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.045+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693201 cookie 94657434680208 notifier 5666 bl.length()=189 2024-02-23T06:38:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.046+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 from cache 2024-02-23T06:38:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.046+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15, ofs0, ns] 2024-02-23T06:38:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.046+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693215 cookie 94657434681392 notifier 5666 bl.length()=247 2024-02-23T06:38:33.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.049+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 : miss 2024-02-23T06:38:33.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.049+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.049+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.049+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 info.flags=0x0 2024-02-23T06:38:33.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.049+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15 to cache LRU end 2024-02-23T06:38:33.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 : miss 2024-02-23T06:38:33.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=417 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 info.flags=0x17 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 to cache LRU end 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.051+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 2024-02-23T06:38:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.052+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-02-23T06:38:33.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.053+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-02-23T06:38:33.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.053+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-02-23T06:38:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.054+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-02-23T06:38:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.054+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-02-23T06:38:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.054+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-02-23T06:38:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.054+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-02-23T06:38:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.054+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-02-23T06:38:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.054+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-02-23T06:38:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.055+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-02-23T06:38:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.055+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-02-23T06:38:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.055+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-02-23T06:38:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.055+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04059720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.056+0000 7f2d18816800 10 manifest: total_size = 16377 2024-02-23T06:38:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.056+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _Dm26SRyD8bJyaEcCYyzJJaHnXplptwV 2024-02-23T06:38:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.056+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d04059720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.056+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.056+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.0 2024-02-23T06:38:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _Dm26SRyD8bJyaEcCYyzJJaHnXplptwV 2024-02-23T06:38:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.31ARpUfE0R15wmWGc6Y1zG_Mf0tdAiH_0 2024-02-23T06:38:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-02-23T06:38:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.058+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _Dm26SRyD8bJyaEcCYyzJJaHnXplptwV 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d040700c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _2eLEl0wTwkTY7B0aKeDhXQfkdrbzaIG 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d040700c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.059+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.2 2024-02-23T06:38:33.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _2eLEl0wTwkTY7B0aKeDhXQfkdrbzaIG 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.SFmVqo0KO8XmirrrYC3q7RBbeMtyaAh_0 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.SFmVqo0KO8XmirrrYC3q7RBbeMtyaAh_1 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.062+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _2eLEl0wTwkTY7B0aKeDhXQfkdrbzaIG 2024-02-23T06:38:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.063+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d040700c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.063+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-02-23T06:38:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.064+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.064+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3477438124948925070 2024-02-23T06:38:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.064+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d040700c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.064+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.064+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.3 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-02-23T06:38:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3477438124948925070 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.1 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.3 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.066+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3477438124948925070 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.067+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.068+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.068+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.068+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _vob4BX82C6G1QnDqmUSnLwEvjMtsOuL 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.068+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.068+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.068+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.5 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _vob4BX82C6G1QnDqmUSnLwEvjMtsOuL 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.XGIwL3kvxyj97K57BUF6f98KB1-OOQh_0 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.XGIwL3kvxyj97K57BUF6f98KB1-OOQh_1 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.070+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _vob4BX82C6G1QnDqmUSnLwEvjMtsOuL 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.071+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.071+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08095540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.072+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.072+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _FEVVPPnDYq4AEJu4xF25Hj4_6lDOIxW 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.072+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08095540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.072+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.072+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.5 2024-02-23T06:38:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _FEVVPPnDYq4AEJu4xF25Hj4_6lDOIxW 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.PbHiy5XlxZM5Ix8B4bRIdKUrLA30k6O_0 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.PbHiy5XlxZM5Ix8B4bRIdKUrLA30k6O_1 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.074+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _FEVVPPnDYq4AEJu4xF25Hj4_6lDOIxW 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.075+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.075+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0c029e70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.076+0000 7f2d18816800 10 manifest: total_size = 16377 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.076+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13264420476750456153 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.076+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0c029e70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.076+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.076+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.5 2024-02-23T06:38:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-02-23T06:38:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-02-23T06:38:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13264420476750456153 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.1 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.3 2024-02-23T06:38:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-02-23T06:38:33.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.078+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13264420476750456153 2024-02-23T06:38:33.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-02-23T06:38:33.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _lLF75WAI7JsKibIxwZJQNeQ65HgwxYC 2024-02-23T06:38:33.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.079+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.7 2024-02-23T06:38:33.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _lLF75WAI7JsKibIxwZJQNeQ65HgwxYC 2024-02-23T06:38:33.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.NfENy_rTMzWfXqJAZaa50ab5J1HQ4oH_0 2024-02-23T06:38:33.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-02-23T06:38:33.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.NfENy_rTMzWfXqJAZaa50ab5J1HQ4oH_1 2024-02-23T06:38:33.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-02-23T06:38:33.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.082+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _lLF75WAI7JsKibIxwZJQNeQ65HgwxYC 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08095540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12337579225015592496 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08095540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.083+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.7 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12337579225015592496 2024-02-23T06:38:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.1 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.3 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.085+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12337579225015592496 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401d190 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 10 manifest: total_size = 16377 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 10 generate_fake_tag new tag=7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2_58735bfaa27f1d39e76828e5f9966ee4 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2_58735bfaa27f1d39e76828e5f9966ee4 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0401d190 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.087+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.7 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-02-23T06:38:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2_58735bfaa27f1d39e76828e5f9966ee4 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.1 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.3 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.090+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2_58735bfaa27f1d39e76828e5f9966ee4 2024-02-23T06:38:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-02-23T06:38:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 10 generate_fake_tag new tag=7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2_4b795c6a04bb88ccd48506283e84253f 2024-02-23T06:38:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2_4b795c6a04bb88ccd48506283e84253f 2024-02-23T06:38:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.091+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.8 2024-02-23T06:38:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.093+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2_4b795c6a04bb88ccd48506283e84253f 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.1 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 449 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 722 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.3 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 995 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.094+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2_4b795c6a04bb88ccd48506283e84253f 2024-02-23T06:38:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-02-23T06:38:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2d18816800 10 manifest: total_size = 16377 2024-02-23T06:38:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to _93F-_Zc_7beN_pptry41J-5jEOln9Le 2024-02-23T06:38:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.095+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.8 2024-02-23T06:38:33.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: _93F-_Zc_7beN_pptry41J-5jEOln9Le 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.4hWm-Yn4O2qUimsuDdxgo4DlGSwsu3W_0 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.097+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _93F-_Zc_7beN_pptry41J-5jEOln9Le 2024-02-23T06:38:33.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.098+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 get_obj_state: octx=0x561726c54610 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 10 generate_fake_tag new tag=7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2_50e80a6da848a48dfa3a8d30955e8ca0 2024-02-23T06:38:33.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2_50e80a6da848a48dfa3a8d30955e8ca0 2024-02-23T06:38:33.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 get_obj_state: octx=0x561726c54610 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x561726cb01f8 s->prefetch_data=0 2024-02-23T06:38:33.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726cb01f8 2024-02-23T06:38:33.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.099+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16.9 2024-02-23T06:38:33.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2_50e80a6da848a48dfa3a8d30955e8ca0 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.1 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 441 2024-02-23T06:38:33.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2 2024-02-23T06:38:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 708 2024-02-23T06:38:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.3 2024-02-23T06:38:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 975 2024-02-23T06:38:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.101+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2_50e80a6da848a48dfa3a8d30955e8ca0 2024-02-23T06:38:33.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.102+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.102+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.102+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.103+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.103+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.103+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.103+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.103+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.105+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-02-23T06:38:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.105+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.105+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=243 2024-02-23T06:38:33.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.105+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-02-23T06:38:33.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.105+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-02-23T06:38:33.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.106+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-02-23T06:38:33.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.106+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-02-23T06:38:33.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.107+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693205 cookie 94657434684432 notifier 5666 bl.length()=199 2024-02-23T06:38:33.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.108+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 from cache 2024-02-23T06:38:33.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.108+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16, ofs0, ns] 2024-02-23T06:38:33.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.109+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693197 cookie 94657434694768 notifier 5666 bl.length()=257 2024-02-23T06:38:33.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.111+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 : miss 2024-02-23T06:38:33.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.111+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.111+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.111+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 info.flags=0x0 2024-02-23T06:38:33.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.111+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16 to cache LRU end 2024-02-23T06:38:33.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.113+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 : miss 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.113+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.114+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=412 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.114+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 info.flags=0x17 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.114+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 to cache LRU end 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.114+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.114+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.114+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.115+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-02-23T06:38:33.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.116+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-02-23T06:38:33.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.117+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-02-23T06:38:33.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.118+0000 7f2d18816800 20 get_obj_state: octx=0x561726c4f090 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.118+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.118+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2344351711385468193 2024-02-23T06:38:33.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.118+0000 7f2d18816800 20 get_obj_state: octx=0x561726c4f090 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.118+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c91d78 2024-02-23T06:38:33.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.118+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14.3 2024-02-23T06:38:33.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2344351711385468193 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-FROZEN.2~3nENm3ybA8wavTgSbGcxBQ4Yw7IkfOx.1 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-FROZEN.2~3nENm3ybA8wavTgSbGcxBQ4Yw7IkfOx.2 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-FROZEN.2~3nENm3ybA8wavTgSbGcxBQ4Yw7IkfOx.3 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.121+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2344351711385468193 2024-02-23T06:38:33.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-02-23T06:38:33.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2d18816800 20 get_obj_state: octx=0x561726ca38f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2d18816800 10 manifest: total_size = 16378 2024-02-23T06:38:33.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4285450810685467939 2024-02-23T06:38:33.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2d18816800 20 get_obj_state: octx=0x561726ca38f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c91d78 2024-02-23T06:38:33.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.122+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14.5 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7672 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4285450810685467939 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-STANDARD.2~gvthoWONe8h9KQfOJA5TKQDPnspHIfg.1 2024-02-23T06:38:33.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-02-23T06:38:33.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-STANDARD.2~gvthoWONe8h9KQfOJA5TKQDPnspHIfg.2 2024-02-23T06:38:33.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-02-23T06:38:33.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-STANDARD.2~gvthoWONe8h9KQfOJA5TKQDPnspHIfg.3 2024-02-23T06:38:33.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-02-23T06:38:33.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.124+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4285450810685467939 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.125+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.126+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.126+0000 7f2d18816800 10 manifest: total_size = 11534336 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.126+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3538922961312480066 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.126+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.126+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c91d78 2024-02-23T06:38:33.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.126+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14.7 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-02-23T06:38:33.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-02-23T06:38:33.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-02-23T06:38:33.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3538922961312480066 2024-02-23T06:38:33.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-LUKEWARM.2~JGUYkRvBXpJMIqYr2Psg6Cz5W4rTsqK.1 2024-02-23T06:38:33.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-02-23T06:38:33.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-LUKEWARM.2~JGUYkRvBXpJMIqYr2Psg6Cz5W4rTsqK.2 2024-02-23T06:38:33.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-02-23T06:38:33.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-LUKEWARM.2~JGUYkRvBXpJMIqYr2Psg6Cz5W4rTsqK.3 2024-02-23T06:38:33.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-02-23T06:38:33.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.129+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3538922961312480066 2024-02-23T06:38:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-02-23T06:38:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.130+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.132+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.132+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.133+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=238 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.133+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-02-23T06:38:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.133+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-02-23T06:38:33.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.134+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-02-23T06:38:33.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.134+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-02-23T06:38:33.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.134+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693247 cookie 94657434689824 notifier 5666 bl.length()=194 2024-02-23T06:38:33.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.136+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 from cache 2024-02-23T06:38:33.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.136+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14, ofs0, ns] 2024-02-23T06:38:33.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.136+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94657434694768 notifier 5666 bl.length()=252 2024-02-23T06:38:33.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.138+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 : miss 2024-02-23T06:38:33.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.138+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.138+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.138+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 info.flags=0x0 2024-02-23T06:38:33.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.138+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14 to cache LRU end 2024-02-23T06:38:33.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 : miss 2024-02-23T06:38:33.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=402 2024-02-23T06:38:33.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 info.flags=0x17 2024-02-23T06:38:33.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 to cache LRU end 2024-02-23T06:38:33.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:33.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.141+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 2024-02-23T06:38:33.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.143+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-02-23T06:38:33.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.144+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-02-23T06:38:33.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.144+0000 7f2d18816800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-02-23T06:38:33.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.145+0000 7f2d18816800 20 get_obj_state: octx=0x561726c57590 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.146+0000 7f2d18816800 10 manifest: total_size = 10485760 2024-02-23T06:38:33.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.146+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5878414035204845529 2024-02-23T06:38:33.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.146+0000 7f2d18816800 20 get_obj_state: octx=0x561726c57590 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.146+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c91d78 2024-02-23T06:38:33.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.146+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13.3 2024-02-23T06:38:33.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5878414035204845529 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.vEcqMg52L898ox-UMR579nytUAlQPq4_0 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.vEcqMg52L898ox-UMR579nytUAlQPq4_1 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.148+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5878414035204845529 2024-02-23T06:38:33.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.149+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-02-23T06:38:33.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.150+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.150+0000 7f2d18816800 10 manifest: total_size = 10485760 2024-02-23T06:38:33.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.150+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8540883754809531022 2024-02-23T06:38:33.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.150+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407f730 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.150+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c91d78 2024-02-23T06:38:33.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.150+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13.5 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8540883754809531022 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.jSnlRAK5v2wxQWh44BQ7vlgtPY6NgkQ_0 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.jSnlRAK5v2wxQWh44BQ7vlgtPY6NgkQ_1 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.152+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8540883754809531022 2024-02-23T06:38:33.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.153+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-02-23T06:38:33.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.153+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407c670 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.154+0000 7f2d18816800 10 manifest: total_size = 10485760 2024-02-23T06:38:33.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.154+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10643437094324557156 2024-02-23T06:38:33.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.154+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0407c670 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x561726c91d78 s->prefetch_data=0 2024-02-23T06:38:33.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.154+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726c91d78 2024-02-23T06:38:33.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.154+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13.7 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10643437094324557156 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.3cFScttGFHGLnrzeYUGUh7lQTd30dn7_0 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.3cFScttGFHGLnrzeYUGUh7lQTd30dn7_1 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.156+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10643437094324557156 2024-02-23T06:38:33.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.157+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-02-23T06:38:33.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.158+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.160+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-02-23T06:38:33.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.160+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.160+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=228 2024-02-23T06:38:33.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.160+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-02-23T06:38:33.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.160+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-02-23T06:38:33.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.161+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-02-23T06:38:33.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.162+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-02-23T06:38:33.163 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.162+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693202 cookie 94657434680208 notifier 5666 bl.length()=184 2024-02-23T06:38:33.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.163+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 from cache 2024-02-23T06:38:33.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.163+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13, ofs0, ns] 2024-02-23T06:38:33.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.164+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693248 cookie 94657434692096 notifier 5666 bl.length()=242 2024-02-23T06:38:33.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.166+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 : miss 2024-02-23T06:38:33.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.166+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.167+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.167+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 info.flags=0x0 2024-02-23T06:38:33.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.167+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13 to cache LRU end 2024-02-23T06:38:33.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 : miss 2024-02-23T06:38:33.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=397 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 info.flags=0x17 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 to cache LRU end 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.169+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 2024-02-23T06:38:33.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.170+0000 7f2d18816800 10 cls_bucket_list_unordered: got ___ 2024-02-23T06:38:33.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.171+0000 7f2d18816800 10 cls_bucket_list_unordered: got __ _ 2024-02-23T06:38:33.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.171+0000 7f2d18816800 10 cls_bucket_list_unordered: got __ 2024-02-23T06:38:33.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.172+0000 7f2d18816800 10 cls_bucket_list_unordered: got obj 2024-02-23T06:38:33.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.173+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0c01a930 obj=test-client.0-r-test-small-obj-data.1:___ state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.173+0000 7f2d18816800 10 manifest: total_size = 0 2024-02-23T06:38:33.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.173+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1030588224848404988 2024-02-23T06:38:33.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.173+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0c01a930 obj=test-client.0-r-test-small-obj-data.1:___ state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.173+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726ca8c18 2024-02-23T06:38:33.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.173+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6.2 2024-02-23T06:38:33.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.175+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08089f80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.176+0000 7f2d18816800 10 manifest: total_size = 0 2024-02-23T06:38:33.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.176+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2199814564905041606 2024-02-23T06:38:33.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.176+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08089f80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.176+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726ca8c18 2024-02-23T06:38:33.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.176+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6.3 2024-02-23T06:38:33.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.177+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=___ 2024-02-23T06:38:33.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.178+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.178+0000 7f2d18816800 10 manifest: total_size = 0 2024-02-23T06:38:33.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.178+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12291857862323188488 2024-02-23T06:38:33.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.178+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.178+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726ca8c18 2024-02-23T06:38:33.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.178+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6.6 2024-02-23T06:38:33.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.179+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=__ _ 2024-02-23T06:38:33.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.181+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.181+0000 7f2d18816800 10 manifest: total_size = 0 2024-02-23T06:38:33.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.181+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8234801735004959636 2024-02-23T06:38:33.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.181+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d0807ece0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x561726ca8c18 s->prefetch_data=0 2024-02-23T06:38:33.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.181+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726ca8c18 2024-02-23T06:38:33.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.181+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6.8 2024-02-23T06:38:33.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.182+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=__ 2024-02-23T06:38:33.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.184+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.184+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.185+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=obj 2024-02-23T06:38:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.185+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.185+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.185+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.185+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.185+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.187+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-02-23T06:38:33.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.187+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.188+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=223 2024-02-23T06:38:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.188+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-02-23T06:38:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.188+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-02-23T06:38:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.189+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-02-23T06:38:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.189+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-02-23T06:38:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.189+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693237 cookie 94657434632640 notifier 5666 bl.length()=181 2024-02-23T06:38:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.191+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 from cache 2024-02-23T06:38:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.191+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6, ofs0, ns] 2024-02-23T06:38:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.191+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693216 cookie 94657434634848 notifier 5666 bl.length()=238 2024-02-23T06:38:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.194+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 : miss 2024-02-23T06:38:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.194+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.194+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.194+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 info.flags=0x0 2024-02-23T06:38:33.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.194+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6 to cache LRU end 2024-02-23T06:38:33.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.196+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 : miss 2024-02-23T06:38:33.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.196+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.196+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=397 2024-02-23T06:38:33.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.197+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 info.flags=0x17 2024-02-23T06:38:33.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.197+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 to cache LRU end 2024-02-23T06:38:33.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.197+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.197+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:33.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.197+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 2024-02-23T06:38:33.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.198+0000 7f2d18816800 10 cls_bucket_list_unordered: got ___ 2024-02-23T06:38:33.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.198+0000 7f2d18816800 10 cls_bucket_list_unordered: got __ _ 2024-02-23T06:38:33.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.199+0000 7f2d18816800 10 cls_bucket_list_unordered: got __ 2024-02-23T06:38:33.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.200+0000 7f2d18816800 10 cls_bucket_list_unordered: got obj 2024-02-23T06:38:33.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.201+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.201+0000 7f2d18816800 10 manifest: total_size = 38 2024-02-23T06:38:33.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.201+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2967397210953166866 2024-02-23T06:38:33.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.201+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.201+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa438 2024-02-23T06:38:33.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.201+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7.2 2024-02-23T06:38:33.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2967397210953166866 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.fA9YMBB_5C3S7jGthheqIHPbTN7NFVQ_0 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.203+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2967397210953166866 2024-02-23T06:38:33.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.204+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=___ 2024-02-23T06:38:33.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.204+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.205+0000 7f2d18816800 10 manifest: total_size = 2078 2024-02-23T06:38:33.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.205+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2120083563956461510 2024-02-23T06:38:33.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.205+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.205+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa438 2024-02-23T06:38:33.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.205+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7.3 2024-02-23T06:38:33.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2120083563956461510 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.LQoeFSrZ9Kxxb_vXVe9VNgFTjnbGyHA_0 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.207+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2120083563956461510 2024-02-23T06:38:33.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.208+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=__ _ 2024-02-23T06:38:33.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.209+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.209+0000 7f2d18816800 10 manifest: total_size = 527 2024-02-23T06:38:33.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.209+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8912383105217441282 2024-02-23T06:38:33.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.209+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.209+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa438 2024-02-23T06:38:33.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.209+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7.6 2024-02-23T06:38:33.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8912383105217441282 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.qj4rHMNsSgq0bWTmGWB9wU9DupIfPHy_0 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.211+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8912383105217441282 2024-02-23T06:38:33.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.212+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=__ 2024-02-23T06:38:33.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.213+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.213+0000 7f2d18816800 10 manifest: total_size = 38 2024-02-23T06:38:33.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.213+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4467208422134573424 2024-02-23T06:38:33.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.213+0000 7f2d18816800 20 get_obj_state: octx=0x561726d0b4c0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x561726caa438 s->prefetch_data=0 2024-02-23T06:38:33.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.213+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa438 2024-02-23T06:38:33.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.213+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7.8 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4467208422134573424 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.Gcl8Izkku0XMqhTAYRT4oFJvBeEuhsX_0 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.215+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4467208422134573424 2024-02-23T06:38:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.216+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=obj 2024-02-23T06:38:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.217+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.219+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-02-23T06:38:33.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.219+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.219+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=223 2024-02-23T06:38:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.219+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-02-23T06:38:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.220+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-02-23T06:38:33.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.220+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-02-23T06:38:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.220+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-02-23T06:38:33.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.221+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693238 cookie 94657434632640 notifier 5666 bl.length()=181 2024-02-23T06:38:33.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.222+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 from cache 2024-02-23T06:38:33.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.222+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7, ofs0, ns] 2024-02-23T06:38:33.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.222+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693217 cookie 94657434634848 notifier 5666 bl.length()=238 2024-02-23T06:38:33.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.225+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 : miss 2024-02-23T06:38:33.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.225+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.225+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.225+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 info.flags=0x0 2024-02-23T06:38:33.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.225+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7 to cache LRU end 2024-02-23T06:38:33.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 : miss 2024-02-23T06:38:33.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=397 2024-02-23T06:38:33.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 info.flags=0x17 2024-02-23T06:38:33.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 to cache LRU end 2024-02-23T06:38:33.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.227+0000 7f2d18816800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-02-23T06:38:33.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.228+0000 7f2d18816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 2024-02-23T06:38:33.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.229+0000 7f2d18816800 10 cls_bucket_list_unordered: got ___ 2024-02-23T06:38:33.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.229+0000 7f2d18816800 10 cls_bucket_list_unordered: got __ _ 2024-02-23T06:38:33.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.230+0000 7f2d18816800 10 cls_bucket_list_unordered: got __ 2024-02-23T06:38:33.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.230+0000 7f2d18816800 10 cls_bucket_list_unordered: got obj 2024-02-23T06:38:33.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.231+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:___ state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.231+0000 7f2d18816800 10 manifest: total_size = 49187 2024-02-23T06:38:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.231+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2573206275532232678 2024-02-23T06:38:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.231+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:___ state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.231+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa868 2024-02-23T06:38:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.231+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8.2 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2573206275532232678 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.B9jV02ucQN3avaE5aXz042gVWceYr9Z_0 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.234+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2573206275532232678 2024-02-23T06:38:33.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=___ 2024-02-23T06:38:33.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2d18816800 10 manifest: total_size = 1048576 2024-02-23T06:38:33.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6341120178007761801 2024-02-23T06:38:33.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa868 2024-02-23T06:38:33.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.235+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8.3 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6341120178007761801 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.Iywk2CYI7mi_-6jh6A7sqGSkf4qvQpu_0 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.237+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6341120178007761801 2024-02-23T06:38:33.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-02-23T06:38:33.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:__ state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2d18816800 10 manifest: total_size = 1035 2024-02-23T06:38:33.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6904461898630207753 2024-02-23T06:38:33.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:__ state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa868 2024-02-23T06:38:33.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.239+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8.6 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6904461898630207753 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.PFa5M7gnOocp9Y63-k8Cyx0XAFPfdoR_0 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.241+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6904461898630207753 2024-02-23T06:38:33.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2bf27fc640 20 handle_completion(): completion ok for obj=__ 2024-02-23T06:38:33.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:obj state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2d18816800 10 manifest: total_size = 4134 2024-02-23T06:38:33.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2d18816800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12940868134882068566 2024-02-23T06:38:33.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2d18816800 20 get_obj_state: octx=0x7f2d08092510 obj=test-client.0-r-test-small-obj-data.3:obj state=0x561726caa868 s->prefetch_data=0 2024-02-23T06:38:33.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2d18816800 20 prepare_atomic_modification: state is not atomic. state=0x561726caa868 2024-02-23T06:38:33.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.243+0000 7f2d18816800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8.8 2024-02-23T06:38:33.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:38:33.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-02-23T06:38:33.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12940868134882068566 2024-02-23T06:38:33.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-02-23T06:38:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.JCKnQy68Fcoa9DPtOe44B31bSJE65Z1_0 2024-02-23T06:38:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-02-23T06:38:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-02-23T06:38:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.245+0000 7f2d18816800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12940868134882068566 2024-02-23T06:38:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.246+0000 7f2bf2ffd640 20 handle_completion(): completion ok for obj=obj 2024-02-23T06:38:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.246+0000 7f2d18816800 20 list_objects_ordered: starting attempt 1 2024-02-23T06:38:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.246+0000 7f2d18816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-23T06:38:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.247+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-23T06:38:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.247+0000 7f2d18816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-23T06:38:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.247+0000 7f2d18816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-23T06:38:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.247+0000 7f2d18816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-23T06:38:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.247+0000 7f2d18816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8])"; uploads.size()=0; is_truncated=0 2024-02-23T06:38:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.249+0000 7f2d18816800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-02-23T06:38:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.249+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.249+0000 7f2d18816800 20 rados_obj.operate() r=0 bl.length=223 2024-02-23T06:38:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.249+0000 7f2d18816800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-02-23T06:38:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.249+0000 7f2d18816800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-02-23T06:38:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.250+0000 7f2d18816800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-02-23T06:38:33.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.250+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-02-23T06:38:33.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.251+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693239 cookie 94657434632640 notifier 5666 bl.length()=181 2024-02-23T06:38:33.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.252+0000 7f2d18816800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 from cache 2024-02-23T06:38:33.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.252+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8, ofs0, ns] 2024-02-23T06:38:33.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.253+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693218 cookie 94657434634848 notifier 5666 bl.length()=238 2024-02-23T06:38:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.255+0000 7f2d18816800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 : miss 2024-02-23T06:38:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.255+0000 7f2d18816800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.255+0000 7f2d18816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.255+0000 7f2d18816800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 info.flags=0x0 2024-02-23T06:38:33.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.255+0000 7f2d18816800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8 to cache LRU end 2024-02-23T06:38:33.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.257+0000 7f2d18816800 10 removing key index: PPYCJFDXQMSOMCJBQWMP 2024-02-23T06:38:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.258+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:PPYCJFDXQMSOMCJBQWMP, ofs0, ns] 2024-02-23T06:38:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.258+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693249 cookie 94657434692096 notifier 5666 bl.length()=170 2024-02-23T06:38:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.259+0000 7f2d18816800 10 removing email index: ragweed.client.0+test@test.test 2024-02-23T06:38:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.260+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-02-23T06:38:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.260+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693203 cookie 94657434680208 notifier 5666 bl.length()=182 2024-02-23T06:38:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.260+0000 7f2d18816800 10 removing user buckets index 2024-02-23T06:38:33.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.261+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-02-23T06:38:33.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.261+0000 7f2bf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693250 cookie 94657434689824 notifier 5666 bl.length()=173 2024-02-23T06:38:33.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.262+0000 7f2d18816800 10 removing user index: ragweed.client.0 2024-02-23T06:38:33.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.263+0000 7f2d18816800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-02-23T06:38:33.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.263+0000 7f2d18816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-02-23T06:38:33.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.263+0000 7f2bf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693219 cookie 94657434681392 notifier 5666 bl.length()=165 2024-02-23T06:38:33.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.264+0000 7f2bc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:33.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.266+0000 7f2d18816800 20 remove_watcher() i=0 2024-02-23T06:38:33.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.266+0000 7f2d18816800 2 removed watcher, disabling cache 2024-02-23T06:38:33.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.267+0000 7f2d18816800 20 remove_watcher() i=1 2024-02-23T06:38:33.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.268+0000 7f2d18816800 20 remove_watcher() i=2 2024-02-23T06:38:33.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.269+0000 7f2d18816800 20 remove_watcher() i=3 2024-02-23T06:38:33.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.270+0000 7f2d18816800 20 remove_watcher() i=4 2024-02-23T06:38:33.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.271+0000 7f2d18816800 20 remove_watcher() i=5 2024-02-23T06:38:33.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.272+0000 7f2d18816800 20 remove_watcher() i=6 2024-02-23T06:38:33.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.273+0000 7f2d18816800 20 remove_watcher() i=7 2024-02-23T06:38:33.285 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-02-23T06:38:33.339 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:38:33.339 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:38:33.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.370+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 realm 2024-02-23T06:38:33.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:38:33.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.372+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.373+0000 7f78f9f11800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:33.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.373+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.373+0000 7f78f9f11800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:38:33.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.373+0000 7f78f9f11800 20 searching for the correct realm 2024-02-23T06:38:33.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.376+0000 7f78f6fa2640 0 -- 172.21.15.142:0/2685556943 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f78e8091040 msgr2=0x7f78e805f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:33.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.379+0000 7f78f77a3640 0 -- 172.21.15.142:0/2685556943 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f78ec01fb10 msgr2=0x7f78ec05e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:38:33.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.585+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 zone default found 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 4 Realm: () 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 zonegroup default 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:38:33.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 started sync module instance, tier type = 2024-02-23T06:38:33.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.586+0000 7f78f9f11800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=0 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=1 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=2 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=3 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=4 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=5 2024-02-23T06:38:33.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.595+0000 7f78f9f11800 20 add_watcher() i=6 2024-02-23T06:38:33.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.596+0000 7f78f9f11800 20 add_watcher() i=7 2024-02-23T06:38:33.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.596+0000 7f78f9f11800 2 all 8 watchers are set, enabling cache 2024-02-23T06:38:33.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.598+0000 7f77adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:33.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.598+0000 7f78f9f11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:38:33.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.598+0000 7f78f9f11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:38:33.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.632+0000 7f77acfe1640 20 reqs_thread_entry: start 2024-02-23T06:38:33.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.632+0000 7f78f9f11800 20 init_complete bucket index max shards: 11 2024-02-23T06:38:33.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.632+0000 7f78f9f11800 20 Filter name: none 2024-02-23T06:38:33.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.632+0000 7f77267fc640 20 reqs_thread_entry: start 2024-02-23T06:38:33.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.632+0000 7f78f9f11800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-02-23T06:38:33.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.632+0000 7f78f9f11800 20 rados->read ofs=0 len=0 2024-02-23T06:38:33.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.633+0000 7f78f9f11800 20 rados_obj.operate() r=0 bl.length=453 2024-02-23T06:38:33.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.633+0000 7f78f9f11800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-02-23T06:38:33.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.633+0000 7f78f9f11800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-02-23T06:38:33.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.633+0000 7f78f9f11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:38:33.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.633+0000 7f78f9f11800 10 removing key index: CXCMYZYGENYUHMNCXDRR 2024-02-23T06:38:33.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.634+0000 7f78f9f11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:CXCMYZYGENYUHMNCXDRR, ofs0, ns] 2024-02-23T06:38:33.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.634+0000 7f77daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693251 cookie 93859812903856 notifier 5684 bl.length()=170 2024-02-23T06:38:33.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.635+0000 7f78f9f11800 10 removing email index: sysuser.client.0+test@test.test 2024-02-23T06:38:33.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.636+0000 7f78f9f11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-02-23T06:38:33.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.636+0000 7f77da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693220 cookie 93859812899904 notifier 5684 bl.length()=182 2024-02-23T06:38:33.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.636+0000 7f78f9f11800 10 removing user buckets index 2024-02-23T06:38:33.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.637+0000 7f78f9f11800 10 removing user index: sysuser.client.0 2024-02-23T06:38:33.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.638+0000 7f78f9f11800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-02-23T06:38:33.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.638+0000 7f78f9f11800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-02-23T06:38:33.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.638+0000 7f77da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693204 cookie 93859812893472 notifier 5684 bl.length()=165 2024-02-23T06:38:33.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.639+0000 7f77adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:38:33.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.641+0000 7f78f9f11800 20 remove_watcher() i=0 2024-02-23T06:38:33.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.641+0000 7f78f9f11800 2 removed watcher, disabling cache 2024-02-23T06:38:33.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.642+0000 7f78f9f11800 20 remove_watcher() i=1 2024-02-23T06:38:33.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.643+0000 7f78f9f11800 20 remove_watcher() i=2 2024-02-23T06:38:33.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.644+0000 7f78f9f11800 20 remove_watcher() i=3 2024-02-23T06:38:33.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.645+0000 7f78f9f11800 20 remove_watcher() i=4 2024-02-23T06:38:33.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.646+0000 7f78f9f11800 20 remove_watcher() i=5 2024-02-23T06:38:33.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.647+0000 7f78f9f11800 20 remove_watcher() i=6 2024-02-23T06:38:33.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:38:33.648+0000 7f78f9f11800 20 remove_watcher() i=7 2024-02-23T06:38:33.660 INFO:tasks.ragweed:Removing ragweed... 2024-02-23T06:38:33.660 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-02-23T06:38:33.730 INFO:teuthology.run_tasks:Running task workunit... 2024-02-23T06:38:33.741 INFO:tasks.workunit:Pulling workunits from ref 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:38:33.741 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-23T06:38:33.742 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:38:33.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:38:33.769 INFO:teuthology.orchestra.run.smithi142.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-23T06:38:33.769 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:38:33.836 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-23T06:38:33.836 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-23T06:38:33.904 INFO:tasks.workunit:timeout=3h 2024-02-23T06:38:33.905 INFO:tasks.workunit:cleanup=True 2024-02-23T06:38:33.905 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 2024-02-23T06:38:33.972 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-23T06:39:46.364 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to '1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4'. 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-02-23T06:39:46.365 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.366 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-02-23T06:39:46.366 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.366 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-23T06:39:46.366 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:46.366 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at 1fb7413ec44 Merge branches 'pr-55565', 'pr-55627' and 'wip-64543' into wip-cbodley-testing 2024-02-23T06:39:46.368 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-23T06:39:46.434 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-23T06:39:46.436 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:39:46.436 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-23T06:39:46.485 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-23T06:39:46.533 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-23T06:39:46.572 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-23T06:39:46.573 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:39:46.574 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-23T06:39:46.613 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-23T06:39:46.616 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:39:46.616 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-23T06:39:46.684 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-02-23T06:39:46.685 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-02-23T06:39:46.685 DEBUG:teuthology.orchestra.run.smithi142:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-02-23T06:39:46.755 INFO:tasks.workunit.client.0.smithi142.stderr:+ ulimit -c 0 2024-02-23T06:39:46.755 INFO:tasks.workunit.client.0.smithi142.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-02-23T06:39:46.756 INFO:tasks.workunit.client.0.smithi142.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-02-23T06:39:46.756 INFO:tasks.workunit.client.0.smithi142.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-02-23T06:39:49.136 INFO:tasks.workunit.client.0.smithi142.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ deactivate nondestructive 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ hash -r 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ unset VIRTUAL_ENV 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-02-23T06:39:49.137 INFO:tasks.workunit.client.0.smithi142.stderr:++ export VIRTUAL_ENV 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ export PATH 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n '' ']' 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -z '' ']' 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ _OLD_VIRTUAL_PS1= 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ PS1='(rgw) ' 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ export PS1 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:++ hash -r 2024-02-23T06:39:49.139 INFO:tasks.workunit.client.0.smithi142.stderr:+ pip install pip --upgrade 2024-02-23T06:39:49.366 INFO:tasks.workunit.client.0.smithi142.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-02-23T06:39:49.600 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting pip 2024-02-23T06:39:49.606 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-02-23T06:39:49.654 INFO:tasks.workunit.client.0.smithi142.stdout:Installing collected packages: pip 2024-02-23T06:39:49.654 INFO:tasks.workunit.client.0.smithi142.stdout: Attempting uninstall: pip 2024-02-23T06:39:49.654 INFO:tasks.workunit.client.0.smithi142.stdout: Found existing installation: pip 21.2.3 2024-02-23T06:39:49.802 INFO:tasks.workunit.client.0.smithi142.stdout: Uninstalling pip-21.2.3: 2024-02-23T06:39:49.808 INFO:tasks.workunit.client.0.smithi142.stdout: Successfully uninstalled pip-21.2.3 2024-02-23T06:39:50.971 INFO:tasks.workunit.client.0.smithi142.stdout:Successfully installed pip-24.0 2024-02-23T06:39:51.021 INFO:tasks.workunit.client.0.smithi142.stderr:+ pip install boto3 2024-02-23T06:39:51.852 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting boto3 2024-02-23T06:39:51.853 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached boto3-1.34.48-py3-none-any.whl.metadata (6.6 kB) 2024-02-23T06:39:52.444 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting botocore<1.35.0,>=1.34.48 (from boto3) 2024-02-23T06:39:52.445 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached botocore-1.34.48-py3-none-any.whl.metadata (5.7 kB) 2024-02-23T06:39:52.504 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-02-23T06:39:52.505 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-02-23T06:39:52.558 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-02-23T06:39:52.559 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-02-23T06:39:52.617 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:39:52.618 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2024-02-23T06:39:52.702 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:39:52.702 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-02-23T06:39:52.965 INFO:tasks.workunit.client.0.smithi142.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.48->boto3) 2024-02-23T06:39:52.966 INFO:tasks.workunit.client.0.smithi142.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-02-23T06:39:52.989 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached boto3-1.34.48-py3-none-any.whl (139 kB) 2024-02-23T06:39:52.990 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached botocore-1.34.48-py3-none-any.whl (12.0 MB) 2024-02-23T06:39:53.010 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-02-23T06:39:53.011 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-02-23T06:39:53.012 INFO:tasks.workunit.client.0.smithi142.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-02-23T06:39:53.111 INFO:tasks.workunit.client.0.smithi142.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-02-23T06:39:54.130 INFO:tasks.workunit.client.0.smithi142.stdout:Successfully installed boto3-1.34.48 botocore-1.34.48 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-02-23T06:39:54.258 INFO:tasks.workunit.client.0.smithi142.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-02-23T06:39:54.384 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-02-23T06:39:54.418 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:39:54.418 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:39:54.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.451+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 realm 2024-02-23T06:39:54.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:39:54.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.453+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.454+0000 7f5bea530800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:54.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.454+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.454+0000 7f5bea530800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:39:54.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.454+0000 7f5bea530800 20 searching for the correct realm 2024-02-23T06:39:54.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.458+0000 7f5be684c640 0 -- 172.21.15.142:0/3762276563 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x5586c9397ff0 msgr2=0x5586c939a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:54.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.462+0000 7f5be584a640 0 -- 172.21.15.142:0/3762276563 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f5be007f070 msgr2=0x7f5be0058a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:39:54.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:54.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.466+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 zone default found 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 4 Realm: () 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 zonegroup default 2024-02-23T06:39:54.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.467+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.468+0000 7f5bea530800 20 started sync module instance, tier type = 2024-02-23T06:39:54.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.468+0000 7f5bea530800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=0 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=1 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=2 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=3 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=4 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=5 2024-02-23T06:39:54.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.477+0000 7f5bea530800 20 add_watcher() i=6 2024-02-23T06:39:54.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.478+0000 7f5bea530800 20 add_watcher() i=7 2024-02-23T06:39:54.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.478+0000 7f5bea530800 2 all 8 watchers are set, enabling cache 2024-02-23T06:39:54.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.479+0000 7f5a9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:54.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 5 note: GC not initialized 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5a177fe640 20 reqs_thread_entry: start 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 20 init_complete bucket index max shards: 11 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 20 Filter name: none 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5a157fa640 20 reqs_thread_entry: start 2024-02-23T06:39:54.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.480+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-23T06:39:54.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.481+0000 7f5bea530800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-23T06:39:54.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.482+0000 7f5bea530800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-02-23T06:39:54.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.482+0000 7f5bea530800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.482+0000 7f5bea530800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.482+0000 7f5ac9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693252 cookie 94037390038816 notifier 5702 bl.length()=536 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.482+0000 7f5ac9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.482+0000 7f5ac9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.484+0000 7f5bea530800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.484+0000 7f5bea530800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.484+0000 7f5bea530800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.484+0000 7f5ac97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693253 cookie 94037390034976 notifier 5702 bl.length()=180 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.484+0000 7f5ac97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-23T06:39:54.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.484+0000 7f5ac97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-23T06:39:54.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.485+0000 7f5a9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:54.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.488+0000 7f5bea530800 20 remove_watcher() i=0 2024-02-23T06:39:54.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.488+0000 7f5bea530800 2 removed watcher, disabling cache 2024-02-23T06:39:54.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.489+0000 7f5bea530800 20 remove_watcher() i=1 2024-02-23T06:39:54.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.490+0000 7f5bea530800 20 remove_watcher() i=2 2024-02-23T06:39:54.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.491+0000 7f5bea530800 20 remove_watcher() i=3 2024-02-23T06:39:54.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.492+0000 7f5bea530800 20 remove_watcher() i=4 2024-02-23T06:39:54.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.493+0000 7f5bea530800 20 remove_watcher() i=5 2024-02-23T06:39:54.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.494+0000 7f5bea530800 20 remove_watcher() i=6 2024-02-23T06:39:54.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.495+0000 7f5bea530800 20 remove_watcher() i=7 2024-02-23T06:39:54.720 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard add 2024-02-23T06:39:54.721 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:54.722 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-02-23T06:39:54.749 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:39:54.749 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:39:54.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.782+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.783+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.783+0000 7f3a0b42d800 20 realm 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.783+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.784+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.784+0000 7f3a0b42d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.784+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.784+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.784+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.785+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:54.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.785+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.785+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:39:54.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.785+0000 7f3a0b42d800 20 searching for the correct realm 2024-02-23T06:39:54.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.789+0000 7f3a05ba2640 0 -- 172.21.15.142:0/4038046503 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f39f8024070 msgr2=0x7f39f8071920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:54.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.793+0000 7f3a05ba2640 0 -- 172.21.15.142:0/4038046503 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f38d007a5e0 msgr2=0x7f38d007ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.797+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:54.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 zone default found 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 4 Realm: () 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 zonegroup default 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.798+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 started sync module instance, tier type = 2024-02-23T06:39:54.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.799+0000 7f3a0b42d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=0 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=1 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=2 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=3 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=4 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=5 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.808+0000 7f3a0b42d800 20 add_watcher() i=6 2024-02-23T06:39:54.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.809+0000 7f3a0b42d800 20 add_watcher() i=7 2024-02-23T06:39:54.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.809+0000 7f3a0b42d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.811+0000 7f38bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.811+0000 7f3a0b42d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.811+0000 7f3a0b42d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.811+0000 7f3a0b42d800 5 note: GC not initialized 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.811+0000 7f38377fe640 20 reqs_thread_entry: start 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.812+0000 7f3a0b42d800 20 init_complete bucket index max shards: 11 2024-02-23T06:39:54.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.812+0000 7f3a0b42d800 20 Filter name: none 2024-02-23T06:39:54.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.812+0000 7f38357fa640 20 reqs_thread_entry: start 2024-02-23T06:39:54.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.812+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.812+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.812+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.813+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.813+0000 7f3a0b42d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.813+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.813+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.813+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.814+0000 7f3a0b42d800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:39:54.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.814+0000 7f3a0b42d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:39:54.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.815+0000 7f3a0b42d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.815+0000 7f3a0b42d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.816+0000 7f38bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:54.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.818+0000 7f3a0b42d800 20 remove_watcher() i=0 2024-02-23T06:39:54.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.818+0000 7f3a0b42d800 2 removed watcher, disabling cache 2024-02-23T06:39:54.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.820+0000 7f3a0b42d800 20 remove_watcher() i=1 2024-02-23T06:39:54.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.821+0000 7f3a0b42d800 20 remove_watcher() i=2 2024-02-23T06:39:54.822 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.822+0000 7f3a0b42d800 20 remove_watcher() i=3 2024-02-23T06:39:54.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.823+0000 7f3a0b42d800 20 remove_watcher() i=4 2024-02-23T06:39:54.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.824+0000 7f3a0b42d800 20 remove_watcher() i=5 2024-02-23T06:39:54.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.824+0000 7f3a0b42d800 20 remove_watcher() i=6 2024-02-23T06:39:54.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.825+0000 7f3a0b42d800 20 remove_watcher() i=7 2024-02-23T06:39:54.835 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:54.835 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:39:54.835 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: a-bucket id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-02-23T06:39:54.835 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:54.836 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-02-23T06:39:54.866 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:39:54.866 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:39:54.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.899+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.900+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.900+0000 7f20ce630800 20 realm 2024-02-23T06:39:54.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.900+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.900+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.900+0000 7f20ce630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:39:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.900+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.901+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.901+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.901+0000 7f20ce630800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:54.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.901+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:54.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.902+0000 7f20ce630800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:39:54.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.902+0000 7f20ce630800 20 searching for the correct realm 2024-02-23T06:39:54.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.905+0000 7f20c0e4a640 0 -- 172.21.15.142:0/401571706 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f20bc07e2d0 msgr2=0x7f20bc05e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:54.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:54.909+0000 7f20c964b640 0 -- 172.21.15.142:0/401571706 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f20b40b6c20 msgr2=0x7f20b40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.114+0000 7f20ce630800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.114+0000 7f20ce630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.114+0000 7f20ce630800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.114+0000 7f20ce630800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.114+0000 7f20ce630800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.114+0000 7f20ce630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:55.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 zone default found 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 4 Realm: () 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 zonegroup default 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.115+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 started sync module instance, tier type = 2024-02-23T06:39:55.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.116+0000 7f20ce630800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:39:55.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=0 2024-02-23T06:39:55.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=1 2024-02-23T06:39:55.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=2 2024-02-23T06:39:55.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=3 2024-02-23T06:39:55.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=4 2024-02-23T06:39:55.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=5 2024-02-23T06:39:55.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.126+0000 7f20ce630800 20 add_watcher() i=6 2024-02-23T06:39:55.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.127+0000 7f20ce630800 20 add_watcher() i=7 2024-02-23T06:39:55.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.127+0000 7f20ce630800 2 all 8 watchers are set, enabling cache 2024-02-23T06:39:55.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.128+0000 7f1f7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 5 note: GC not initialized 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f1f7e7e4640 20 reqs_thread_entry: start 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 20 init_complete bucket index max shards: 11 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 20 Filter name: none 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f1eeffff640 20 reqs_thread_entry: start 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-02-23T06:39:55.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.129+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:39:55.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-02-23T06:39:55.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : miss 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.130+0000 7f20ce630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:39:55.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.132+0000 7f1f7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:55.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.135+0000 7f20ce630800 20 remove_watcher() i=0 2024-02-23T06:39:55.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.135+0000 7f20ce630800 2 removed watcher, disabling cache 2024-02-23T06:39:55.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.136+0000 7f20ce630800 20 remove_watcher() i=1 2024-02-23T06:39:55.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.137+0000 7f20ce630800 20 remove_watcher() i=2 2024-02-23T06:39:55.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.138+0000 7f20ce630800 20 remove_watcher() i=3 2024-02-23T06:39:55.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.139+0000 7f20ce630800 20 remove_watcher() i=4 2024-02-23T06:39:55.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.140+0000 7f20ce630800 20 remove_watcher() i=5 2024-02-23T06:39:55.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.141+0000 7f20ce630800 20 remove_watcher() i=6 2024-02-23T06:39:55.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.141+0000 7f20ce630800 20 remove_watcher() i=7 2024-02-23T06:39:55.153 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin reshard list 2024-02-23T06:39:55.178 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:39:55.179 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:39:55.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.211+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 realm 2024-02-23T06:39:55.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:39:55.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.212+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.213+0000 7f2b98444800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:55.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.213+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.214+0000 7f2b98444800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:39:55.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.214+0000 7f2b98444800 20 searching for the correct realm 2024-02-23T06:39:55.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.217+0000 7f2b95542640 0 -- 172.21.15.142:0/3327945596 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x5645eac04a20 msgr2=0x5645eac06eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:55.221 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.220+0000 7f2b95d43640 0 -- 172.21.15.142:0/3327945596 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f2b80098410 msgr2=0x7f2b80098890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:55.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:39:55.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.225+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:55.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 zone default found 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 4 Realm: () 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 zonegroup default 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.226+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.227+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.227+0000 7f2b98444800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.227+0000 7f2b98444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.227+0000 7f2b98444800 20 started sync module instance, tier type = 2024-02-23T06:39:55.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.227+0000 7f2b98444800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:39:55.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=0 2024-02-23T06:39:55.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=1 2024-02-23T06:39:55.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=2 2024-02-23T06:39:55.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=3 2024-02-23T06:39:55.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=4 2024-02-23T06:39:55.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=5 2024-02-23T06:39:55.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=6 2024-02-23T06:39:55.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 20 add_watcher() i=7 2024-02-23T06:39:55.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.236+0000 7f2b98444800 2 all 8 watchers are set, enabling cache 2024-02-23T06:39:55.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.238+0000 7f2a477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:55.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f2b98444800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:39:55.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f2b98444800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:39:55.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f2b98444800 5 note: GC not initialized 2024-02-23T06:39:55.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f2a467fc640 20 reqs_thread_entry: start 2024-02-23T06:39:55.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f2b98444800 20 init_complete bucket index max shards: 11 2024-02-23T06:39:55.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f2b98444800 20 Filter name: none 2024-02-23T06:39:55.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.239+0000 7f29b7fff640 20 reqs_thread_entry: start 2024-02-23T06:39:55.245 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.245+0000 7f2a477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:55.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.248+0000 7f2b98444800 20 remove_watcher() i=0 2024-02-23T06:39:55.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.248+0000 7f2b98444800 2 removed watcher, disabling cache 2024-02-23T06:39:55.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.248+0000 7f2b98444800 20 remove_watcher() i=1 2024-02-23T06:39:55.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.249+0000 7f2b98444800 20 remove_watcher() i=2 2024-02-23T06:39:55.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.250+0000 7f2b98444800 20 remove_watcher() i=3 2024-02-23T06:39:55.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.251+0000 7f2b98444800 20 remove_watcher() i=4 2024-02-23T06:39:55.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.252+0000 7f2b98444800 20 remove_watcher() i=5 2024-02-23T06:39:55.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.253+0000 7f2b98444800 20 remove_watcher() i=6 2024-02-23T06:39:55.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.254+0000 7f2b98444800 20 remove_watcher() i=7 2024-02-23T06:39:55.264 INFO:tasks.workunit.client.0.smithi142.stderr:bucket name a-bucket 2024-02-23T06:39:55.264 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard process 2024-02-23T06:39:55.264 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:39:55.265 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin reshard process 2024-02-23T06:39:55.291 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:39:55.291 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:39:55.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.324+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.325+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.325+0000 7f3bf102d800 20 realm 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.325+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.325+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.325+0000 7f3bf102d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.325+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.326+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.326+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.326+0000 7f3bf102d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:55.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.326+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.327+0000 7f3bf102d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:39:55.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.327+0000 7f3bf102d800 20 searching for the correct realm 2024-02-23T06:39:55.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.329+0000 7f3bec84c640 0 -- 172.21.15.142:0/1227866742 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f3bd4069070 msgr2=0x7f3bd402c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:39:55.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.333+0000 7f3bec04b640 0 -- 172.21.15.142:0/1227866742 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f3bd4034c20 msgr2=0x7f3bd4034590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:39:55.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:39:55.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:39:55.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:39:55.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.539+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 zone default found 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 4 Realm: () 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:39:55.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 zonegroup default 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.540+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.541+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.541+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.541+0000 7f3bf102d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:39:55.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.541+0000 7f3bf102d800 20 started sync module instance, tier type = 2024-02-23T06:39:55.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.541+0000 7f3bf102d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:39:55.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=0 2024-02-23T06:39:55.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=1 2024-02-23T06:39:55.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=2 2024-02-23T06:39:55.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=3 2024-02-23T06:39:55.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=4 2024-02-23T06:39:55.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=5 2024-02-23T06:39:55.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.551+0000 7f3bf102d800 20 add_watcher() i=6 2024-02-23T06:39:55.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.552+0000 7f3bf102d800 20 add_watcher() i=7 2024-02-23T06:39:55.554 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.552+0000 7f3bf102d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:39:55.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3aa2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:55.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3bf102d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:39:55.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3bf102d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:39:55.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3bf102d800 5 note: GC not initialized 2024-02-23T06:39:55.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3aa1fdb640 20 reqs_thread_entry: start 2024-02-23T06:39:55.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3bf102d800 20 init_complete bucket index max shards: 11 2024-02-23T06:39:55.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3bf102d800 20 Filter name: none 2024-02-23T06:39:55.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3a137fe640 20 reqs_thread_entry: start 2024-02-23T06:39:55.556 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.554+0000 7f3bf102d800 20 processing logshard = reshard.0000000000 2024-02-23T06:39:55.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.557+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-02-23T06:39:55.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.557+0000 7f3bf102d800 20 processing logshard = reshard.0000000001 2024-02-23T06:39:55.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.560+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-02-23T06:39:55.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.560+0000 7f3bf102d800 20 processing logshard = reshard.0000000002 2024-02-23T06:39:55.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.562+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-02-23T06:39:55.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.562+0000 7f3bf102d800 20 processing logshard = reshard.0000000003 2024-02-23T06:39:55.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.565+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-02-23T06:39:55.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.565+0000 7f3bf102d800 20 processing logshard = reshard.0000000004 2024-02-23T06:39:55.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.568+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-02-23T06:39:55.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.568+0000 7f3bf102d800 20 processing logshard = reshard.0000000005 2024-02-23T06:39:55.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.570+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-02-23T06:39:55.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.570+0000 7f3bf102d800 20 processing logshard = reshard.0000000006 2024-02-23T06:39:55.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 20 process_entry resharding a-bucket 2024-02-23T06:39:55.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-02-23T06:39:55.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : miss 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 20 rados->read ofs=0 len=0 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:39:55.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:39:55.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:39:55.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.572+0000 7f3bf102d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:39:55.574 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.573+0000 7f3bf102d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:39:55.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3bf102d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:39:55.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3bf102d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:39:55.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3bf102d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:39:55.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3bf102d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17, ofs0, ns] 2024-02-23T06:39:55.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3ac2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693241 cookie 94434201847168 notifier 5768 bl.length()=789 2024-02-23T06:39:55.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3ac2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:39:55.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3ac2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:39:55.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.579+0000 7f3ac2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:39:55.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.580+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_sources= new_sources= 2024-02-23T06:39:55.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.580+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential sources added=[] removed=[] 2024-02-23T06:39:55.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.580+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_dests= new_dests= 2024-02-23T06:39:55.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.580+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential dests added=[] removed=[] 2024-02-23T06:39:55.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.0 2024-02-23T06:39:55.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.0 2024-02-23T06:39:55.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.1 2024-02-23T06:39:55.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.1 2024-02-23T06:39:55.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.2 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.2 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.3 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.3 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.4 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.4 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.5 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.5 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.6 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.6 2024-02-23T06:39:55.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.7 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.7 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.8 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.8 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.9 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.9 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.10 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.10 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.11 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.11 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.582+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.0 2024-02-23T06:39:55.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.583+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.583+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.584+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.3 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.584+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.4 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.585+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.5 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.586+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.6 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.586+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.7 2024-02-23T06:39:55.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.586+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.8 2024-02-23T06:39:55.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.587+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.9 2024-02-23T06:39:55.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.587+0000 7f3bf102d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.10 2024-02-23T06:39:55.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.588+0000 7f3bf102d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : hit (requested=0x17, cached=0x17) 2024-02-23T06:39:55.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.588+0000 7f3bf102d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3bf102d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3bf102d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3bf102d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3bf102d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17, ofs0, ns] 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3ac2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693242 cookie 94434201847168 notifier 5768 bl.length()=757 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3ac2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3ac2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:39:55.590 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.589+0000 7f3ac2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:39:55.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.590+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_sources= new_sources= 2024-02-23T06:39:55.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.590+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential sources added=[] removed=[] 2024-02-23T06:39:55.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.590+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_dests= new_dests= 2024-02-23T06:39:55.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.590+0000 7f3bf102d800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential dests added=[] removed=[] 2024-02-23T06:39:55.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.592+0000 7f3bf102d800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-02-23T06:39:55.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.593+0000 7f3bf102d800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-02-23T06:39:55.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.595+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-02-23T06:39:55.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.595+0000 7f3bf102d800 20 processing logshard = reshard.0000000007 2024-02-23T06:39:55.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.598+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-02-23T06:39:55.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.598+0000 7f3bf102d800 20 processing logshard = reshard.0000000008 2024-02-23T06:39:55.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.600+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-02-23T06:39:55.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.600+0000 7f3bf102d800 20 processing logshard = reshard.0000000009 2024-02-23T06:39:55.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.602+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-02-23T06:39:55.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.602+0000 7f3bf102d800 20 processing logshard = reshard.0000000010 2024-02-23T06:39:55.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.604+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-02-23T06:39:55.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.604+0000 7f3bf102d800 20 processing logshard = reshard.0000000011 2024-02-23T06:39:55.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.607+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-02-23T06:39:55.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.607+0000 7f3bf102d800 20 processing logshard = reshard.0000000012 2024-02-23T06:39:55.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.609+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-02-23T06:39:55.610 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.609+0000 7f3bf102d800 20 processing logshard = reshard.0000000013 2024-02-23T06:39:55.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.612+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-02-23T06:39:55.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.612+0000 7f3bf102d800 20 processing logshard = reshard.0000000014 2024-02-23T06:39:55.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.614+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-02-23T06:39:55.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.614+0000 7f3bf102d800 20 processing logshard = reshard.0000000015 2024-02-23T06:39:55.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.617+0000 7f3bf102d800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-02-23T06:39:55.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.618+0000 7f3aa2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:39:55.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.620+0000 7f3bf102d800 20 remove_watcher() i=0 2024-02-23T06:39:55.620 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.620+0000 7f3bf102d800 2 removed watcher, disabling cache 2024-02-23T06:39:55.621 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.621+0000 7f3bf102d800 20 remove_watcher() i=1 2024-02-23T06:39:55.622 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.622+0000 7f3bf102d800 20 remove_watcher() i=2 2024-02-23T06:39:55.623 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.623+0000 7f3bf102d800 20 remove_watcher() i=3 2024-02-23T06:39:55.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.624+0000 7f3bf102d800 20 remove_watcher() i=4 2024-02-23T06:39:55.625 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.625+0000 7f3bf102d800 20 remove_watcher() i=5 2024-02-23T06:39:55.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.626+0000 7f3bf102d800 20 remove_watcher() i=6 2024-02-23T06:39:55.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:39:55.627+0000 7f3bf102d800 20 remove_watcher() i=7 2024-02-23T06:40:00.645 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-02-23T06:40:00.677 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:00.678 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:00.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.716+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.717+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.717+0000 7fbfccf2a800 20 realm 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.717+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.717+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.717+0000 7fbfccf2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.717+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.718+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.718+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.719+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:00.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.719+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.719+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:00.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.719+0000 7fbfccf2a800 20 searching for the correct realm 2024-02-23T06:40:00.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.722+0000 7fbfc824a640 0 -- 172.21.15.142:0/4141694456 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fbfb8037060 msgr2=0x7fbfb80388e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:00.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.726+0000 7fbfc8a4b640 0 -- 172.21.15.142:0/4141694456 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fbfbc008730 msgr2=0x7fbfbc056900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:00.933 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.934 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:00.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.933+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:00.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 zone default found 2024-02-23T06:40:00.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 4 Realm: () 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 zonegroup default 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.934+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.935+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.935+0000 7fbfccf2a800 20 started sync module instance, tier type = 2024-02-23T06:40:00.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.935+0000 7fbfccf2a800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:00.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=0 2024-02-23T06:40:00.945 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=1 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=2 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=3 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=4 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=5 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.945+0000 7fbfccf2a800 20 add_watcher() i=6 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.946+0000 7fbfccf2a800 20 add_watcher() i=7 2024-02-23T06:40:00.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.946+0000 7fbfccf2a800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:00.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbe7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbfccf2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbfccf2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbfccf2a800 5 note: GC not initialized 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbe7dfe3640 20 reqs_thread_entry: start 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbfccf2a800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbfccf2a800 20 Filter name: none 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbdef7fe640 20 reqs_thread_entry: start 2024-02-23T06:40:00.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.948+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.949+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:00.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.949+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:00.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:00.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:00.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:00.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.950+0000 7fbfccf2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:00.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.951+0000 7fbfccf2a800 20 rados->read ofs=0 len=0 2024-02-23T06:40:00.952 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.952+0000 7fbfccf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:00.953 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.952+0000 7fbe7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:00.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.956+0000 7fbfccf2a800 20 remove_watcher() i=0 2024-02-23T06:40:00.956 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.956+0000 7fbfccf2a800 2 removed watcher, disabling cache 2024-02-23T06:40:00.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.957+0000 7fbfccf2a800 20 remove_watcher() i=1 2024-02-23T06:40:00.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.959+0000 7fbfccf2a800 20 remove_watcher() i=2 2024-02-23T06:40:00.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.960+0000 7fbfccf2a800 20 remove_watcher() i=3 2024-02-23T06:40:00.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.961+0000 7fbfccf2a800 20 remove_watcher() i=4 2024-02-23T06:40:00.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.962+0000 7fbfccf2a800 20 remove_watcher() i=5 2024-02-23T06:40:00.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.963+0000 7fbfccf2a800 20 remove_watcher() i=6 2024-02-23T06:40:00.964 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:00.964+0000 7fbfccf2a800 20 remove_watcher() i=7 2024-02-23T06:40:00.974 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:00.974 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:00.974 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: a-bucket id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-02-23T06:40:00.975 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:00.975 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard add non empty bucket 2024-02-23T06:40:00.975 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:01.061 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-02-23T06:40:01.087 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:01.088 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:01.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.120+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.121+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.121+0000 7f185742d800 20 realm 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.121+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.121+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.121+0000 7f185742d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.121+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.122+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.122+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.123+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.123+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.123+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:01.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.123+0000 7f185742d800 20 searching for the correct realm 2024-02-23T06:40:01.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.126+0000 7f1851c4a640 0 -- 172.21.15.142:0/3598131038 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x55e41f6aab60 msgr2=0x55e41f6acfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.130+0000 7f185244b640 0 -- 172.21.15.142:0/3598131038 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f183c003670 msgr2=0x7f183c06ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:01.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.134+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 zone default found 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 4 Realm: () 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 zonegroup default 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.135+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.136+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.136+0000 7f185742d800 20 started sync module instance, tier type = 2024-02-23T06:40:01.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.136+0000 7f185742d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=0 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=1 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=2 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=3 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=4 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=5 2024-02-23T06:40:01.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.145+0000 7f185742d800 20 add_watcher() i=6 2024-02-23T06:40:01.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.146+0000 7f185742d800 20 add_watcher() i=7 2024-02-23T06:40:01.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.146+0000 7f185742d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:01.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.147+0000 7f1708fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.147+0000 7f185742d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:01.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.147+0000 7f185742d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:01.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.147+0000 7f185742d800 5 note: GC not initialized 2024-02-23T06:40:01.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f16837fe640 20 reqs_thread_entry: start 2024-02-23T06:40:01.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f185742d800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:01.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f185742d800 20 Filter name: none 2024-02-23T06:40:01.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f16817fa640 20 reqs_thread_entry: start 2024-02-23T06:40:01.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.148+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.149+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.149+0000 7f185742d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.149+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.149+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.149+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.150+0000 7f185742d800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:01.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.150+0000 7f185742d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:01.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.151+0000 7f185742d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.151+0000 7f185742d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.152+0000 7f1708fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.154+0000 7f185742d800 20 remove_watcher() i=0 2024-02-23T06:40:01.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.154+0000 7f185742d800 2 removed watcher, disabling cache 2024-02-23T06:40:01.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.155+0000 7f185742d800 20 remove_watcher() i=1 2024-02-23T06:40:01.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.156+0000 7f185742d800 20 remove_watcher() i=2 2024-02-23T06:40:01.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.157+0000 7f185742d800 20 remove_watcher() i=3 2024-02-23T06:40:01.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.158+0000 7f185742d800 20 remove_watcher() i=4 2024-02-23T06:40:01.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.158+0000 7f185742d800 20 remove_watcher() i=5 2024-02-23T06:40:01.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.159+0000 7f185742d800 20 remove_watcher() i=6 2024-02-23T06:40:01.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.160+0000 7f185742d800 20 remove_watcher() i=7 2024-02-23T06:40:01.170 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:01.170 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:01.171 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: a-bucket id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-02-23T06:40:01.171 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:01.172 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-02-23T06:40:01.201 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:01.201 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:01.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.234+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.235+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.235+0000 7f29e8724800 20 realm 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.235+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.236+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.236+0000 7f29e8724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.236+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.236+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.236+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.237+0000 7f29e8724800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.237+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.237+0000 7f29e8724800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:01.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.237+0000 7f29e8724800 20 searching for the correct realm 2024-02-23T06:40:01.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.240+0000 7f29db9a2640 0 -- 172.21.15.142:0/1795913930 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x55e089a6f4c0 msgr2=0x55e089a71980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.243+0000 7f29e41a3640 0 -- 172.21.15.142:0/1795913930 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f29cc0605f0 msgr2=0x7f29cc05e650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:01.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:01.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:01.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:01.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:01.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:01.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.247+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:01.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 zone default found 2024-02-23T06:40:01.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 4 Realm: () 2024-02-23T06:40:01.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:01.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:01.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 zonegroup default 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.248+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.249+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.249+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.249+0000 7f29e8724800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.249+0000 7f29e8724800 20 started sync module instance, tier type = 2024-02-23T06:40:01.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.249+0000 7f29e8724800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=0 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=1 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=2 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=3 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=4 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=5 2024-02-23T06:40:01.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.258+0000 7f29e8724800 20 add_watcher() i=6 2024-02-23T06:40:01.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.259+0000 7f29e8724800 20 add_watcher() i=7 2024-02-23T06:40:01.259 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.259+0000 7f29e8724800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:01.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.260+0000 7f289afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:01.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 5 note: GC not initialized 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f2899fdb640 20 reqs_thread_entry: start 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 Filter name: none 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f280b7fe640 20 reqs_thread_entry: start 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-02-23T06:40:01.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : miss 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.261+0000 7f29e8724800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.262+0000 7f29e8724800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.262+0000 7f29e8724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.262+0000 7f29e8724800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.262+0000 7f29e8724800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.262+0000 7f29e8724800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:40:01.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.262+0000 7f29e8724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:40:01.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.264+0000 7f289afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.266+0000 7f29e8724800 20 remove_watcher() i=0 2024-02-23T06:40:01.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.266+0000 7f29e8724800 2 removed watcher, disabling cache 2024-02-23T06:40:01.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.267+0000 7f29e8724800 20 remove_watcher() i=1 2024-02-23T06:40:01.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.268+0000 7f29e8724800 20 remove_watcher() i=2 2024-02-23T06:40:01.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.270+0000 7f29e8724800 20 remove_watcher() i=3 2024-02-23T06:40:01.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.271+0000 7f29e8724800 20 remove_watcher() i=4 2024-02-23T06:40:01.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.272+0000 7f29e8724800 20 remove_watcher() i=5 2024-02-23T06:40:01.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.272+0000 7f29e8724800 20 remove_watcher() i=6 2024-02-23T06:40:01.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.273+0000 7f29e8724800 20 remove_watcher() i=7 2024-02-23T06:40:01.285 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin reshard list 2024-02-23T06:40:01.310 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:01.310 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:01.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.343+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 realm 2024-02-23T06:40:01.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:01.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.345+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.346+0000 7f5aa9a67800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.346+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.346+0000 7f5aa9a67800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:01.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.346+0000 7f5aa9a67800 20 searching for the correct realm 2024-02-23T06:40:01.350 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.350+0000 7f5aa7b50640 0 -- 172.21.15.142:0/865491481 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f5a9001a040 msgr2=0x7f5a9004c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.555+0000 7f5aa734f640 0 -- 172.21.15.142:0/865491481 >> [v2:172.21.15.152:6824/160508611,v1:172.21.15.152:6825/160508611] conn(0x5573a4e2fae0 msgr2=0x5573a4e31f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:01.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:01.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.559 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:01.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 zone default found 2024-02-23T06:40:01.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 4 Realm: () 2024-02-23T06:40:01.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 zonegroup default 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.558+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 started sync module instance, tier type = 2024-02-23T06:40:01.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.559+0000 7f5aa9a67800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=0 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=1 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=2 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=3 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=4 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=5 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.568+0000 7f5aa9a67800 20 add_watcher() i=6 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.569+0000 7f5aa9a67800 20 add_watcher() i=7 2024-02-23T06:40:01.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.569+0000 7f5aa9a67800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:01.571 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.571+0000 7f595dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.571+0000 7f5aa9a67800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.571+0000 7f5aa9a67800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.571+0000 7f5aa9a67800 5 note: GC not initialized 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.571+0000 7f595cfe1640 20 reqs_thread_entry: start 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.571+0000 7f5aa9a67800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.572+0000 7f5aa9a67800 20 Filter name: none 2024-02-23T06:40:01.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.572+0000 7f58d67fc640 20 reqs_thread_entry: start 2024-02-23T06:40:01.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.577+0000 7f595dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.580+0000 7f5aa9a67800 20 remove_watcher() i=0 2024-02-23T06:40:01.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.580+0000 7f5aa9a67800 2 removed watcher, disabling cache 2024-02-23T06:40:01.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.581+0000 7f5aa9a67800 20 remove_watcher() i=1 2024-02-23T06:40:01.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.582+0000 7f5aa9a67800 20 remove_watcher() i=2 2024-02-23T06:40:01.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.583+0000 7f5aa9a67800 20 remove_watcher() i=3 2024-02-23T06:40:01.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.584+0000 7f5aa9a67800 20 remove_watcher() i=4 2024-02-23T06:40:01.585 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.585+0000 7f5aa9a67800 20 remove_watcher() i=5 2024-02-23T06:40:01.586 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.586+0000 7f5aa9a67800 20 remove_watcher() i=6 2024-02-23T06:40:01.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.587+0000 7f5aa9a67800 20 remove_watcher() i=7 2024-02-23T06:40:01.597 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard process non empty bucket 2024-02-23T06:40:01.597 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:01.598 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin reshard process 2024-02-23T06:40:01.623 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:01.623 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:01.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.656+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.657+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.657+0000 7f85f0616800 20 realm 2024-02-23T06:40:01.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.658+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.658+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.658+0000 7f85f0616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:01.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.658+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.658+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.658+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.659+0000 7f85f0616800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.659+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.659+0000 7f85f0616800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:01.660 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.659+0000 7f85f0616800 20 searching for the correct realm 2024-02-23T06:40:01.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.662+0000 7f85ec350640 0 -- 172.21.15.142:0/3195402977 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f85e0067070 msgr2=0x7f85e0098b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.665+0000 7f85ebb4f640 0 -- 172.21.15.142:0/3195402977 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f85e00d49e0 msgr2=0x7f85e0069920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:01.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:01.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:01.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:01.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:01.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.670+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 zone default found 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 4 Realm: () 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 zonegroup default 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.671+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.672+0000 7f85f0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.672+0000 7f85f0616800 20 started sync module instance, tier type = 2024-02-23T06:40:01.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.672+0000 7f85f0616800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:01.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=0 2024-02-23T06:40:01.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=1 2024-02-23T06:40:01.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=2 2024-02-23T06:40:01.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=3 2024-02-23T06:40:01.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=4 2024-02-23T06:40:01.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=5 2024-02-23T06:40:01.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.680+0000 7f85f0616800 20 add_watcher() i=6 2024-02-23T06:40:01.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.681+0000 7f85f0616800 20 add_watcher() i=7 2024-02-23T06:40:01.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.681+0000 7f85f0616800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:01.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.682+0000 7f84a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f85f0616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f85f0616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f85f0616800 5 note: GC not initialized 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f84a0fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f85f0616800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f85f0616800 20 Filter name: none 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f841a7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:01.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.683+0000 7f85f0616800 20 processing logshard = reshard.0000000000 2024-02-23T06:40:01.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.686+0000 7f85f0616800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-02-23T06:40:01.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.686+0000 7f85f0616800 20 processing logshard = reshard.0000000001 2024-02-23T06:40:01.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.688+0000 7f85f0616800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-02-23T06:40:01.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.688+0000 7f85f0616800 20 processing logshard = reshard.0000000002 2024-02-23T06:40:01.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.690+0000 7f85f0616800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-02-23T06:40:01.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.690+0000 7f85f0616800 20 processing logshard = reshard.0000000003 2024-02-23T06:40:01.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.692+0000 7f85f0616800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-02-23T06:40:01.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.692+0000 7f85f0616800 20 processing logshard = reshard.0000000004 2024-02-23T06:40:01.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.695+0000 7f85f0616800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-02-23T06:40:01.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.695+0000 7f85f0616800 20 processing logshard = reshard.0000000005 2024-02-23T06:40:01.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.697+0000 7f85f0616800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-02-23T06:40:01.697 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.697+0000 7f85f0616800 20 processing logshard = reshard.0000000006 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.698+0000 7f85f0616800 20 process_entry resharding a-bucket 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.698+0000 7f85f0616800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.698+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : miss 2024-02-23T06:40:01.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:01.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:40:01.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:40:01.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:01.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:40:01.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.699+0000 7f85f0616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.705+0000 7f85f0616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.705+0000 7f85f0616800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.705+0000 7f85f0616800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.705+0000 7f85f0616800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17, ofs0, ns] 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f84caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693243 cookie 94716440901776 notifier 6144 bl.length()=789 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f84caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:40:01.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f84caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:40:01.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f84caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:40:01.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_sources= new_sources= 2024-02-23T06:40:01.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential sources added=[] removed=[] 2024-02-23T06:40:01.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_dests= new_dests= 2024-02-23T06:40:01.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.706+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential dests added=[] removed=[] 2024-02-23T06:40:01.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 2024-02-23T06:40:01.709 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.1 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.1 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.2 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.2 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.3 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.3 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.4 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.4 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.5 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.5 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.6 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.6 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.7 2024-02-23T06:40:01.710 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.7 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.8 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.8 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.9 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.9 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.10 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.10 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.11 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.11 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.12 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.12 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.0 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.0 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.1 2024-02-23T06:40:01.711 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.709+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.1 2024-02-23T06:40:01.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.710+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.2 2024-02-23T06:40:01.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.710+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.2 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.710+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.3 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.710+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.3 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.710+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.4 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.710+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.4 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.711+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.5 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.711+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.5 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.711+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.6 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.711+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.6 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.712+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.7 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.712+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.7 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.712+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.8 2024-02-23T06:40:01.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.712+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.8 2024-02-23T06:40:01.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.713+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.9 2024-02-23T06:40:01.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.713+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.9 2024-02-23T06:40:01.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.713+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.10 2024-02-23T06:40:01.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.713+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.10 2024-02-23T06:40:01.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.714+0000 7f85f0616800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.11 2024-02-23T06:40:01.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.714+0000 7f85f0616800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.1.11 2024-02-23T06:40:01.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.716+0000 7f85f0616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : hit (requested=0x17, cached=0x17) 2024-02-23T06:40:01.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.716+0000 7f85f0616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:40:01.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f85f0616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:40:01.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f85f0616800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:40:01.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f85f0616800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:40:01.717 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f85f0616800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17, ofs0, ns] 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f84caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693244 cookie 94716440901776 notifier 6144 bl.length()=757 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f84caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f84caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.717+0000 7f84caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.718+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_sources= new_sources= 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.718+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential sources added=[] removed=[] 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.718+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_dests= new_dests= 2024-02-23T06:40:01.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.718+0000 7f85f0616800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential dests added=[] removed=[] 2024-02-23T06:40:01.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.720+0000 7f85f0616800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-02-23T06:40:01.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.721+0000 7f85f0616800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-02-23T06:40:01.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.723+0000 7f85f0616800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-02-23T06:40:01.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.723+0000 7f85f0616800 20 processing logshard = reshard.0000000007 2024-02-23T06:40:01.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.725+0000 7f85f0616800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-02-23T06:40:01.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.725+0000 7f85f0616800 20 processing logshard = reshard.0000000008 2024-02-23T06:40:01.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.727+0000 7f85f0616800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-02-23T06:40:01.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.727+0000 7f85f0616800 20 processing logshard = reshard.0000000009 2024-02-23T06:40:01.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.730+0000 7f85f0616800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-02-23T06:40:01.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.730+0000 7f85f0616800 20 processing logshard = reshard.0000000010 2024-02-23T06:40:01.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.732+0000 7f85f0616800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-02-23T06:40:01.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.732+0000 7f85f0616800 20 processing logshard = reshard.0000000011 2024-02-23T06:40:01.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.734+0000 7f85f0616800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-02-23T06:40:01.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.734+0000 7f85f0616800 20 processing logshard = reshard.0000000012 2024-02-23T06:40:01.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.737+0000 7f85f0616800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-02-23T06:40:01.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.737+0000 7f85f0616800 20 processing logshard = reshard.0000000013 2024-02-23T06:40:01.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.739+0000 7f85f0616800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-02-23T06:40:01.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.739+0000 7f85f0616800 20 processing logshard = reshard.0000000014 2024-02-23T06:40:01.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.741+0000 7f85f0616800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-02-23T06:40:01.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.741+0000 7f85f0616800 20 processing logshard = reshard.0000000015 2024-02-23T06:40:01.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.743+0000 7f85f0616800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-02-23T06:40:01.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.744+0000 7f84a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.746+0000 7f85f0616800 20 remove_watcher() i=0 2024-02-23T06:40:01.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.746+0000 7f85f0616800 2 removed watcher, disabling cache 2024-02-23T06:40:01.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.747+0000 7f85f0616800 20 remove_watcher() i=1 2024-02-23T06:40:01.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.748+0000 7f85f0616800 20 remove_watcher() i=2 2024-02-23T06:40:01.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.749+0000 7f85f0616800 20 remove_watcher() i=3 2024-02-23T06:40:01.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.750+0000 7f85f0616800 20 remove_watcher() i=4 2024-02-23T06:40:01.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.751+0000 7f85f0616800 20 remove_watcher() i=5 2024-02-23T06:40:01.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.752+0000 7f85f0616800 20 remove_watcher() i=6 2024-02-23T06:40:01.753 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.753+0000 7f85f0616800 20 remove_watcher() i=7 2024-02-23T06:40:01.764 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-02-23T06:40:01.791 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:01.792 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:01.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.824+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 realm 2024-02-23T06:40:01.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:01.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.826+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.827+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.827+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.827+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:01.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.827+0000 7f776e413800 20 searching for the correct realm 2024-02-23T06:40:01.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.829+0000 7f776c44c640 0 -- 172.21.15.142:0/3311159456 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f7754032070 msgr2=0x7f7754033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.831+0000 7f776c44c640 0 -- 172.21.15.142:0/3311159456 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f77580030f0 msgr2=0x7f7754048400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:01.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:01.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.838+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:01.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 zone default found 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 4 Realm: () 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 zonegroup default 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.839+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.840+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.840+0000 7f776e413800 20 started sync module instance, tier type = 2024-02-23T06:40:01.841 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.840+0000 7f776e413800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=0 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=1 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=2 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=3 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=4 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=5 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.848+0000 7f776e413800 20 add_watcher() i=6 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.849+0000 7f776e413800 20 add_watcher() i=7 2024-02-23T06:40:01.849 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.849+0000 7f776e413800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:01.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f7621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f776e413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:01.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f776e413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:01.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f776e413800 5 note: GC not initialized 2024-02-23T06:40:01.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f7620fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f776e413800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f776e413800 20 Filter name: none 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f759a7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.851+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.852+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.852+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.852+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.852+0000 7f776e413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:01.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.852+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.853+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:40:01.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.853+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.853+0000 7f776e413800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:40:01.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.853+0000 7f776e413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:01.854 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.854+0000 7f776e413800 20 rados->read ofs=0 len=0 2024-02-23T06:40:01.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.854+0000 7f776e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:01.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.855+0000 7f7621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:01.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.857+0000 7f776e413800 20 remove_watcher() i=0 2024-02-23T06:40:01.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.857+0000 7f776e413800 2 removed watcher, disabling cache 2024-02-23T06:40:01.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.858+0000 7f776e413800 20 remove_watcher() i=1 2024-02-23T06:40:01.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.859+0000 7f776e413800 20 remove_watcher() i=2 2024-02-23T06:40:01.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.860+0000 7f776e413800 20 remove_watcher() i=3 2024-02-23T06:40:01.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.860+0000 7f776e413800 20 remove_watcher() i=4 2024-02-23T06:40:01.862 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.862+0000 7f776e413800 20 remove_watcher() i=5 2024-02-23T06:40:01.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.863+0000 7f776e413800 20 remove_watcher() i=6 2024-02-23T06:40:01.864 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:01.864+0000 7f776e413800 20 remove_watcher() i=7 2024-02-23T06:40:01.874 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:01.874 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:01.874 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: a-bucket id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-02-23T06:40:01.874 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:01.874 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-02-23T06:40:01.874 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:02.083 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-02-23T06:40:02.111 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:02.111 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:02.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.146+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 realm 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.147+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.148+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.148+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.149+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:02.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.149+0000 7f06fbe38800 20 searching for the correct realm 2024-02-23T06:40:02.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.152+0000 7f06f764c640 0 -- 172.21.15.142:0/419333189 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f06e0081040 msgr2=0x7f06e0009850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:02.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.155+0000 7f06f6e4b640 0 -- 172.21.15.142:0/419333189 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f06e00d83e0 msgr2=0x7f06e0076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:02.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:02.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:02.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:02.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:02.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:02.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:02.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:02.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 zone default found 2024-02-23T06:40:02.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 4 Realm: () 2024-02-23T06:40:02.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 zonegroup default 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.160+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 started sync module instance, tier type = 2024-02-23T06:40:02.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.161+0000 7f06fbe38800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:02.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=0 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=1 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=2 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=3 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=4 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=5 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.170+0000 7f06fbe38800 20 add_watcher() i=6 2024-02-23T06:40:02.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.171+0000 7f06fbe38800 20 add_watcher() i=7 2024-02-23T06:40:02.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.171+0000 7f06fbe38800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f05ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f06fbe38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f06fbe38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f06fbe38800 5 note: GC not initialized 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f0527fff640 20 reqs_thread_entry: start 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f06fbe38800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f06fbe38800 20 Filter name: none 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f0525ffb640 20 reqs_thread_entry: start 2024-02-23T06:40:02.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.173+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.174+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:02.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.174+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.174+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.174+0000 7f06fbe38800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.174+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.175+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.175+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.175+0000 7f06fbe38800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.175+0000 7f06fbe38800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:02.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.176+0000 7f06fbe38800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.176+0000 7f06fbe38800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.177+0000 7f05ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:02.179 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.179+0000 7f06fbe38800 20 remove_watcher() i=0 2024-02-23T06:40:02.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.179+0000 7f06fbe38800 2 removed watcher, disabling cache 2024-02-23T06:40:02.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.180+0000 7f06fbe38800 20 remove_watcher() i=1 2024-02-23T06:40:02.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.181+0000 7f06fbe38800 20 remove_watcher() i=2 2024-02-23T06:40:02.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.182+0000 7f06fbe38800 20 remove_watcher() i=3 2024-02-23T06:40:02.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.183+0000 7f06fbe38800 20 remove_watcher() i=4 2024-02-23T06:40:02.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.184+0000 7f06fbe38800 20 remove_watcher() i=5 2024-02-23T06:40:02.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.185+0000 7f06fbe38800 20 remove_watcher() i=6 2024-02-23T06:40:02.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.186+0000 7f06fbe38800 20 remove_watcher() i=7 2024-02-23T06:40:02.196 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:02.196 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:02.196 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:02.196 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:02.198 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-02-23T06:40:02.230 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:02.230 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:02.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.263+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 realm 2024-02-23T06:40:02.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.264+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.265+0000 7f0f60f1e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.265 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.265+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.265+0000 7f0f60f1e800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:02.266 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.265+0000 7f0f60f1e800 20 searching for the correct realm 2024-02-23T06:40:02.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.268+0000 7f0f55fa2640 0 -- 172.21.15.142:0/1918136067 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f0f50028040 msgr2=0x7f0f500193f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:02.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.271+0000 7f0f5e7a3640 0 -- 172.21.15.142:0/1918136067 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f0f48083bb0 msgr2=0x7f0f480809a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:02.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:02.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.476+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:02.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 zone default found 2024-02-23T06:40:02.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 4 Realm: () 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 zonegroup default 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.477+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 started sync module instance, tier type = 2024-02-23T06:40:02.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.478+0000 7f0f60f1e800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:02.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=0 2024-02-23T06:40:02.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=1 2024-02-23T06:40:02.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=2 2024-02-23T06:40:02.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=3 2024-02-23T06:40:02.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=4 2024-02-23T06:40:02.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=5 2024-02-23T06:40:02.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.487+0000 7f0f60f1e800 20 add_watcher() i=6 2024-02-23T06:40:02.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.488+0000 7f0f60f1e800 20 add_watcher() i=7 2024-02-23T06:40:02.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.488+0000 7f0f60f1e800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:02.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 5 note: GC not initialized 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0d8f7fe640 20 reqs_thread_entry: start 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 20 Filter name: none 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0d8d7fa640 20 reqs_thread_entry: start 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-02-23T06:40:02.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.490+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 : miss 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:02.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 info.flags=0x17 2024-02-23T06:40:02.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 to cache LRU end 2024-02-23T06:40:02.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:02.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:02.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.491+0000 7f0f60f1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 2024-02-23T06:40:02.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.495+0000 7f0f60f1e800 -1 Injecting error=-5 at location=set_target_layout 2024-02-23T06:40:02.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.495+0000 7f0f60f1e800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-02-23T06:40:02.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.499+0000 7f0e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:02.501 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.501+0000 7f0f60f1e800 20 remove_watcher() i=0 2024-02-23T06:40:02.501 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.501+0000 7f0f60f1e800 2 removed watcher, disabling cache 2024-02-23T06:40:02.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.502+0000 7f0f60f1e800 20 remove_watcher() i=1 2024-02-23T06:40:02.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.503+0000 7f0f60f1e800 20 remove_watcher() i=2 2024-02-23T06:40:02.504 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.504+0000 7f0f60f1e800 20 remove_watcher() i=3 2024-02-23T06:40:02.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.505+0000 7f0f60f1e800 20 remove_watcher() i=4 2024-02-23T06:40:02.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.506+0000 7f0f60f1e800 20 remove_watcher() i=5 2024-02-23T06:40:02.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.507+0000 7f0f60f1e800 20 remove_watcher() i=6 2024-02-23T06:40:02.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.508+0000 7f0f60f1e800 20 remove_watcher() i=7 2024-02-23T06:40:02.519 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-02-23T06:40:02.546 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:02.546 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:02.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.578+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 realm 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.580+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.581+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.581+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.581+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:02.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.581+0000 7fb364416800 20 searching for the correct realm 2024-02-23T06:40:02.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.584+0000 7fb35f04a640 0 -- 172.21.15.142:0/3938873066 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fb35002c480 msgr2=0x7fb35002c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:02.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.588+0000 7fb35f84b640 0 -- 172.21.15.142:0/3938873066 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb35407d220 msgr2=0x7fb35408f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:02.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:02.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:02.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:02.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:02.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:02.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:02.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.793+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 zone default found 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 4 Realm: () 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:02.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 zonegroup default 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.794+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 started sync module instance, tier type = 2024-02-23T06:40:02.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.795+0000 7fb364416800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=0 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=1 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=2 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=3 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=4 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=5 2024-02-23T06:40:02.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.804+0000 7fb364416800 20 add_watcher() i=6 2024-02-23T06:40:02.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.805+0000 7fb364416800 20 add_watcher() i=7 2024-02-23T06:40:02.806 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.805+0000 7fb364416800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:02.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:02.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb364416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:02.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb364416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb364416800 5 note: GC not initialized 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb214fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb364416800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.807+0000 7fb364416800 20 Filter name: none 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb18e7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb364416800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.808+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.809+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.809+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.809+0000 7fb364416800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:02.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.809+0000 7fb364416800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:02.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.810+0000 7fb364416800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.811 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.811+0000 7fb364416800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.812 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.811+0000 7fb215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:02.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.813+0000 7fb364416800 20 remove_watcher() i=0 2024-02-23T06:40:02.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.813+0000 7fb364416800 2 removed watcher, disabling cache 2024-02-23T06:40:02.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.814+0000 7fb364416800 20 remove_watcher() i=1 2024-02-23T06:40:02.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.815+0000 7fb364416800 20 remove_watcher() i=2 2024-02-23T06:40:02.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.816+0000 7fb364416800 20 remove_watcher() i=3 2024-02-23T06:40:02.817 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.817+0000 7fb364416800 20 remove_watcher() i=4 2024-02-23T06:40:02.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.818+0000 7fb364416800 20 remove_watcher() i=5 2024-02-23T06:40:02.819 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.819+0000 7fb364416800 20 remove_watcher() i=6 2024-02-23T06:40:02.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.820+0000 7fb364416800 20 remove_watcher() i=7 2024-02-23T06:40:02.830 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:02.830 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:02.831 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:02.831 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:02.883 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:40:02.913 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:02.913 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:02.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.945+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.947 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 realm 2024-02-23T06:40:02.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:02.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:02.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.947+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.948+0000 7f7d0048c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:02.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.948+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:02.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.948+0000 7f7d0048c800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:02.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.948+0000 7f7d0048c800 20 searching for the correct realm 2024-02-23T06:40:02.951 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.951+0000 7f7cf554e640 0 -- 172.21.15.142:0/2665428378 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f7cf0056020 msgr2=0x7f7cf0016050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:02.954 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:02.954+0000 7f7cfdd4f640 0 -- 172.21.15.142:0/2665428378 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f7ce8060bb0 msgr2=0x7f7ce80a1d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.160+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 zone default found 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 4 Realm: () 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 zonegroup default 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.161+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.162+0000 7f7d0048c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.162+0000 7f7d0048c800 20 started sync module instance, tier type = 2024-02-23T06:40:03.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.162+0000 7f7d0048c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=0 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=1 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=2 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=3 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=4 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=5 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.170+0000 7f7d0048c800 20 add_watcher() i=6 2024-02-23T06:40:03.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.171+0000 7f7d0048c800 20 add_watcher() i=7 2024-02-23T06:40:03.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.171+0000 7f7d0048c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:03.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.173+0000 7f7baf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:03.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.173+0000 7f7d0048c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:03.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.173+0000 7f7d0048c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:03.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.173+0000 7f7d0048c800 5 note: GC not initialized 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.173+0000 7f7bae7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 20 Filter name: none 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7b1ffff640 20 reqs_thread_entry: start 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-02-23T06:40:03.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-02-23T06:40:03.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 : miss 2024-02-23T06:40:03.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.174+0000 7f7d0048c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.175+0000 7f7d0048c800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:03.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.175+0000 7f7d0048c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 info.flags=0x17 2024-02-23T06:40:03.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.175+0000 7f7d0048c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 to cache LRU end 2024-02-23T06:40:03.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.175+0000 7f7d0048c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:03.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.175+0000 7f7d0048c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:03.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.175+0000 7f7d0048c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 2024-02-23T06:40:03.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 info.flags=0x17 2024-02-23T06:40:03.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 to cache LRU end 2024-02-23T06:40:03.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:03.180 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19, ofs0, ns] 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7be0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693246 cookie 94856141574192 notifier 5936 bl.length()=887 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7be0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 info.flags=0x17 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7be0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 to cache LRU end 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7be0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): orig_sources= new_sources= 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): potential sources added=[] removed=[] 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): orig_dests= new_dests= 2024-02-23T06:40:03.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.180+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): potential dests added=[] removed=[] 2024-02-23T06:40:03.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.0 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.0 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.1 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.1 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.2 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.2 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.3 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.3 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.4 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.4 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.5 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.5 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.6 2024-02-23T06:40:03.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.6 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.7 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.7 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.8 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.8 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.9 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.9 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.10 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.10 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.11 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1.11 2024-02-23T06:40:03.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.183+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.0 2024-02-23T06:40:03.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.184+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.1 2024-02-23T06:40:03.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.184+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.2 2024-02-23T06:40:03.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.184+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.3 2024-02-23T06:40:03.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.185+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.4 2024-02-23T06:40:03.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.185+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.5 2024-02-23T06:40:03.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.186+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.6 2024-02-23T06:40:03.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.186+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.7 2024-02-23T06:40:03.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.186+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.8 2024-02-23T06:40:03.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.187+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.9 2024-02-23T06:40:03.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.187+0000 7f7d0048c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19.10 2024-02-23T06:40:03.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.190+0000 7f7d0048c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 : hit (requested=0x17, cached=0x17) 2024-02-23T06:40:03.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.190+0000 7f7d0048c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 2024-02-23T06:40:03.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.191+0000 7f7d0048c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 info.flags=0x17 2024-02-23T06:40:03.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.191+0000 7f7d0048c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 to cache LRU end 2024-02-23T06:40:03.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.191+0000 7f7d0048c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:03.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.191+0000 7f7d0048c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19, ofs0, ns] 2024-02-23T06:40:03.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7be17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693247 cookie 94856141574192 notifier 5936 bl.length()=855 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7be17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 info.flags=0x17 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7be17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 to cache LRU end 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7be17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): orig_sources= new_sources= 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): potential sources added=[] removed=[] 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): orig_dests= new_dests= 2024-02-23T06:40:03.193 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.192+0000 7f7d0048c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19]): potential dests added=[] removed=[] 2024-02-23T06:40:03.195 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.195+0000 7f7d0048c800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-02-23T06:40:03.196 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.196+0000 7f7baf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:03.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.198+0000 7f7d0048c800 20 remove_watcher() i=0 2024-02-23T06:40:03.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.198+0000 7f7d0048c800 2 removed watcher, disabling cache 2024-02-23T06:40:03.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.199+0000 7f7d0048c800 20 remove_watcher() i=1 2024-02-23T06:40:03.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.201+0000 7f7d0048c800 20 remove_watcher() i=2 2024-02-23T06:40:03.202 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.202+0000 7f7d0048c800 20 remove_watcher() i=3 2024-02-23T06:40:03.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.203+0000 7f7d0048c800 20 remove_watcher() i=4 2024-02-23T06:40:03.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.204+0000 7f7d0048c800 20 remove_watcher() i=5 2024-02-23T06:40:03.205 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.205+0000 7f7d0048c800 20 remove_watcher() i=6 2024-02-23T06:40:03.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.206+0000 7f7d0048c800 20 remove_watcher() i=7 2024-02-23T06:40:03.217 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-02-23T06:40:03.244 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:03.244 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:03.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.277+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 realm 2024-02-23T06:40:03.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:03.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.278+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.279+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:03.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.279+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.279+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:03.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.279+0000 7f32a2731800 20 searching for the correct realm 2024-02-23T06:40:03.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.282+0000 7f329d9a2640 0 -- 172.21.15.142:0/3326901664 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x5608ad8348b0 msgr2=0x5608ad836d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:03.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.286+0000 7f329e1a3640 0 -- 172.21.15.142:0/3326901664 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f32940a2a60 msgr2=0x7f32940a0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:03.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:03.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:03.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:03.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:03.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.289+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 zone default found 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 4 Realm: () 2024-02-23T06:40:03.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:03.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:03.293 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:03.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 zonegroup default 2024-02-23T06:40:03.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.290+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.291+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.294 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.291+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.291+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.291+0000 7f32a2731800 20 started sync module instance, tier type = 2024-02-23T06:40:03.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.291+0000 7f32a2731800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=0 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=1 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=2 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=3 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=4 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=5 2024-02-23T06:40:03.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.299+0000 7f32a2731800 20 add_watcher() i=6 2024-02-23T06:40:03.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.300+0000 7f32a2731800 20 add_watcher() i=7 2024-02-23T06:40:03.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.300+0000 7f32a2731800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:03.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f3154fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f32a2731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f32a2731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f32a2731800 5 note: GC not initialized 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f30cf7fe640 20 reqs_thread_entry: start 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f32a2731800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.302+0000 7f32a2731800 20 Filter name: none 2024-02-23T06:40:03.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.303+0000 7f30cd7fa640 20 reqs_thread_entry: start 2024-02-23T06:40:03.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.303+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.303+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:03.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.303+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:03.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.304+0000 7f32a2731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:03.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.305+0000 7f32a2731800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.305+0000 7f32a2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.306+0000 7f3154fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:03.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.308+0000 7f32a2731800 20 remove_watcher() i=0 2024-02-23T06:40:03.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.308+0000 7f32a2731800 2 removed watcher, disabling cache 2024-02-23T06:40:03.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.309+0000 7f32a2731800 20 remove_watcher() i=1 2024-02-23T06:40:03.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.310+0000 7f32a2731800 20 remove_watcher() i=2 2024-02-23T06:40:03.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.311+0000 7f32a2731800 20 remove_watcher() i=3 2024-02-23T06:40:03.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.312+0000 7f32a2731800 20 remove_watcher() i=4 2024-02-23T06:40:03.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.313+0000 7f32a2731800 20 remove_watcher() i=5 2024-02-23T06:40:03.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.314+0000 7f32a2731800 20 remove_watcher() i=6 2024-02-23T06:40:03.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.315+0000 7f32a2731800 20 remove_watcher() i=7 2024-02-23T06:40:03.325 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:03.325 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:03.325 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:40:03.325 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:03.416 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-02-23T06:40:03.417 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:03.615 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-02-23T06:40:03.642 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:03.642 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:03.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.674+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.675+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.675+0000 7f0de7415800 20 realm 2024-02-23T06:40:03.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.675+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.676+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.676+0000 7f0de7415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:03.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.676+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.676+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.676+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.677+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:03.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.677+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.677+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:03.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.677+0000 7f0de7415800 20 searching for the correct realm 2024-02-23T06:40:03.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.681+0000 7f0de2fa4640 0 -- 172.21.15.142:0/1078092571 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f0dcc015940 msgr2=0x7f0dcc04f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:03.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.886+0000 7f0de27a3640 0 -- 172.21.15.142:0/1078092571 >> [v2:172.21.15.152:6824/160508611,v1:172.21.15.152:6825/160508611] conn(0x5603ae6b6a20 msgr2=0x5603ae6b8e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.888+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:03.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 zone default found 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 4 Realm: () 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 zonegroup default 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.889+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.890+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.890+0000 7f0de7415800 20 started sync module instance, tier type = 2024-02-23T06:40:03.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.890+0000 7f0de7415800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=0 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=1 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=2 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=3 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=4 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=5 2024-02-23T06:40:03.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.898+0000 7f0de7415800 20 add_watcher() i=6 2024-02-23T06:40:03.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.899+0000 7f0de7415800 20 add_watcher() i=7 2024-02-23T06:40:03.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.899+0000 7f0de7415800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:03.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0c98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:03.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0de7415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:03.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0de7415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:03.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0de7415800 5 note: GC not initialized 2024-02-23T06:40:03.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0c137fe640 20 reqs_thread_entry: start 2024-02-23T06:40:03.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0de7415800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:03.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.901+0000 7f0de7415800 20 Filter name: none 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.902+0000 7f0c117fa640 20 reqs_thread_entry: start 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.902+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.902+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.902+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:03.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.903+0000 7f0de7415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:03.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.904+0000 7f0de7415800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.904+0000 7f0de7415800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.905+0000 7f0c98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:03.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.907+0000 7f0de7415800 20 remove_watcher() i=0 2024-02-23T06:40:03.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.907+0000 7f0de7415800 2 removed watcher, disabling cache 2024-02-23T06:40:03.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.908+0000 7f0de7415800 20 remove_watcher() i=1 2024-02-23T06:40:03.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.909+0000 7f0de7415800 20 remove_watcher() i=2 2024-02-23T06:40:03.910 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.910+0000 7f0de7415800 20 remove_watcher() i=3 2024-02-23T06:40:03.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.911+0000 7f0de7415800 20 remove_watcher() i=4 2024-02-23T06:40:03.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.912+0000 7f0de7415800 20 remove_watcher() i=5 2024-02-23T06:40:03.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.913+0000 7f0de7415800 20 remove_watcher() i=6 2024-02-23T06:40:03.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.914+0000 7f0de7415800 20 remove_watcher() i=7 2024-02-23T06:40:03.923 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:03.924 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:03.924 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:03.924 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:03.925 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-02-23T06:40:03.959 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:03.960 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:03.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.992+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 realm 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:03.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.993+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.994+0000 7f30b9e8c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:03.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.994+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:03.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.994+0000 7f30b9e8c800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:03.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.994+0000 7f30b9e8c800 20 searching for the correct realm 2024-02-23T06:40:03.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:03.997+0000 7f30b7f50640 0 -- 172.21.15.142:0/1627860882 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f30a0083040 msgr2=0x7f30a0057b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:04.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.000+0000 7f30b774f640 0 -- 172.21.15.142:0/1627860882 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f30a0001eb0 msgr2=0x7f30a001a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:04.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.207+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 zone default found 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 4 Realm: () 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 zonegroup default 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.208+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.209+0000 7f30b9e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.209+0000 7f30b9e8c800 20 started sync module instance, tier type = 2024-02-23T06:40:04.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.209+0000 7f30b9e8c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=0 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=1 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=2 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=3 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=4 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=5 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.218+0000 7f30b9e8c800 20 add_watcher() i=6 2024-02-23T06:40:04.219 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.219+0000 7f30b9e8c800 20 add_watcher() i=7 2024-02-23T06:40:04.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.219+0000 7f30b9e8c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.220+0000 7f2f6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 5 note: GC not initialized 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f2f6cfe1640 20 reqs_thread_entry: start 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 20 Filter name: none 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f2ee67fc640 20 reqs_thread_entry: start 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.221+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:04.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 : miss 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 info.flags=0x17 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 to cache LRU end 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:04.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.222+0000 7f30b9e8c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 2024-02-23T06:40:04.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.225+0000 7f30b9e8c800 -1 Injecting error=-125 at location=set_target_layout 2024-02-23T06:40:04.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 info.flags=0x17 2024-02-23T06:40:04.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 to cache LRU end 2024-02-23T06:40:04.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:04.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20, ofs0, ns] 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f2f9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693250 cookie 94436033378608 notifier 6288 bl.length()=887 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f2f9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 info.flags=0x17 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f2f9a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 to cache LRU end 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f2f9a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): orig_sources= new_sources= 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): potential sources added=[] removed=[] 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): orig_dests= new_dests= 2024-02-23T06:40:04.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.227+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): potential dests added=[] removed=[] 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.0 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.0 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.1 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.1 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.2 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.2 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.3 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.3 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.4 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.4 2024-02-23T06:40:04.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.5 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.5 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.6 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.6 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.7 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.7 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.8 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.8 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.9 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.9 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.10 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.10 2024-02-23T06:40:04.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.11 2024-02-23T06:40:04.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1.11 2024-02-23T06:40:04.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.230+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.0 2024-02-23T06:40:04.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.231+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.1 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.231+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.2 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.231+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.3 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.232+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.4 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.232+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.5 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.233+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.6 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.233+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.7 2024-02-23T06:40:04.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.234+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.8 2024-02-23T06:40:04.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.235+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.9 2024-02-23T06:40:04.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.235+0000 7f30b9e8c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20.10 2024-02-23T06:40:04.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.238+0000 7f30b9e8c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 : hit (requested=0x17, cached=0x17) 2024-02-23T06:40:04.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.238+0000 7f30b9e8c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 2024-02-23T06:40:04.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.239+0000 7f30b9e8c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 info.flags=0x17 2024-02-23T06:40:04.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.239+0000 7f30b9e8c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 to cache LRU end 2024-02-23T06:40:04.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.239+0000 7f30b9e8c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.239+0000 7f30b9e8c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20, ofs0, ns] 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f2f9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693251 cookie 94436033378608 notifier 6288 bl.length()=855 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f2f9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 info.flags=0x17 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f2f9a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 to cache LRU end 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f2f9a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): orig_sources= new_sources= 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): potential sources added=[] removed=[] 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): orig_dests= new_dests= 2024-02-23T06:40:04.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.240+0000 7f30b9e8c800 20 handle_bi_update(): bucket=:error-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20]): potential dests added=[] removed=[] 2024-02-23T06:40:04.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.242+0000 7f30b9e8c800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-02-23T06:40:04.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.244+0000 7f2f6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:04.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.246+0000 7f30b9e8c800 20 remove_watcher() i=0 2024-02-23T06:40:04.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.246+0000 7f30b9e8c800 2 removed watcher, disabling cache 2024-02-23T06:40:04.247 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.247+0000 7f30b9e8c800 20 remove_watcher() i=1 2024-02-23T06:40:04.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.248+0000 7f30b9e8c800 20 remove_watcher() i=2 2024-02-23T06:40:04.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.250+0000 7f30b9e8c800 20 remove_watcher() i=3 2024-02-23T06:40:04.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.251+0000 7f30b9e8c800 20 remove_watcher() i=4 2024-02-23T06:40:04.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.252+0000 7f30b9e8c800 20 remove_watcher() i=5 2024-02-23T06:40:04.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.253+0000 7f30b9e8c800 20 remove_watcher() i=6 2024-02-23T06:40:04.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.254+0000 7f30b9e8c800 20 remove_watcher() i=7 2024-02-23T06:40:04.266 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-02-23T06:40:04.293 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:04.294 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:04.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.326+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.327+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.327+0000 7fefa6612800 20 realm 2024-02-23T06:40:04.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.327+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.327+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.327+0000 7fefa6612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:04.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.327+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.328+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.328+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.328+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:04.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.328+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.329+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:04.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.329+0000 7fefa6612800 20 searching for the correct realm 2024-02-23T06:40:04.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.332+0000 7fefa11a2640 0 -- 172.21.15.142:0/2880729264 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x5619c8d08d20 msgr2=0x5619c8d0b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:04.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.335+0000 7fefa19a3640 0 -- 172.21.15.142:0/2880729264 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fef98068920 msgr2=0x7fef98067460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:04.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:04.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:04.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:04.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.339+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 zone default found 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 4 Realm: () 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:04.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 zonegroup default 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.340+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 started sync module instance, tier type = 2024-02-23T06:40:04.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.341+0000 7fefa6612800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:04.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.351+0000 7fefa6612800 20 add_watcher() i=0 2024-02-23T06:40:04.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.351+0000 7fefa6612800 20 add_watcher() i=1 2024-02-23T06:40:04.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.351+0000 7fefa6612800 20 add_watcher() i=2 2024-02-23T06:40:04.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.351+0000 7fefa6612800 20 add_watcher() i=3 2024-02-23T06:40:04.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.351+0000 7fefa6612800 20 add_watcher() i=4 2024-02-23T06:40:04.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.351+0000 7fefa6612800 20 add_watcher() i=5 2024-02-23T06:40:04.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.352+0000 7fefa6612800 20 add_watcher() i=6 2024-02-23T06:40:04.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.353+0000 7fefa6612800 20 add_watcher() i=7 2024-02-23T06:40:04.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.353+0000 7fefa6612800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:04.354 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.354+0000 7fee2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:04.355 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.354+0000 7fefa6612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.354+0000 7fefa6612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fefa6612800 5 note: GC not initialized 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fee2a7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fefa6612800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fefa6612800 20 Filter name: none 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fedc7fff640 20 reqs_thread_entry: start 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:04.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.355+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:04.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:04.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:04.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:04.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.356+0000 7fefa6612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:04.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.357+0000 7fefa6612800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.358+0000 7fefa6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.358+0000 7fee2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:04.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.361+0000 7fefa6612800 20 remove_watcher() i=0 2024-02-23T06:40:04.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.361+0000 7fefa6612800 2 removed watcher, disabling cache 2024-02-23T06:40:04.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.363+0000 7fefa6612800 20 remove_watcher() i=1 2024-02-23T06:40:04.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.364+0000 7fefa6612800 20 remove_watcher() i=2 2024-02-23T06:40:04.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.365+0000 7fefa6612800 20 remove_watcher() i=3 2024-02-23T06:40:04.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.366+0000 7fefa6612800 20 remove_watcher() i=4 2024-02-23T06:40:04.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.366+0000 7fefa6612800 20 remove_watcher() i=5 2024-02-23T06:40:04.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.367+0000 7fefa6612800 20 remove_watcher() i=6 2024-02-23T06:40:04.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.368+0000 7fefa6612800 20 remove_watcher() i=7 2024-02-23T06:40:04.378 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:04.378 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:04.379 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-02-23T06:40:04.379 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:04.473 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with abort at set_target_layout 2024-02-23T06:40:04.473 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:04.684 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-02-23T06:40:04.710 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:04.710 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:04.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.742+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 realm 2024-02-23T06:40:04.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:04.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.744+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.745+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:04.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.745+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.745+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:04.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.745+0000 7f790373b800 20 searching for the correct realm 2024-02-23T06:40:04.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.748+0000 7f78f6a4a640 0 -- 172.21.15.142:0/129662447 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x55abddc7d6d0 msgr2=0x55abddc7fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:04.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.752+0000 7f78ff24b640 0 -- 172.21.15.142:0/129662447 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f78e80bb8a0 msgr2=0x7f78e80a2a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:04.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:04.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:04.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.756+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:04.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 zone default found 2024-02-23T06:40:04.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 4 Realm: () 2024-02-23T06:40:04.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 zonegroup default 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.757+0000 7f790373b800 20 started sync module instance, tier type = 2024-02-23T06:40:04.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.758+0000 7f790373b800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:04.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=0 2024-02-23T06:40:04.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=1 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=2 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=3 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=4 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=5 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.766+0000 7f790373b800 20 add_watcher() i=6 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.767+0000 7f790373b800 20 add_watcher() i=7 2024-02-23T06:40:04.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.767+0000 7f790373b800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:04.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f77b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f790373b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f790373b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f790373b800 5 note: GC not initialized 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f77b4fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f790373b800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f790373b800 20 Filter name: none 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f772e7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:04.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.769+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.770+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:04.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.770+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:04.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:04.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:04.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:04.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.771+0000 7f790373b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:04.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.772+0000 7f790373b800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.772+0000 7f790373b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.773+0000 7f77b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:04.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.775+0000 7f790373b800 20 remove_watcher() i=0 2024-02-23T06:40:04.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.775+0000 7f790373b800 2 removed watcher, disabling cache 2024-02-23T06:40:04.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.776+0000 7f790373b800 20 remove_watcher() i=1 2024-02-23T06:40:04.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.777+0000 7f790373b800 20 remove_watcher() i=2 2024-02-23T06:40:04.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.778+0000 7f790373b800 20 remove_watcher() i=3 2024-02-23T06:40:04.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.779+0000 7f790373b800 20 remove_watcher() i=4 2024-02-23T06:40:04.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.780+0000 7f790373b800 20 remove_watcher() i=5 2024-02-23T06:40:04.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.781+0000 7f790373b800 20 remove_watcher() i=6 2024-02-23T06:40:04.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.782+0000 7f790373b800 20 remove_watcher() i=7 2024-02-23T06:40:04.791 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:04.791 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:04.791 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:04.791 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:04.793 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-02-23T06:40:04.825 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:04.826 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:04.858 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.858+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 realm 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:04.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:04.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:04.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:04.861 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.860+0000 7fea4a531800 20 searching for the correct realm 2024-02-23T06:40:04.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:04.863+0000 7fea3d7a2640 0 -- 172.21.15.142:0/826301341 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fea38085060 msgr2=0x7fea38002070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.069+0000 7fea45fa3640 0 -- 172.21.15.142:0/826301341 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fea30055e40 msgr2=0x7fea30059560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 zone default found 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 4 Realm: () 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 zonegroup default 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.277+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.277+0000 7fea4a531800 20 started sync module instance, tier type = 2024-02-23T06:40:05.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.277+0000 7fea4a531800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:05.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=0 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=1 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=2 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=3 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=4 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=5 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=6 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.287+0000 7fea4a531800 20 add_watcher() i=7 2024-02-23T06:40:05.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.287+0000 7fea4a531800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:05.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.288+0000 7fe8f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.289 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 5 note: GC not initialized 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fe8f67fc640 20 reqs_thread_entry: start 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 20 Filter name: none 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fe86bfff640 20 reqs_thread_entry: start 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-02-23T06:40:05.290 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.289+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:05.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-02-23T06:40:05.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 : miss 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:05.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.290+0000 7fea4a531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fea4a531800 time 2024-02-23T06:40:05.295333+0000 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fea4bb80e86] 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 4: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 6: main() 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.319 INFO:tasks.workunit.client.0.smithi142.stderr: 8: __libc_start_main() 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 9: _start() 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.295+0000 7fea4a531800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fea4a531800 time 2024-02-23T06:40:05.295333+0000 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fea4bb80e86] 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 4: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 6: main() 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.320 INFO:tasks.workunit.client.0.smithi142.stderr: 8: __libc_start_main() 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 9: _start() 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr:*** Caught signal (Aborted) ** 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fea4a531800 thread_name:radosgw-admin 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fea4aa54db0] 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fea4aaa154c] 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fea4bb80ee0] 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 8: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.321 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 10: main() 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 12: __libc_start_main() 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 13: _start() 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.296+0000 7fea4a531800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fea4a531800 thread_name:radosgw-admin 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fea4aa54db0] 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fea4aaa154c] 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fea4bb80ee0] 2024-02-23T06:40:05.322 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 8: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 10: main() 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 12: __libc_start_main() 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 13: _start() 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:40:04.842+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:40:04.842+0000 7fea467a4640 10 monclient(hunting): handle_auth_done global_id 6330 payload 274 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:40:04.842+0000 7fea467a4640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.323 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:40:04.842+0000 7fea467a4640 1 monclient: found mon.noname-a 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:40:04.842+0000 7fea467a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: dump: 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.324 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: dump: 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.325 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:40:04.842+0000 7fea4a531800 5 monclient: authenticate success, global_id 6330 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:40:04.842+0000 7fea4a531800 10 monclient: get_monmap_and_config success 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:40:04.842+0000 7fea4a531800 4 set_mon_vals no callback set 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:40:04.843+0000 7fea4a531800 10 monclient: shutdown 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 asok(0x562f8bac0620) unregister_commands rotate-key 2024-02-23T06:40:05.326 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:40:04.843+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:40:04.843+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:40:04.843+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.327 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding auth protocol: cephx 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding auth protocol: cephx 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding auth protocol: cephx 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.328 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:40:04.843+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:40:04.843+0000 7fea4a531800 1 librados: starting msgr at 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:40:04.843+0000 7fea4a531800 1 librados: starting objecter 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command objecter_requests hook 0x562f8bce4210 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:40:04.844+0000 7fea4a531800 1 librados: setting wanted keys 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:40:04.844+0000 7fea4a531800 1 librados: calling monclient init 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding auth protocol: cephx 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding auth protocol: cephx 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding auth protocol: cephx 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.329 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:40:04.844+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:40:04.844+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key hook 0x562f8bcdde58 2024-02-23T06:40:05.330 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bb88840 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bb92cd0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bc22430 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.157292s 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bb92cd0 auth_method 0 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.331 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bb88840 auth_method 0 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bc22430 auth_method 0 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.332 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_done global_id 6026 payload 824 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 1 monclient: found mon.noname-c 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: dump: 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.333 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: dump: 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.334 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:40:04.845+0000 7fea4a531800 5 monclient: authenticate success, global_id 6026 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:40:04.845+0000 7fe933e07640 4 set_mon_vals no callback set 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.335 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:40:04.845+0000 7fea4a531800 1 librados: init done 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:40:04.846+0000 7fe932604640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:40:04.846+0000 7fe932604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:40:04.846+0000 7fe932604640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:40:04.847+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fe92c069eb0 auth_method 0 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:40:04.847+0000 7fea467a4640 10 monclient: get_auth_request con 0x562f8bd26920 auth_method 0 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:40:04.848+0000 7fea45fa3640 10 monclient: get_auth_request con 0x562f8bd29b00 auth_method 0 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:40:04.849+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x562f8bd2eb90 auth_method 0 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:40:04.849+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:40:04.849+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:40:04.849+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.336 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding auth protocol: cephx 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding auth protocol: cephx 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding auth protocol: cephx 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.337 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:40:04.850+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command objecter_requests cmddesc objecter_requests hook 0x562f8bd36550 EEXIST 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding auth protocol: cephx 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding auth protocol: cephx 2024-02-23T06:40:05.338 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding auth protocol: cephx 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.339 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:40:04.850+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:40:04.850+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key cmddesc rotate-key hook 0x562f8bd31a20 EEXIST 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bd5cd80 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bd5d160 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bd6fb10 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.163558s 2024-02-23T06:40:05.340 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bd5cd80 auth_method 0 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bd5d160 auth_method 0 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.341 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bd6fb10 auth_method 0 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_done global_id 6336 payload 824 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:40:04.851+0000 7fea45fa3640 1 monclient: found mon.noname-a 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: dump: 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.342 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: dump: 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.343 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:40:04.851+0000 7fea4a531800 5 monclient: authenticate success, global_id 6336 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:40:04.851+0000 7fea46fa5640 4 set_mon_vals no callback set 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:40:04.853+0000 7fe92b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:05.344 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:40:04.853+0000 7fe92b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:40:04.853+0000 7fe92b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:40:04.853+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fe920069df0 auth_method 0 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: get_monmap_and_config 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:40:04.853+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.345 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding auth protocol: cephx 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding auth protocol: cephx 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding auth protocol: cephx 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.346 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:40:04.853+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding auth protocol: cephx 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding auth protocol: cephx 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding auth protocol: cephx 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.347 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:40:04.854+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:40:04.854+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:40:04.854+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key cmddesc rotate-key hook 0x7fffd96d0208 EEXIST 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient: _add_conns ranks=[2,0,1] 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bdaef60 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.348 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bdaf340 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bda91d0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.166960s 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bdaef60 auth_method 0 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bdaf340 auth_method 0 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.349 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bda91d0 auth_method 0 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_done global_id 6032 payload 274 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:40:04.854+0000 7fea45fa3640 1 monclient: found mon.noname-c 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.350 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: dump: 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.351 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: dump: 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.352 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:40:04.854+0000 7fea4a531800 5 monclient: authenticate success, global_id 6032 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient: get_monmap_and_config success 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:40:04.854+0000 7fea4a531800 4 set_mon_vals no callback set 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: shutdown 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.353 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding auth protocol: cephx 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding auth protocol: cephx 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding auth protocol: cephx 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.354 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:40:04.855+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: starting msgr at 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: starting objecter 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command objecter_requests cmddesc objecter_requests hook 0x562f8bdab070 EEXIST 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: setting wanted keys 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: calling monclient init 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding auth protocol: cephx 2024-02-23T06:40:05.355 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding auth protocol: cephx 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding auth protocol: cephx 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.356 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:40:04.856+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:40:04.856+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:40:04.856+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key cmddesc rotate-key hook 0x562f8bd72868 EEXIST 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient: _add_conns ranks=[2,1,0] 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bda91d0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bdaef60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bdb0640 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.357 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.169100s 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bda91d0 auth_method 0 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bdb0640 auth_method 0 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.358 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bdaef60 auth_method 0 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_done global_id 6035 payload 824 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:40:04.856+0000 7fea45fa3640 1 monclient: found mon.noname-c 2024-02-23T06:40:05.359 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:40:04.856+0000 7fe9177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:40:04.856+0000 7fe9177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:40:04.856+0000 7fe9177fe640 10 monclient: dump: 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.360 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: dump: 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.361 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:40:04.857+0000 7fea4a531800 5 monclient: authenticate success, global_id 6035 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:40:04.857+0000 7fe9297fa640 4 set_mon_vals no callback set 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:40:04.857+0000 7fea4a531800 1 librados: init done 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:40:04.857+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cr dump hook 0x562f8bdb44c8 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:40:04.858+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.362 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:40:04.858+0000 7fe9177fe640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:40:04.858+0000 7fe9177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:40:04.858+0000 7fe9177fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:40:04.858+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fe910069eb0 auth_method 0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:40:04.859+0000 7fea467a4640 10 monclient: get_auth_request con 0x562f8bdcaf40 auth_method 0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 realm 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:40:04.859+0000 7fea4a531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.363 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:40:04.860+0000 7fea45fa3640 10 monclient: get_auth_request con 0x562f8bdcf2f0 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 searching for the correct realm 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:40:04.861+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x562f8bdd3ca0 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:40:04.861+0000 7fea467a4640 10 monclient: get_auth_request con 0x7fea30008990 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:40:04.862+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fea40025040 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:40:04.863+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fea38085060 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:40:04.863+0000 7fea3d7a2640 0 -- 172.21.15.142:0/826301341 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fea38085060 msgr2=0x7fea38002070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:40:05.064+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fea38085060 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:40:05.066+0000 7fea467a4640 10 monclient: get_auth_request con 0x7fea300814f0 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:40:05.069+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fea30055e40 auth_method 0 2024-02-23T06:40:05.364 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:40:05.069+0000 7fea45fa3640 0 -- 172.21.15.142:0/826301341 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fea30055e40 msgr2=0x7fea30059560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:40:05.270+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fea30055e40 auth_method 0 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:05.365 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 zone default found 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:40:05.276+0000 7fea4a531800 4 Realm: () 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:40:05.276+0000 7fea4a531800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:40:05.276+0000 7fea4a531800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:40:05.276+0000 7fea4a531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 zonegroup default 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:40:05.277+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:40:05.277+0000 7fea4a531800 20 started sync module instance, tier type = 2024-02-23T06:40:05.366 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:40:05.277+0000 7fea4a531800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=0 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=1 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=2 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=3 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=4 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=5 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=6 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:40:05.287+0000 7fea4a531800 20 add_watcher() i=7 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:40:05.287+0000 7fea4a531800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding auth protocol: cephx 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding auth protocol: cephx 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding auth protocol: cephx 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.367 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:40:05.288+0000 7fe8f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:40:05.289+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:05.368 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache list hook 0x562f8bdb0a60 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache inspect hook 0x562f8bdb0a60 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache erase hook 0x562f8bdb0a60 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache zap hook 0x562f8bdb0a60 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 note: GC not initialized 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:40:05.289+0000 7fe8f67fc640 20 reqs_thread_entry: start 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace show hook 0x7fea38073030 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace history hook 0x7fea38073030 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace active hook 0x7fea38073030 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace active_short hook 0x7fea38073030 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 Filter name: none 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:40:05.289+0000 7fe86bfff640 20 reqs_thread_entry: start 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:40:05.289+0000 7fea4a531800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-02-23T06:40:05.369 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 : miss 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:40:05.295+0000 7fea4a531800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fea4a531800 time 2024-02-23T06:40:05.295333+0000 2024-02-23T06:40:05.370 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fea4bb80e86] 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 4: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 6: main() 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 8: __libc_start_main() 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 9: _start() 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:40:05.296+0000 7fea4a531800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:40:05.371 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fea4a531800 thread_name:radosgw-admin 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fea4aa54db0] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fea4aaa154c] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fea4bb80ee0] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 8: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 10: main() 2024-02-23T06:40:05.372 INFO:tasks.workunit.client.0.smithi142.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 12: __libc_start_main() 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 13: _start() 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:40:05.373 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:40:05.374 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:40:05.375 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:40:05.376 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:40:05.377 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:40:05.378 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe86bfff640 / http_manager 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe8f67fc640 / http_manager 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe8f77fe640 / rgw_dt_lg_renew 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe9177fe640 / ms_dispatch 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe9297fa640 / io_context_pool 2024-02-23T06:40:05.379 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe92b7fe640 / ms_dispatch 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe932604640 / ms_dispatch 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe933e07640 / io_context_pool 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea3d7a2640 / msgr-worker-2 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea45fa3640 / msgr-worker-1 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea467a4640 / msgr-worker-0 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea46fa5640 / io_context_pool 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea4a531800 / radosgw-admin 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/log/ceph/ceph-client.admin.91587.log 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:40:04.842+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.380 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:40:04.842+0000 7fea467a4640 10 monclient(hunting): handle_auth_done global_id 6330 payload 274 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:40:04.842+0000 7fea467a4640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:40:04.842+0000 7fea467a4640 1 monclient: found mon.noname-a 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:40:04.842+0000 7fea467a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: dump: 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.381 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:40:04.842+0000 7fe933e07640 10 monclient: dump: 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.382 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:40:04.842+0000 7fea4a531800 5 monclient: authenticate success, global_id 6330 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:40:04.842+0000 7fea4a531800 10 monclient: get_monmap_and_config success 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:40:04.842+0000 7fea4a531800 4 set_mon_vals no callback set 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:40:04.843+0000 7fea4a531800 10 monclient: shutdown 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 asok(0x562f8bac0620) unregister_commands rotate-key 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:40:04.843+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:40:04.843+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:40:04.843+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.383 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding auth protocol: cephx 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding auth protocol: cephx 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding auth protocol: cephx 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.384 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: crc 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:40:04.843+0000 7fea4a531800 5 AuthRegistry(0x562f8bcdfb50) adding con mode: secure 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:40:04.843+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:40:04.843+0000 7fea4a531800 1 librados: starting msgr at 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:40:04.843+0000 7fea4a531800 1 librados: starting objecter 2024-02-23T06:40:05.385 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command objecter_requests hook 0x562f8bce4210 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:40:04.844+0000 7fea4a531800 1 librados: setting wanted keys 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:40:04.844+0000 7fea4a531800 1 librados: calling monclient init 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding auth protocol: cephx 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding auth protocol: cephx 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding auth protocol: cephx 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.386 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: crc 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 AuthRegistry(0x562f8bcddd10) adding con mode: secure 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:40:04.844+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.387 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:40:04.844+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:40:04.844+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key hook 0x562f8bcdde58 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bb88840 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bb92cd0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bc22430 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:40:04.844+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.157292s 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bb92cd0 auth_method 0 2024-02-23T06:40:05.388 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bb88840 auth_method 0 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.389 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:40:04.844+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bc22430 auth_method 0 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:40:04.844+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_done global_id 6026 payload 824 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 1 monclient: found mon.noname-c 2024-02-23T06:40:05.390 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:40:04.844+0000 7fea3d7a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: dump: 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.391 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:40:04.845+0000 7fe932604640 10 monclient: dump: 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.392 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:40:04.845+0000 7fea4a531800 5 monclient: authenticate success, global_id 6026 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:40:04.845+0000 7fe933e07640 4 set_mon_vals no callback set 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.393 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:40:04.845+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:40:04.845+0000 7fea4a531800 1 librados: init done 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:40:04.846+0000 7fe932604640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:40:04.846+0000 7fe932604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:40:04.846+0000 7fe932604640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:40:04.847+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fe92c069eb0 auth_method 0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:40:04.847+0000 7fea467a4640 10 monclient: get_auth_request con 0x562f8bd26920 auth_method 0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:40:04.848+0000 7fea45fa3640 10 monclient: get_auth_request con 0x562f8bd29b00 auth_method 0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:40:04.849+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x562f8bd2eb90 auth_method 0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:40:04.849+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:40:04.849+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:40:04.849+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.394 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding auth protocol: cephx 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding auth protocol: cephx 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding auth protocol: cephx 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.395 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: crc 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:40:04.849+0000 7fea4a531800 5 AuthRegistry(0x562f8bd32850) adding con mode: secure 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:40:04.850+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command objecter_requests cmddesc objecter_requests hook 0x562f8bd36550 EEXIST 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding auth protocol: cephx 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding auth protocol: cephx 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding auth protocol: cephx 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.396 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: crc 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 AuthRegistry(0x562f8bd318d8) adding con mode: secure 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:40:04.850+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:40:04.850+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:40:04.850+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key cmddesc rotate-key hook 0x562f8bd31a20 EEXIST 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.397 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bd5cd80 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bd5d160 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bd6fb10 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:40:04.850+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.163558s 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bd5cd80 auth_method 0 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:40:04.850+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bd5d160 auth_method 0 2024-02-23T06:40:05.398 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:40:04.851+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bd6fb10 auth_method 0 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:40:04.851+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient(hunting): handle_auth_done global_id 6336 payload 824 2024-02-23T06:40:05.399 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:40:04.851+0000 7fea45fa3640 1 monclient: found mon.noname-a 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:40:04.851+0000 7fea45fa3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: dump: 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.400 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:40:04.851+0000 7fe92b7fe640 10 monclient: dump: 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.401 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:40:04.851+0000 7fea4a531800 5 monclient: authenticate success, global_id 6336 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:40:04.851+0000 7fea46fa5640 4 set_mon_vals no callback set 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:40:04.851+0000 7fea4a531800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:40:04.853+0000 7fe92b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:40:04.853+0000 7fe92b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:40:04.853+0000 7fe92b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:40:04.853+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fe920069df0 auth_method 0 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: get_monmap_and_config 2024-02-23T06:40:05.402 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:40:04.853+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding auth protocol: cephx 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding auth protocol: cephx 2024-02-23T06:40:05.403 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding auth protocol: cephx 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: crc 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a550) adding con mode: secure 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:40:04.853+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.404 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:40:04.853+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding auth protocol: cephx 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding auth protocol: cephx 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding auth protocol: cephx 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.405 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: crc 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:40:04.853+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d00c0) adding con mode: secure 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:40:04.854+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:40:04.854+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:40:04.854+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key cmddesc rotate-key hook 0x7fffd96d0208 EEXIST 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient: _add_conns ranks=[2,0,1] 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bdaef60 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bdaf340 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bda91d0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.406 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.166960s 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bdaef60 auth_method 0 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bdaf340 auth_method 0 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.407 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:40:04.854+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bda91d0 auth_method 0 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:40:04.854+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient(hunting): handle_auth_done global_id 6032 payload 274 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:40:04.854+0000 7fea45fa3640 1 monclient: found mon.noname-c 2024-02-23T06:40:05.408 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:40:04.854+0000 7fea45fa3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: dump: 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.409 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:40:04.854+0000 7fe9297fa640 10 monclient: dump: 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.410 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:40:04.854+0000 7fea4a531800 5 monclient: authenticate success, global_id 6032 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:40:04.854+0000 7fea4a531800 10 monclient: get_monmap_and_config success 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:40:04.854+0000 7fea4a531800 4 set_mon_vals no callback set 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: shutdown 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: build_initial_monmap 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 build_initial for_mkfs: 0 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: monmap: 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:05.411 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding auth protocol: cephx 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding auth protocol: cephx 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding auth protocol: cephx 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.412 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: crc 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd7a500) adding con mode: secure 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:40:04.855+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: starting msgr at 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: starting objecter 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command objecter_requests cmddesc objecter_requests hook 0x562f8bdab070 EEXIST 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: setting wanted keys 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:40:04.855+0000 7fea4a531800 1 librados: calling monclient init 2024-02-23T06:40:05.413 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:40:04.855+0000 7fea4a531800 10 monclient: init 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding auth protocol: cephx 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding auth protocol: cephx 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding auth protocol: cephx 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.414 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: crc 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:40:04.855+0000 7fea4a531800 5 AuthRegistry(0x562f8bd72720) adding con mode: secure 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:40:04.856+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:40:04.856+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:40:04.856+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command rotate-key cmddesc rotate-key hook 0x562f8bd72868 EEXIST 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient: _add_conns ranks=[2,1,0] 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-c con 0x562f8bda91d0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-b con 0x562f8bdaef60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): picked mon.noname-a con 0x562f8bdb0640 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:05.415 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:40:04.856+0000 7fea4a531800 10 monclient(hunting): authenticate will time out at 1556.169100s 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): get_auth_request con 0x562f8bda91d0 auth_method 0 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): get_auth_request con 0x562f8bdb0640 auth_method 0 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request con 0x562f8bdaef60 auth_method 0 2024-02-23T06:40:05.416 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:40:04.856+0000 7fea467a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:40:04.856+0000 7fea3d7a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient(hunting): handle_auth_done global_id 6035 payload 824 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient: _finish_hunting 0 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:40:04.856+0000 7fea45fa3640 1 monclient: found mon.noname-c 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:40:04.856+0000 7fea45fa3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:40:04.856+0000 7fe9177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.417 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:40:04.856+0000 7fe9177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:40:04.856+0000 7fe9177fe640 10 monclient: dump: 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: _finish_auth 0 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: _check_auth_tickets 2024-02-23T06:40:05.418 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:40:04.857+0000 7fe9177fe640 10 monclient: dump: 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.419 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:40:04.857+0000 7fea4a531800 5 monclient: authenticate success, global_id 6035 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:40:04.857+0000 7fe9297fa640 4 set_mon_vals no callback set 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _renew_subs 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:40:04.857+0000 7fea4a531800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:40:04.857+0000 7fea4a531800 1 librados: init done 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:40:04.857+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cr dump hook 0x562f8bdb44c8 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:40:04.858+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:40:04.858+0000 7fe9177fe640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:40:04.858+0000 7fe9177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:40:04.858+0000 7fe9177fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:40:04.858+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fe910069eb0 auth_method 0 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:40:04.859+0000 7fea467a4640 10 monclient: get_auth_request con 0x562f8bdcaf40 auth_method 0 2024-02-23T06:40:05.420 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 realm 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:40:04.859+0000 7fea4a531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:40:04.859+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:40:04.860+0000 7fea45fa3640 10 monclient: get_auth_request con 0x562f8bdcf2f0 auth_method 0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:40:04.860+0000 7fea4a531800 20 searching for the correct realm 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:40:04.861+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x562f8bdd3ca0 auth_method 0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:40:04.861+0000 7fea467a4640 10 monclient: get_auth_request con 0x7fea30008990 auth_method 0 2024-02-23T06:40:05.421 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:40:04.862+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fea40025040 auth_method 0 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:40:04.863+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fea38085060 auth_method 0 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:40:04.863+0000 7fea3d7a2640 0 -- 172.21.15.142:0/826301341 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fea38085060 msgr2=0x7fea38002070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:40:05.064+0000 7fea3d7a2640 10 monclient: get_auth_request con 0x7fea38085060 auth_method 0 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:40:05.066+0000 7fea467a4640 10 monclient: get_auth_request con 0x7fea300814f0 auth_method 0 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:40:05.069+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fea30055e40 auth_method 0 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:40:05.069+0000 7fea45fa3640 0 -- 172.21.15.142:0/826301341 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fea30055e40 msgr2=0x7fea30059560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:40:05.270+0000 7fea45fa3640 10 monclient: get_auth_request con 0x7fea30055e40 auth_method 0 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:05.422 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:40:05.275+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 zone default found 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:40:05.276+0000 7fea4a531800 4 Realm: () 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:40:05.276+0000 7fea4a531800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:40:05.276+0000 7fea4a531800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:40:05.276+0000 7fea4a531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 zonegroup default 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.423 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:40:05.276+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:40:05.277+0000 7fea4a531800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:40:05.277+0000 7fea4a531800 20 started sync module instance, tier type = 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:40:05.277+0000 7fea4a531800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=0 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=1 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=2 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=3 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=4 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=5 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:40:05.286+0000 7fea4a531800 20 add_watcher() i=6 2024-02-23T06:40:05.424 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:40:05.287+0000 7fea4a531800 20 add_watcher() i=7 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:40:05.287+0000 7fea4a531800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding auth protocol: cephx 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding auth protocol: cephx 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding auth protocol: cephx 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:40:05.288+0000 7fe8f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.425 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: crc 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:40:05.288+0000 7fea4a531800 5 AuthRegistry(0x7fffd96d0550) adding con mode: secure 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:40:05.289+0000 7fea4a531800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache list hook 0x562f8bdb0a60 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache inspect hook 0x562f8bdb0a60 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache erase hook 0x562f8bdb0a60 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command cache zap hook 0x562f8bdb0a60 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 note: GC not initialized 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:40:05.289+0000 7fe8f67fc640 20 reqs_thread_entry: start 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace show hook 0x7fea38073030 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace history hook 0x7fea38073030 2024-02-23T06:40:05.426 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace active hook 0x7fea38073030 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:40:05.289+0000 7fea4a531800 5 asok(0x562f8bac0620) register_command sync trace active_short hook 0x7fea38073030 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 Filter name: none 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:40:05.289+0000 7fe86bfff640 20 reqs_thread_entry: start 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:40:05.289+0000 7fea4a531800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:40:05.289+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 : miss 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:40:05.290+0000 7fea4a531800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:05.427 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:40:05.290+0000 7fea4a531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:40:05.295+0000 7fea4a531800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fea4a531800 time 2024-02-23T06:40:05.295333+0000 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fea4bb80e86] 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 4: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 6: main() 2024-02-23T06:40:05.428 INFO:tasks.workunit.client.0.smithi142.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 8: __libc_start_main() 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 9: _start() 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:40:05.296+0000 7fea4a531800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fea4a531800 thread_name:radosgw-admin 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fea4aa54db0] 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fea4aaa154c] 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fea4bb80ee0] 2024-02-23T06:40:05.429 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fea4bb81044] 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f89ed3c61] 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 8: radosgw-admin(+0x7cfc6a) [0x562f89edbc6a] 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x562f89ee047b] 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 10: main() 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fea4aa3feb0] 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 12: __libc_start_main() 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 13: _start() 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:40:05.430 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:40:05.431 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:40:05.432 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:40:05.433 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:40:05.434 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:40:05.435 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:40:05.436 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe86bfff640 / http_manager 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe8f67fc640 / http_manager 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe8f77fe640 / rgw_dt_lg_renew 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe9177fe640 / ms_dispatch 2024-02-23T06:40:05.437 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe9297fa640 / io_context_pool 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe92b7fe640 / ms_dispatch 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe932604640 / ms_dispatch 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fe933e07640 / io_context_pool 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea3d7a2640 / msgr-worker-2 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea45fa3640 / msgr-worker-1 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea467a4640 / msgr-worker-0 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea46fa5640 / io_context_pool 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: 7fea4a531800 / radosgw-admin 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/lib/ceph/crash/2024-02-23T06:40:05.296937Z_b792262c-a727-43a6-8d04-6e3c01e732c8/log 2024-02-23T06:40:05.438 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:40:05.439 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-02-23T06:40:05.440 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:05.440 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.367+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 realm 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.368+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.369+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.369+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.369+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.369+0000 7f3f0b320800 20 searching for the correct realm 2024-02-23T06:40:05.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.373+0000 7f3f075a4640 0 -- 172.21.15.142:0/2472632046 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f3ef0080550 msgr2=0x7f3ef00957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.579+0000 7f3f06da3640 0 -- 172.21.15.142:0/2472632046 >> [v2:172.21.15.152:6824/160508611,v1:172.21.15.152:6825/160508611] conn(0x5589ab8a10a0 msgr2=0x5589ab8a3490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.581+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:05.583 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 zone default found 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 4 Realm: () 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 zonegroup default 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.582+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.583+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.583+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.583+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.583+0000 7f3f0b320800 20 started sync module instance, tier type = 2024-02-23T06:40:05.584 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.583+0000 7f3f0b320800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:05.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=0 2024-02-23T06:40:05.591 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=1 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=2 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=3 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=4 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=5 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.591+0000 7f3f0b320800 20 add_watcher() i=6 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.592+0000 7f3f0b320800 20 add_watcher() i=7 2024-02-23T06:40:05.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.592+0000 7f3f0b320800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:05.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.593+0000 7f3dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3f0b320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3f0b320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3f0b320800 5 note: GC not initialized 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3d37fff640 20 reqs_thread_entry: start 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3f0b320800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3f0b320800 20 Filter name: none 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3d35ffb640 20 reqs_thread_entry: start 2024-02-23T06:40:05.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.594+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.595+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:05.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.595+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.595+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:05.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.595+0000 7f3f0b320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:05.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.595+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.596 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.596+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:05.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.596+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.596+0000 7f3f0b320800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:05.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.596+0000 7f3f0b320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:05.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.597+0000 7f3f0b320800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.597+0000 7f3f0b320800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.598+0000 7f3dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.600+0000 7f3f0b320800 20 remove_watcher() i=0 2024-02-23T06:40:05.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.600+0000 7f3f0b320800 2 removed watcher, disabling cache 2024-02-23T06:40:05.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.601+0000 7f3f0b320800 20 remove_watcher() i=1 2024-02-23T06:40:05.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.602+0000 7f3f0b320800 20 remove_watcher() i=2 2024-02-23T06:40:05.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.603+0000 7f3f0b320800 20 remove_watcher() i=3 2024-02-23T06:40:05.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.604+0000 7f3f0b320800 20 remove_watcher() i=4 2024-02-23T06:40:05.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.605+0000 7f3f0b320800 20 remove_watcher() i=5 2024-02-23T06:40:05.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.606+0000 7f3f0b320800 20 remove_watcher() i=6 2024-02-23T06:40:05.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.607+0000 7f3f0b320800 20 remove_watcher() i=7 2024-02-23T06:40:05.618 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.618 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:05.618 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:05.618 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:05.669 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:40:05.698 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:05.698 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:05.732 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.732+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.733 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 realm 2024-02-23T06:40:05.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:05.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.733+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.734+0000 7f25d1c24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.734+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.734+0000 7f25d1c24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:05.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.734+0000 7f25d1c24800 20 searching for the correct realm 2024-02-23T06:40:05.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.737+0000 7f25cfc4c640 0 -- 172.21.15.142:0/2356672658 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f25b80793f0 msgr2=0x7f25b80797f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.741+0000 7f25cf44b640 0 -- 172.21.15.142:0/2356672658 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f25b8078440 msgr2=0x7f25b80788c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.948 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.946+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 zone default found 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 4 Realm: () 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 zonegroup default 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.949 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.947+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.948+0000 7f25d1c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:05.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.948+0000 7f25d1c24800 20 started sync module instance, tier type = 2024-02-23T06:40:05.950 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.948+0000 7f25d1c24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.956+0000 7f25d1c24800 20 add_watcher() i=0 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=1 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=2 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=3 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=4 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=5 2024-02-23T06:40:05.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=6 2024-02-23T06:40:05.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 20 add_watcher() i=7 2024-02-23T06:40:05.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.957+0000 7f25d1c24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:05.959 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.959+0000 7f2485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.959+0000 7f25d1c24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.959+0000 7f25d1c24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f25d1c24800 5 note: GC not initialized 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f2484fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f25d1c24800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f25d1c24800 20 Filter name: none 2024-02-23T06:40:05.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f23fe7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f25d1c24800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.960+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 : miss 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:05.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.961+0000 7f25d1c24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 2024-02-23T06:40:05.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.962+0000 7f25d1c24800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to be held by another RGW process; skipping for now 2024-02-23T06:40:05.963 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.963+0000 7f2485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:05.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.965+0000 7f25d1c24800 20 remove_watcher() i=0 2024-02-23T06:40:05.965 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.965+0000 7f25d1c24800 2 removed watcher, disabling cache 2024-02-23T06:40:05.966 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.966+0000 7f25d1c24800 20 remove_watcher() i=1 2024-02-23T06:40:05.967 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.967+0000 7f25d1c24800 20 remove_watcher() i=2 2024-02-23T06:40:05.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.968+0000 7f25d1c24800 20 remove_watcher() i=3 2024-02-23T06:40:05.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.969+0000 7f25d1c24800 20 remove_watcher() i=4 2024-02-23T06:40:05.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.970+0000 7f25d1c24800 20 remove_watcher() i=5 2024-02-23T06:40:05.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.970+0000 7f25d1c24800 20 remove_watcher() i=6 2024-02-23T06:40:05.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:05.971+0000 7f25d1c24800 20 remove_watcher() i=7 2024-02-23T06:40:05.981 INFO:tasks.workunit.client.0.smithi142.stderr:waiting 30 seconds for reshard lock to expire... 2024-02-23T06:40:35.990 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:40:36.022 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:36.023 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:36.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.061+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.062+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.062+0000 7fdf91e44800 20 realm 2024-02-23T06:40:36.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.062+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.063+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.063+0000 7fdf91e44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:36.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.063+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.063+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.063+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.064+0000 7fdf91e44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:36.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.064+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.064+0000 7fdf91e44800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:36.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.064+0000 7fdf91e44800 20 searching for the correct realm 2024-02-23T06:40:36.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.068+0000 7fdf8ff44640 0 -- 172.21.15.142:0/2288200827 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fdf84057040 msgr2=0x7fdf840c3260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:36.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.071+0000 7fdf8f743640 0 -- 172.21.15.142:0/2288200827 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fdf84095fd0 msgr2=0x7fdf8409ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:36.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:36.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.278+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:36.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:36.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 zone default found 2024-02-23T06:40:36.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 4 Realm: () 2024-02-23T06:40:36.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.279+0000 7fdf91e44800 20 zonegroup default 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.280+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.280+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.280+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.280+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.280+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.281+0000 7fdf91e44800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.281+0000 7fdf91e44800 20 started sync module instance, tier type = 2024-02-23T06:40:36.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.281+0000 7fdf91e44800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:36.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=0 2024-02-23T06:40:36.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=1 2024-02-23T06:40:36.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=2 2024-02-23T06:40:36.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=3 2024-02-23T06:40:36.291 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=4 2024-02-23T06:40:36.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=5 2024-02-23T06:40:36.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.291+0000 7fdf91e44800 20 add_watcher() i=6 2024-02-23T06:40:36.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.292+0000 7fdf91e44800 20 add_watcher() i=7 2024-02-23T06:40:36.292 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.292+0000 7fdf91e44800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:36.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fde45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:36.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fdf91e44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:36.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fdf91e44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:36.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fdf91e44800 5 note: GC not initialized 2024-02-23T06:40:36.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fde44fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:36.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fdf91e44800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:36.297 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fdf91e44800 20 Filter name: none 2024-02-23T06:40:36.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fddbe7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:36.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.294+0000 7fdf91e44800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-02-23T06:40:36.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.295+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.295+0000 7fdf91e44800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:36.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.295+0000 7fdf91e44800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-02-23T06:40:36.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.295+0000 7fdf91e44800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-02-23T06:40:36.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.295+0000 7fdf91e44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 : miss 2024-02-23T06:40:36.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.295+0000 7fdf91e44800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.296+0000 7fdf91e44800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:36.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.296+0000 7fdf91e44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:36.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.296+0000 7fdf91e44800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:36.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.296+0000 7fdf91e44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:36.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.296+0000 7fdf91e44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:36.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.296+0000 7fdf91e44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21, ofs0, ns] 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fde727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693255 cookie 93923806327728 notifier 6086 bl.length()=887 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fde727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fde727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fde727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): orig_sources= new_sources= 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): potential sources added=[] removed=[] 2024-02-23T06:40:36.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): orig_dests= new_dests= 2024-02-23T06:40:36.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.301+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): potential dests added=[] removed=[] 2024-02-23T06:40:36.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.0 2024-02-23T06:40:36.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.0 2024-02-23T06:40:36.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.1 2024-02-23T06:40:36.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.1 2024-02-23T06:40:36.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.2 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.2 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.3 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.3 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.4 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.4 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.5 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.5 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.6 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.6 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.7 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.7 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.8 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.8 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.9 2024-02-23T06:40:36.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.9 2024-02-23T06:40:36.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.10 2024-02-23T06:40:36.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.10 2024-02-23T06:40:36.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.11 2024-02-23T06:40:36.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1.11 2024-02-23T06:40:36.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.0 2024-02-23T06:40:36.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.304+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.1 2024-02-23T06:40:36.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.305+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.2 2024-02-23T06:40:36.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.306+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.3 2024-02-23T06:40:36.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.306+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.4 2024-02-23T06:40:36.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.307+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.5 2024-02-23T06:40:36.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.307+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.6 2024-02-23T06:40:36.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.308+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.7 2024-02-23T06:40:36.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.308+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.8 2024-02-23T06:40:36.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.309+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.9 2024-02-23T06:40:36.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.309+0000 7fdf91e44800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21.10 2024-02-23T06:40:36.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.313+0000 7fdf91e44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 : hit (requested=0x17, cached=0x17) 2024-02-23T06:40:36.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.313+0000 7fdf91e44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 2024-02-23T06:40:36.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fdf91e44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:36.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fdf91e44800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fdf91e44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fdf91e44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21, ofs0, ns] 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fde727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693256 cookie 93923806327728 notifier 6086 bl.length()=855 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fde727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 info.flags=0x17 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fde727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 to cache LRU end 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.314+0000 7fde727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.315+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): orig_sources= new_sources= 2024-02-23T06:40:36.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.315+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): potential sources added=[] removed=[] 2024-02-23T06:40:36.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.315+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): orig_dests= new_dests= 2024-02-23T06:40:36.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.315+0000 7fdf91e44800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21]): potential dests added=[] removed=[] 2024-02-23T06:40:36.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.317+0000 7fdf91e44800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-02-23T06:40:36.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.319+0000 7fde45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:36.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.321+0000 7fdf91e44800 20 remove_watcher() i=0 2024-02-23T06:40:36.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.321+0000 7fdf91e44800 2 removed watcher, disabling cache 2024-02-23T06:40:36.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.323+0000 7fdf91e44800 20 remove_watcher() i=1 2024-02-23T06:40:36.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.324+0000 7fdf91e44800 20 remove_watcher() i=2 2024-02-23T06:40:36.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.325+0000 7fdf91e44800 20 remove_watcher() i=3 2024-02-23T06:40:36.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.326+0000 7fdf91e44800 20 remove_watcher() i=4 2024-02-23T06:40:36.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.327+0000 7fdf91e44800 20 remove_watcher() i=5 2024-02-23T06:40:36.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.328+0000 7fdf91e44800 20 remove_watcher() i=6 2024-02-23T06:40:36.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.329+0000 7fdf91e44800 20 remove_watcher() i=7 2024-02-23T06:40:36.341 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-02-23T06:40:36.369 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:36.369 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:36.402 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.402+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 realm 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.404+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.405+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:36.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.405+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.405+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:36.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.405+0000 7fef7c333800 20 searching for the correct realm 2024-02-23T06:40:36.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.409+0000 7fef775a2640 0 -- 172.21.15.142:0/17854782 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fef6805f9f0 msgr2=0x7fef68062170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:36.413 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.412+0000 7fef785a4640 0 -- 172.21.15.142:0/17854782 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7fef6c09af90 msgr2=0x7fef6c0a0db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:36.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:36.417 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:36.418 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.417+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:36.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 zone default found 2024-02-23T06:40:36.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 4 Realm: () 2024-02-23T06:40:36.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:36.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:36.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:36.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 zonegroup default 2024-02-23T06:40:36.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 started sync module instance, tier type = 2024-02-23T06:40:36.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.418+0000 7fef7c333800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=0 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=1 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=2 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=3 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=4 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=5 2024-02-23T06:40:36.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.427+0000 7fef7c333800 20 add_watcher() i=6 2024-02-23T06:40:36.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.428+0000 7fef7c333800 20 add_watcher() i=7 2024-02-23T06:40:36.429 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.428+0000 7fef7c333800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:36.430 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.429+0000 7fee2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fef7c333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fef7c333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fef7c333800 5 note: GC not initialized 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fee2cfe1640 20 reqs_thread_entry: start 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fef7c333800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fef7c333800 20 Filter name: none 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7feda67fc640 20 reqs_thread_entry: start 2024-02-23T06:40:36.431 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.430+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.431+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:36.432 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.431+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.431+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.431+0000 7fef7c333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.431+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.432+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=194 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.432+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.432+0000 7fef7c333800 20 rados_obj.operate() r=0 bl.length=378 2024-02-23T06:40:36.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.432+0000 7fef7c333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:36.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.433+0000 7fef7c333800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.436 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.433+0000 7fef7c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.434+0000 7fee2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:36.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.436+0000 7fef7c333800 20 remove_watcher() i=0 2024-02-23T06:40:36.437 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.436+0000 7fef7c333800 2 removed watcher, disabling cache 2024-02-23T06:40:36.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.437+0000 7fef7c333800 20 remove_watcher() i=1 2024-02-23T06:40:36.438 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.438+0000 7fef7c333800 20 remove_watcher() i=2 2024-02-23T06:40:36.439 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.439+0000 7fef7c333800 20 remove_watcher() i=3 2024-02-23T06:40:36.440 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.440+0000 7fef7c333800 20 remove_watcher() i=4 2024-02-23T06:40:36.441 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.441+0000 7fef7c333800 20 remove_watcher() i=5 2024-02-23T06:40:36.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.442+0000 7fef7c333800 20 remove_watcher() i=6 2024-02-23T06:40:36.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.442+0000 7fef7c333800 20 remove_watcher() i=7 2024-02-23T06:40:36.453 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:36.453 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:36.453 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-set-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:40:36.453 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:36.546 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-02-23T06:40:36.546 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:36.759 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-02-23T06:40:36.786 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:36.786 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:36.818 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.818+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.819+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.819+0000 7fb59762d800 20 realm 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.819+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.819+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.819+0000 7fb59762d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.819+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.820 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.820+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:36.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.820+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.820+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:36.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.820+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:36.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.821+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:36.821 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.821+0000 7fb59762d800 20 searching for the correct realm 2024-02-23T06:40:36.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.824+0000 7fb592da4640 0 -- 172.21.15.142:0/1600620282 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fb57c06e920 msgr2=0x7fb57c06d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:36.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:36.827+0000 7fb5925a3640 0 -- 172.21.15.142:0/1600620282 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb57c06dc40 msgr2=0x7fb57c0863f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.033+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 zone default found 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 4 Realm: () 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 zonegroup default 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.034+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.035+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.035+0000 7fb59762d800 20 started sync module instance, tier type = 2024-02-23T06:40:37.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.035+0000 7fb59762d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:37.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=0 2024-02-23T06:40:37.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=1 2024-02-23T06:40:37.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=2 2024-02-23T06:40:37.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=3 2024-02-23T06:40:37.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=4 2024-02-23T06:40:37.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=5 2024-02-23T06:40:37.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.044+0000 7fb59762d800 20 add_watcher() i=6 2024-02-23T06:40:37.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.045+0000 7fb59762d800 20 add_watcher() i=7 2024-02-23T06:40:37.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.045+0000 7fb59762d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:37.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.046+0000 7fb448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb59762d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:37.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb59762d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:37.050 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb59762d800 5 note: GC not initialized 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb3c37fe640 20 reqs_thread_entry: start 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb59762d800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb59762d800 20 Filter name: none 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb3c17fa640 20 reqs_thread_entry: start 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.047+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.048+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.048+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.051 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.049+0000 7fb59762d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:37.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.050+0000 7fb59762d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.051+0000 7fb59762d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.051+0000 7fb448fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.053+0000 7fb59762d800 20 remove_watcher() i=0 2024-02-23T06:40:37.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.053+0000 7fb59762d800 2 removed watcher, disabling cache 2024-02-23T06:40:37.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.054+0000 7fb59762d800 20 remove_watcher() i=1 2024-02-23T06:40:37.056 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.055+0000 7fb59762d800 20 remove_watcher() i=2 2024-02-23T06:40:37.057 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.056+0000 7fb59762d800 20 remove_watcher() i=3 2024-02-23T06:40:37.058 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.057+0000 7fb59762d800 20 remove_watcher() i=4 2024-02-23T06:40:37.059 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.058+0000 7fb59762d800 20 remove_watcher() i=5 2024-02-23T06:40:37.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.060+0000 7fb59762d800 20 remove_watcher() i=6 2024-02-23T06:40:37.061 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.061+0000 7fb59762d800 20 remove_watcher() i=7 2024-02-23T06:40:37.071 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:37.071 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:37.071 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-block-writes id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:37.072 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:37.072 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-02-23T06:40:37.105 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:37.105 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:37.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.139+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.141 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 realm 2024-02-23T06:40:37.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:37.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.140+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.141+0000 7fba15daf800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.141+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.141+0000 7fba15daf800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:37.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.141+0000 7fba15daf800 20 searching for the correct realm 2024-02-23T06:40:37.144 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.144+0000 7fba13e4c640 0 -- 172.21.15.142:0/2631496239 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fb9fc086060 msgr2=0x7fb9fc04f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.148+0000 7fba1364b640 0 -- 172.21.15.142:0/2631496239 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb9fc0a8de0 msgr2=0x7fb9fc0d0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:37.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:37.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:37.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 zone default found 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 4 Realm: () 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:37.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 zonegroup default 2024-02-23T06:40:37.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.152+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 started sync module instance, tier type = 2024-02-23T06:40:37.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.153+0000 7fba15daf800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=0 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=1 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=2 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=3 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=4 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=5 2024-02-23T06:40:37.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.161+0000 7fba15daf800 20 add_watcher() i=6 2024-02-23T06:40:37.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.162+0000 7fba15daf800 20 add_watcher() i=7 2024-02-23T06:40:37.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.162+0000 7fba15daf800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:37.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fb8c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fba15daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:37.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fba15daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fba15daf800 5 note: GC not initialized 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fb8c8fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fba15daf800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fba15daf800 20 Filter name: none 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.164+0000 7fb8427fc640 20 reqs_thread_entry: start 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 : miss 2024-02-23T06:40:37.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:37.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.165+0000 7fba15daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 2024-02-23T06:40:37.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.170+0000 7fba15daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.170+0000 7fba15daf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.170+0000 7fba15daf800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.170+0000 7fba15daf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22, ofs0, ns] 2024-02-23T06:40:37.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fb8f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 94519355322256 notifier 6450 bl.length()=877 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fb8f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fb8f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fb8f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_sources= new_sources= 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential sources added=[] removed=[] 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_dests= new_dests= 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential dests added=[] removed=[] 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fba15daf800 -1 Injecting error=-5 at location=block_writes 2024-02-23T06:40:37.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.171+0000 7fba15daf800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-02-23T06:40:37.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.173+0000 7fba15daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 : hit (requested=0x17, cached=0x17) 2024-02-23T06:40:37.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.173+0000 7fba15daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fba15daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fba15daf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fba15daf800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fba15daf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22, ofs0, ns] 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fb8f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693201 cookie 94519355322256 notifier 6450 bl.length()=845 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fb8f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fb8f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.174+0000 7fb8f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.175+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_sources= new_sources= 2024-02-23T06:40:37.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.175+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential sources added=[] removed=[] 2024-02-23T06:40:37.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.175+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_dests= new_dests= 2024-02-23T06:40:37.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.175+0000 7fba15daf800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential dests added=[] removed=[] 2024-02-23T06:40:37.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.176+0000 7fb8c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.179 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.178+0000 7fba15daf800 20 remove_watcher() i=0 2024-02-23T06:40:37.179 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.178+0000 7fba15daf800 2 removed watcher, disabling cache 2024-02-23T06:40:37.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.180+0000 7fba15daf800 20 remove_watcher() i=1 2024-02-23T06:40:37.181 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.181+0000 7fba15daf800 20 remove_watcher() i=2 2024-02-23T06:40:37.182 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.182+0000 7fba15daf800 20 remove_watcher() i=3 2024-02-23T06:40:37.183 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.183+0000 7fba15daf800 20 remove_watcher() i=4 2024-02-23T06:40:37.184 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.184+0000 7fba15daf800 20 remove_watcher() i=5 2024-02-23T06:40:37.185 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.185+0000 7fba15daf800 20 remove_watcher() i=6 2024-02-23T06:40:37.186 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.186+0000 7fba15daf800 20 remove_watcher() i=7 2024-02-23T06:40:37.198 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-02-23T06:40:37.225 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:37.225 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:37.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.257+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 realm 2024-02-23T06:40:37.260 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:37.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.259+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.260+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.260+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.261+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:37.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.261+0000 7f5e2672d800 20 searching for the correct realm 2024-02-23T06:40:37.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.264+0000 7f5e22950640 0 -- 172.21.15.142:0/2789815327 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f5e0c089070 msgr2=0x7f5e0c04b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.267+0000 7f5e2214f640 0 -- 172.21.15.142:0/2789815327 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f5e0c0cb310 msgr2=0x7f5e0c053980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:37.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.472+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:37.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 zone default found 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 4 Realm: () 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 zonegroup default 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.473+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.474+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.474+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.475+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.475+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.475+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.475+0000 7f5e2672d800 20 started sync module instance, tier type = 2024-02-23T06:40:37.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.475+0000 7f5e2672d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:37.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=0 2024-02-23T06:40:37.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=1 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=2 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=3 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=4 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=5 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.484+0000 7f5e2672d800 20 add_watcher() i=6 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.485+0000 7f5e2672d800 20 add_watcher() i=7 2024-02-23T06:40:37.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.485+0000 7f5e2672d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:37.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.486+0000 7f5cd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.486+0000 7f5e2672d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.486+0000 7f5e2672d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5e2672d800 5 note: GC not initialized 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5c537fe640 20 reqs_thread_entry: start 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5e2672d800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5e2672d800 20 Filter name: none 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5c517fa640 20 reqs_thread_entry: start 2024-02-23T06:40:37.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.487+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.488+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.488+0000 7f5e2672d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:37.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.488+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.488+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.488+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.489+0000 7f5e2672d800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.489+0000 7f5e2672d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:37.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.490+0000 7f5e2672d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.490+0000 7f5e2672d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.491+0000 7f5cd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.493+0000 7f5e2672d800 20 remove_watcher() i=0 2024-02-23T06:40:37.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.493+0000 7f5e2672d800 2 removed watcher, disabling cache 2024-02-23T06:40:37.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.494+0000 7f5e2672d800 20 remove_watcher() i=1 2024-02-23T06:40:37.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.495+0000 7f5e2672d800 20 remove_watcher() i=2 2024-02-23T06:40:37.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.496+0000 7f5e2672d800 20 remove_watcher() i=3 2024-02-23T06:40:37.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.497+0000 7f5e2672d800 20 remove_watcher() i=4 2024-02-23T06:40:37.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.498+0000 7f5e2672d800 20 remove_watcher() i=5 2024-02-23T06:40:37.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.499+0000 7f5e2672d800 20 remove_watcher() i=6 2024-02-23T06:40:37.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.499+0000 7f5e2672d800 20 remove_watcher() i=7 2024-02-23T06:40:37.509 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:37.509 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:37.510 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-block-writes id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:37.510 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:37.561 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:40:37.591 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:37.591 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:37.624 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.624+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.625+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.625+0000 7fdf4782e800 20 realm 2024-02-23T06:40:37.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.625+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.626 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.625+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.625+0000 7fdf4782e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:37.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.625+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.626+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.627 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.626+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.626+0000 7fdf4782e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.626+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.627+0000 7fdf4782e800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:37.628 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.627+0000 7fdf4782e800 20 searching for the correct realm 2024-02-23T06:40:37.630 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.630+0000 7fdf3a04a640 0 -- 172.21.15.142:0/3288048006 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fdf34042060 msgr2=0x7fdf34061420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:37.634 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.634+0000 7fdf3a04a640 0 -- 172.21.15.142:0/3288048006 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fde0c07a5e0 msgr2=0x7fde0c07ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.638 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:37.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:37.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:37.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:37.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:37.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:37.639 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.637+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.640 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:37.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 zone default found 2024-02-23T06:40:37.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 4 Realm: () 2024-02-23T06:40:37.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:37.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:37.642 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:37.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 zonegroup default 2024-02-23T06:40:37.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.638+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.643 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 started sync module instance, tier type = 2024-02-23T06:40:37.644 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.639+0000 7fdf4782e800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:37.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=0 2024-02-23T06:40:37.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=1 2024-02-23T06:40:37.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=2 2024-02-23T06:40:37.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=3 2024-02-23T06:40:37.648 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=4 2024-02-23T06:40:37.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=5 2024-02-23T06:40:37.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.648+0000 7fdf4782e800 20 add_watcher() i=6 2024-02-23T06:40:37.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.649+0000 7fdf4782e800 20 add_watcher() i=7 2024-02-23T06:40:37.649 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.649+0000 7fdf4782e800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:37.651 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.650+0000 7fddf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 5 note: GC not initialized 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdd73fff640 20 reqs_thread_entry: start 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 20 Filter name: none 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdd71ffb640 20 reqs_thread_entry: start 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-02-23T06:40:37.652 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.651+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-02-23T06:40:37.653 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 : miss 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.652+0000 7fdf4782e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 2024-02-23T06:40:37.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.656+0000 7fdf4782e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22, ofs0, ns] 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fde267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693202 cookie 94856781584256 notifier 6483 bl.length()=877 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fde267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fde267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fde267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_sources= new_sources= 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential sources added=[] removed=[] 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_dests= new_dests= 2024-02-23T06:40:37.658 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.657+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential dests added=[] removed=[] 2024-02-23T06:40:37.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.0 2024-02-23T06:40:37.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.0 2024-02-23T06:40:37.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.1 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.1 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.2 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.2 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.3 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.3 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.4 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.4 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.5 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.5 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.6 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.6 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.7 2024-02-23T06:40:37.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.7 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.8 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.659+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.8 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.9 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.9 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.10 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.10 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.11 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1.11 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.0 2024-02-23T06:40:37.665 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.1 2024-02-23T06:40:37.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.660+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.2 2024-02-23T06:40:37.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.661+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.3 2024-02-23T06:40:37.666 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.661+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.4 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.662+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.5 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.662+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.6 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.662+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.7 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.663+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.8 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.663+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.9 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.664+0000 7fdf4782e800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22.10 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.667+0000 7fdf4782e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 : hit (requested=0x17, cached=0x17) 2024-02-23T06:40:37.667 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.667+0000 7fdf4782e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 2024-02-23T06:40:37.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fdf4782e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.669 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fdf4782e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fdf4782e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fdf4782e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22, ofs0, ns] 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fde267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693203 cookie 94856781584256 notifier 6483 bl.length()=845 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fde267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 info.flags=0x17 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fde267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 to cache LRU end 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.669+0000 7fde267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.670+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_sources= new_sources= 2024-02-23T06:40:37.670 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.670+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential sources added=[] removed=[] 2024-02-23T06:40:37.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.670+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): orig_dests= new_dests= 2024-02-23T06:40:37.671 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.670+0000 7fdf4782e800 20 handle_bi_update(): bucket=:error-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22]): potential dests added=[] removed=[] 2024-02-23T06:40:37.672 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.672+0000 7fdf4782e800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-02-23T06:40:37.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.676+0000 7fddf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.677+0000 7fdf4782e800 20 remove_watcher() i=0 2024-02-23T06:40:37.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.677+0000 7fdf4782e800 2 removed watcher, disabling cache 2024-02-23T06:40:37.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.678+0000 7fdf4782e800 20 remove_watcher() i=1 2024-02-23T06:40:37.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.679+0000 7fdf4782e800 20 remove_watcher() i=2 2024-02-23T06:40:37.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.680+0000 7fdf4782e800 20 remove_watcher() i=3 2024-02-23T06:40:37.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.681+0000 7fdf4782e800 20 remove_watcher() i=4 2024-02-23T06:40:37.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.682+0000 7fdf4782e800 20 remove_watcher() i=5 2024-02-23T06:40:37.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.683+0000 7fdf4782e800 20 remove_watcher() i=6 2024-02-23T06:40:37.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.684+0000 7fdf4782e800 20 remove_watcher() i=7 2024-02-23T06:40:37.695 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-02-23T06:40:37.722 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:37.722 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:37.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.755+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.756+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.756+0000 7f5665430800 20 realm 2024-02-23T06:40:37.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.757+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.757+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.757+0000 7f5665430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:37.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.757+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.757+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.757+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.758+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.758+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.758+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:37.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.758+0000 7f5665430800 20 searching for the correct realm 2024-02-23T06:40:37.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.761+0000 7f5660c4c640 0 -- 172.21.15.142:0/3842114121 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f564803c040 msgr2=0x7f5648026910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.764+0000 7f566044b640 0 -- 172.21.15.142:0/3842114121 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f564805a410 msgr2=0x7f564805a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.769 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 zone default found 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 4 Realm: () 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 zonegroup default 2024-02-23T06:40:37.771 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.769+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 started sync module instance, tier type = 2024-02-23T06:40:37.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.770+0000 7f5665430800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:37.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=0 2024-02-23T06:40:37.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=1 2024-02-23T06:40:37.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=2 2024-02-23T06:40:37.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=3 2024-02-23T06:40:37.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=4 2024-02-23T06:40:37.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=5 2024-02-23T06:40:37.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.779+0000 7f5665430800 20 add_watcher() i=6 2024-02-23T06:40:37.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.780+0000 7f5665430800 20 add_watcher() i=7 2024-02-23T06:40:37.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.780+0000 7f5665430800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:37.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.781+0000 7f5516fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.781+0000 7f5665430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:37.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.781+0000 7f5665430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:37.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.781+0000 7f5665430800 5 note: GC not initialized 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f5515fdb640 20 reqs_thread_entry: start 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f5665430800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f5665430800 20 Filter name: none 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f54877fe640 20 reqs_thread_entry: start 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.782+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.783+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.783+0000 7f5665430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:37.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.783+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.783+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:37.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.783+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.784+0000 7f5665430800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:37.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.784+0000 7f5665430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:37.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.784+0000 7f5665430800 20 rados->read ofs=0 len=0 2024-02-23T06:40:37.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.785+0000 7f5665430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:37.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.785+0000 7f5516fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:37.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.787+0000 7f5665430800 20 remove_watcher() i=0 2024-02-23T06:40:37.788 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.787+0000 7f5665430800 2 removed watcher, disabling cache 2024-02-23T06:40:37.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.788+0000 7f5665430800 20 remove_watcher() i=1 2024-02-23T06:40:37.790 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.789+0000 7f5665430800 20 remove_watcher() i=2 2024-02-23T06:40:37.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.790+0000 7f5665430800 20 remove_watcher() i=3 2024-02-23T06:40:37.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.791+0000 7f5665430800 20 remove_watcher() i=4 2024-02-23T06:40:37.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.792+0000 7f5665430800 20 remove_watcher() i=5 2024-02-23T06:40:37.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.793+0000 7f5665430800 20 remove_watcher() i=6 2024-02-23T06:40:37.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:37.794+0000 7f5665430800 20 remove_watcher() i=7 2024-02-23T06:40:37.805 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:37.805 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:37.805 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-block-writes id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:40:37.805 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:37.901 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with abort at block_writes 2024-02-23T06:40:37.901 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.110 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-02-23T06:40:38.136 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:38.136 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:38.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.170+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 realm 2024-02-23T06:40:38.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:38.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.171+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.172+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:38.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.172+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.172+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:38.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.172+0000 7f33a3a2d800 20 searching for the correct realm 2024-02-23T06:40:38.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.174+0000 7f339ea4b640 0 -- 172.21.15.142:0/3961209072 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f3390075060 msgr2=0x7f339009b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:40:38.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.379+0000 7f339f24c640 0 -- 172.21.15.142:0/3961209072 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f3388044020 msgr2=0x7f338803a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:38.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.384+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 zone default found 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 4 Realm: () 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 zonegroup default 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.385+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.386+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.386+0000 7f33a3a2d800 20 started sync module instance, tier type = 2024-02-23T06:40:38.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.386+0000 7f33a3a2d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=0 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=1 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=2 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=3 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=4 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=5 2024-02-23T06:40:38.395 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.394+0000 7f33a3a2d800 20 add_watcher() i=6 2024-02-23T06:40:38.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.395+0000 7f33a3a2d800 20 add_watcher() i=7 2024-02-23T06:40:38.396 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.395+0000 7f33a3a2d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f32557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f33a3a2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f33a3a2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f33a3a2d800 5 note: GC not initialized 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f31cffff640 20 reqs_thread_entry: start 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f33a3a2d800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f33a3a2d800 20 Filter name: none 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.397+0000 7f31cdffb640 20 reqs_thread_entry: start 2024-02-23T06:40:38.398 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.398+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.399 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.398+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.398+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.400 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:38.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.399+0000 7f33a3a2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:38.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.400+0000 7f33a3a2d800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.400+0000 7f33a3a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.401 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.401+0000 7f32557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:38.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.403+0000 7f33a3a2d800 20 remove_watcher() i=0 2024-02-23T06:40:38.403 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.403+0000 7f33a3a2d800 2 removed watcher, disabling cache 2024-02-23T06:40:38.404 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.404+0000 7f33a3a2d800 20 remove_watcher() i=1 2024-02-23T06:40:38.405 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.405+0000 7f33a3a2d800 20 remove_watcher() i=2 2024-02-23T06:40:38.406 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.406+0000 7f33a3a2d800 20 remove_watcher() i=3 2024-02-23T06:40:38.407 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.407+0000 7f33a3a2d800 20 remove_watcher() i=4 2024-02-23T06:40:38.408 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.408+0000 7f33a3a2d800 20 remove_watcher() i=5 2024-02-23T06:40:38.409 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.409+0000 7f33a3a2d800 20 remove_watcher() i=6 2024-02-23T06:40:38.410 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.410+0000 7f33a3a2d800 20 remove_watcher() i=7 2024-02-23T06:40:38.419 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.420 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:38.420 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-block-writes id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:38.420 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.421 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-02-23T06:40:38.454 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:38.454 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.689+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 realm 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:38.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:38.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.691+0000 7fa455e24800 20 searching for the correct realm 2024-02-23T06:40:38.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.693+0000 7fa45364b640 0 -- 172.21.15.142:0/589834851 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7fa44c00e040 msgr2=0x7fa44c010440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:38.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.898+0000 7fa453e4c640 0 -- 172.21.15.142:0/589834851 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fa4480a1040 msgr2=0x7fa4480a0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:38.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:38.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:38.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:38.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:38.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:38.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:38.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 zone default found 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 4 Realm: () 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:38.907 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 zonegroup default 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 started sync module instance, tier type = 2024-02-23T06:40:38.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.905+0000 7fa455e24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:38.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=0 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=1 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=2 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=3 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=4 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=5 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=6 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.915+0000 7fa455e24800 20 add_watcher() i=7 2024-02-23T06:40:38.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.915+0000 7fa455e24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:38.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:38.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa455e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:38.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa455e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:38.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa455e24800 5 note: GC not initialized 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa308fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa455e24800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.917+0000 7fa455e24800 20 Filter name: none 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa2827fc640 20 reqs_thread_entry: start 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 : miss 2024-02-23T06:40:38.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.919+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:38.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.919+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:38.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.919+0000 7fa455e24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:38.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.919+0000 7fa455e24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:38.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.919+0000 7fa455e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:38.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.919+0000 7fa455e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 2024-02-23T06:40:38.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:38.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:38.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:38.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23, ofs0, ns] 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 93905421787872 notifier 6537 bl.length()=877 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_sources= new_sources= 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential sources added=[] removed=[] 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_dests= new_dests= 2024-02-23T06:40:38.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential dests added=[] removed=[] 2024-02-23T06:40:38.926 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa455e24800 time 2024-02-23T06:40:38.925828+0000 2024-02-23T06:40:38.926 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:38.943 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:38.943 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa459180e86] 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.925+0000 7fa455e24800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa455e24800 time 2024-02-23T06:40:38.925828+0000 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa459180e86] 2024-02-23T06:40:38.944 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr:*** Caught signal (Aborted) ** 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fa455e24800 thread_name:radosgw-admin 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa458054db0] 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa4580a154c] 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:38.945 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa459180ee0] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.926+0000 7fa455e24800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fa455e24800 thread_name:radosgw-admin 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa458054db0] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa4580a154c] 2024-02-23T06:40:38.946 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa459180ee0] 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:40:38.674+0000 7fa455e24800 10 monclient: shutdown 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 asok(0x55680f1d5620) unregister_commands rotate-key 2024-02-23T06:40:38.947 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:40:38.674+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:40:38.674+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:40:38.674+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding auth protocol: cephx 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding auth protocol: cephx 2024-02-23T06:40:38.948 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding auth protocol: cephx 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:40:38.674+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.949 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:40:38.674+0000 7fa455e24800 1 librados: starting msgr at 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:40:38.675+0000 7fa455e24800 1 librados: starting objecter 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command objecter_requests hook 0x55680f3f44e0 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:40:38.675+0000 7fa455e24800 1 librados: setting wanted keys 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:40:38.675+0000 7fa455e24800 1 librados: calling monclient init 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding auth protocol: cephx 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding auth protocol: cephx 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding auth protocol: cephx 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:38.950 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:40:38.675+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:40:38.675+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key hook 0x55680f3f2ef8 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient: _add_conns ranks=[2,0,1] 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f3f89e0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f428350 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x7fa43c005d80 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.951 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1589.988333s 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f3f89e0 auth_method 0 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f428350 auth_method 0 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.952 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x7fa43c005d80 auth_method 0 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6215 payload 824 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:40:38.675+0000 7fa45364b640 1 monclient: found mon.noname-c 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: dump: 2024-02-23T06:40:38.953 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: _finish_auth 0 2024-02-23T06:40:38.954 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: _check_auth_tickets 2024-02-23T06:40:38.955 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: dump: 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.956 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:40:38.676+0000 7fa34160a640 4 set_mon_vals no callback set 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:40:38.676+0000 7fa455e24800 5 monclient: authenticate success, global_id 6215 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:40:38.676+0000 7fa455e24800 1 librados: init done 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:40:38.677+0000 7fa33fe07640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:40:38.677+0000 7fa33fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:40:38.677+0000 7fa33fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:40:38.678+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa338069eb0 auth_method 0 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:40:38.678+0000 7fa453e4c640 10 monclient: get_auth_request con 0x55680f43be10 auth_method 0 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:40:38.679+0000 7fa45364b640 10 monclient: get_auth_request con 0x55680f43eff0 auth_method 0 2024-02-23T06:40:38.957 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:40:38.680+0000 7fa452e4a640 10 monclient: get_auth_request con 0x55680f443bf0 auth_method 0 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:40:38.681+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:40:38.681+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:40:38.681+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding auth protocol: cephx 2024-02-23T06:40:38.958 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding auth protocol: cephx 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding auth protocol: cephx 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:40:38.681+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.959 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command objecter_requests cmddesc objecter_requests hook 0x55680f44d4a0 EEXIST 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:40:38.681+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding auth protocol: cephx 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding auth protocol: cephx 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding auth protocol: cephx 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:38.960 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:40:38.681+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:40:38.682+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:40:38.682+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key cmddesc rotate-key hook 0x55680f446d90 EEXIST 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f472200 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f4725e0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x55680f484f30 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.961 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1589.994766s 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f4725e0 auth_method 0 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f472200 auth_method 0 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x55680f484f30 auth_method 0 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.962 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6531 payload 824 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:40:38.682+0000 7fa45364b640 1 monclient: found mon.noname-a 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.963 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: dump: 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: _finish_auth 0 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: _check_auth_tickets 2024-02-23T06:40:38.964 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: dump: 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:40:38.682+0000 7fa455e24800 5 monclient: authenticate success, global_id 6531 2024-02-23T06:40:38.965 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:40:38.682+0000 7fa45464d640 4 set_mon_vals no callback set 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:40:38.684+0000 7fa33d602640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:40:38.684+0000 7fa33d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:40:38.684+0000 7fa33d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:40:38.684+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa32c069dc0 auth_method 0 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: get_monmap_and_config 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:40:38.684+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:38.966 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding auth protocol: cephx 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding auth protocol: cephx 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding auth protocol: cephx 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:38.967 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:40:38.684+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:38.968 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding auth protocol: cephx 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding auth protocol: cephx 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding auth protocol: cephx 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:38.969 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:40:38.685+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:40:38.685+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:40:38.685+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key cmddesc rotate-key hook 0x7ffd857791b8 EEXIST 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient: _add_conns ranks=[0,1,2] 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f4c4530 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x55680f4c4910 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:38.970 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f4bece0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1589.998058s 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f4c4530 auth_method 0 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x55680f4bece0 auth_method 0 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.971 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f4c4910 auth_method 0 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6534 payload 274 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:40:38.685+0000 7fa45364b640 1 monclient: found mon.noname-a 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.972 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: dump: 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: _finish_auth 0 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: _check_auth_tickets 2024-02-23T06:40:38.973 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: dump: 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:40:38.685+0000 7fa455e24800 5 monclient: authenticate success, global_id 6534 2024-02-23T06:40:38.974 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient: get_monmap_and_config success 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:40:38.685+0000 7fa455e24800 4 set_mon_vals no callback set 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:40:38.686+0000 7fa455e24800 10 monclient: shutdown 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:40:38.686+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:40:38.686+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:40:38.686+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.975 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding auth protocol: cephx 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding auth protocol: cephx 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding auth protocol: cephx 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:38.976 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:40:38.686+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:40:38.686+0000 7fa455e24800 1 librados: starting msgr at 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:40:38.686+0000 7fa455e24800 1 librados: starting objecter 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command objecter_requests cmddesc objecter_requests hook 0x55680f471d90 EEXIST 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:40:38.687+0000 7fa455e24800 1 librados: setting wanted keys 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:40:38.687+0000 7fa455e24800 1 librados: calling monclient init 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding auth protocol: cephx 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding auth protocol: cephx 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding auth protocol: cephx 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:38.977 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:40:38.687+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:40:38.687+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key cmddesc rotate-key hook 0x55680f487f58 EEXIST 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f4bece0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f4c4530 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:38.978 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x55680f4cf120 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1590.000220s 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f4bece0 auth_method 0 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f4c4530 auth_method 0 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.979 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x55680f4cf120 auth_method 0 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6537 payload 824 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:40:38.687+0000 7fa45364b640 1 monclient: found mon.noname-a 2024-02-23T06:40:38.980 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: dump: 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: _finish_auth 0 2024-02-23T06:40:38.981 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: _check_auth_tickets 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: dump: 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:38.982 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:40:38.688+0000 7fa455e24800 5 monclient: authenticate success, global_id 6537 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:40:38.688+0000 7fa336ffd640 4 set_mon_vals no callback set 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:40:38.688+0000 7fa455e24800 1 librados: init done 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:40:38.688+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cr dump hook 0x55680f4bd028 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:40:38.689+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:40:38.689+0000 7fa3357fa640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:40:38.689+0000 7fa3357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:40:38.689+0000 7fa3357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:40:38.689+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa31c069eb0 auth_method 0 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:40:38.690+0000 7fa453e4c640 10 monclient: get_auth_request con 0x55680f4de940 auth_method 0 2024-02-23T06:40:38.983 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 realm 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:40:38.690+0000 7fa455e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:40:38.691+0000 7fa45364b640 10 monclient: get_auth_request con 0x55680f4e2c80 auth_method 0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 searching for the correct realm 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:40:38.692+0000 7fa452e4a640 10 monclient: get_auth_request con 0x55680f4e7d70 auth_method 0 2024-02-23T06:40:38.984 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:40:38.692+0000 7fa3357fa640 1 client.6537.objecter ms_handle_reset 0x55680f4e7d70 session 0x55680f4e76f0 osd.3 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:40:38.692+0000 7fa3357fa640 10 monclient: _renew_subs 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:40:38.692+0000 7fa3357fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:40:38.692+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa31c07a5e0 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:40:38.693+0000 7fa453e4c640 10 monclient: get_auth_request con 0x7fa4480a1040 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:40:38.693+0000 7fa45364b640 0 -- 172.21.15.142:0/589834851 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7fa44c00e040 msgr2=0x7fa44c010440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:40:38.693+0000 7fa45364b640 10 monclient: get_auth_request con 0x7fa44c00e040 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:40:38.894+0000 7fa45364b640 10 monclient: get_auth_request con 0x7fa44c00e040 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:40:38.895+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa44401d060 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:40:38.897+0000 7fa453e4c640 10 monclient: get_auth_request con 0x7fa4480b2920 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:40:38.898+0000 7fa453e4c640 0 -- 172.21.15.142:0/589834851 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fa4480a1040 msgr2=0x7fa4480a0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:40:38.898+0000 7fa3357fa640 1 client.6537.objecter ms_handle_reset 0x7fa4480a1040 session 0x7fa44808c070 osd.7 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:40:38.898+0000 7fa453e4c640 10 monclient: get_auth_request con 0x55680f4e7d70 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:40:38.899+0000 7fa45364b640 10 monclient: get_auth_request con 0x7fa448064950 auth_method 0 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:38.985 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 zone default found 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:40:38.905+0000 7fa455e24800 4 Realm: () 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:40:38.905+0000 7fa455e24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:40:38.905+0000 7fa455e24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:38.986 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:40:38.905+0000 7fa455e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 zonegroup default 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 started sync module instance, tier type = 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=0 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=1 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=2 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=3 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=4 2024-02-23T06:40:38.987 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=5 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=6 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:40:38.915+0000 7fa455e24800 20 add_watcher() i=7 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:40:38.915+0000 7fa455e24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding auth protocol: cephx 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding auth protocol: cephx 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding auth protocol: cephx 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:40:38.917+0000 7fa309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:38.988 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:40:38.917+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache list hook 0x55680f4b9e70 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache inspect hook 0x55680f4b9e70 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache erase hook 0x55680f4b9e70 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache zap hook 0x55680f4b9e70 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 note: GC not initialized 2024-02-23T06:40:38.989 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:40:38.917+0000 7fa308fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace show hook 0x7fa44406e070 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace history hook 0x7fa44406e070 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace active hook 0x7fa44406e070 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace active_short hook 0x7fa44406e070 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 Filter name: none 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:40:38.918+0000 7fa2827fc640 20 reqs_thread_entry: start 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 : miss 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:38.990 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:40:38.919+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23, ofs0, ns] 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 93905421787872 notifier 6537 bl.length()=877 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_sources= new_sources= 2024-02-23T06:40:38.991 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential sources added=[] removed=[] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_dests= new_dests= 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential dests added=[] removed=[] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:40:38.925+0000 7fa455e24800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa455e24800 time 2024-02-23T06:40:38.925828+0000 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa459180e86] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:40:38.992 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:40:38.926+0000 7fa455e24800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fa455e24800 thread_name:radosgw-admin 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa458054db0] 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa4580a154c] 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa459180ee0] 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:38.993 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:40:38.994 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:40:38.995 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:40:38.996 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:40:38.997 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:40:38.998 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:40:38.999 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa2827fc640 / http_manager 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa308fe1640 / http_manager 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa309fe3640 / rgw_dt_lg_renew 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa3357fa640 / ms_dispatch 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa336ffd640 / io_context_pool 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa33d602640 / ms_dispatch 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa33fe07640 / ms_dispatch 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa34160a640 / io_context_pool 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa452e4a640 / msgr-worker-2 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa45364b640 / msgr-worker-1 2024-02-23T06:40:39.000 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa453e4c640 / msgr-worker-0 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa45464d640 / io_context_pool 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa455e24800 / radosgw-admin 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/log/ceph/ceph-client.admin.98068.log 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:40:38.674+0000 7fa455e24800 10 monclient: shutdown 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 asok(0x55680f1d5620) unregister_commands rotate-key 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:40:38.674+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:40:38.674+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:40:38.674+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:39.001 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding auth protocol: cephx 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding auth protocol: cephx 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding auth protocol: cephx 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:39.002 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: crc 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:40:38.674+0000 7fa455e24800 5 AuthRegistry(0x55680f3f4bf0) adding con mode: secure 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:40:38.674+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:40:38.674+0000 7fa455e24800 1 librados: starting msgr at 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:40:38.675+0000 7fa455e24800 1 librados: starting objecter 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command objecter_requests hook 0x55680f3f44e0 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:40:38.675+0000 7fa455e24800 1 librados: setting wanted keys 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:40:38.675+0000 7fa455e24800 1 librados: calling monclient init 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:39.003 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding auth protocol: cephx 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding auth protocol: cephx 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding auth protocol: cephx 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: crc 2024-02-23T06:40:39.004 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 AuthRegistry(0x55680f3f2db0) adding con mode: secure 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:40:38.675+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:40:38.675+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:40:38.675+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key hook 0x55680f3f2ef8 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient: _add_conns ranks=[2,0,1] 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f3f89e0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f428350 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x7fa43c005d80 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:40:38.675+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1589.988333s 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f3f89e0 auth_method 0 2024-02-23T06:40:39.005 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f428350 auth_method 0 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:40:38.675+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x7fa43c005d80 auth_method 0 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.006 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:40:38.675+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6215 payload 824 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:40:38.675+0000 7fa45364b640 1 monclient: found mon.noname-c 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:40:38.675+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: dump: 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.007 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: _finish_auth 0 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: _check_auth_tickets 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:40:38.676+0000 7fa33fe07640 10 monclient: dump: 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.008 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:40:38.676+0000 7fa34160a640 4 set_mon_vals no callback set 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:40:38.676+0000 7fa455e24800 5 monclient: authenticate success, global_id 6215 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:40:38.676+0000 7fa455e24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:40:38.676+0000 7fa455e24800 1 librados: init done 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:40:38.677+0000 7fa33fe07640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:40:38.677+0000 7fa33fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:40:38.677+0000 7fa33fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:39.009 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:40:38.678+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa338069eb0 auth_method 0 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:40:38.678+0000 7fa453e4c640 10 monclient: get_auth_request con 0x55680f43be10 auth_method 0 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:40:38.679+0000 7fa45364b640 10 monclient: get_auth_request con 0x55680f43eff0 auth_method 0 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:40:38.680+0000 7fa452e4a640 10 monclient: get_auth_request con 0x55680f443bf0 auth_method 0 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:40:38.681+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:40:38.681+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:40:38.681+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:39.010 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding auth protocol: cephx 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding auth protocol: cephx 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding auth protocol: cephx 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:39.011 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: crc 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f447bc0) adding con mode: secure 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:40:38.681+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command objecter_requests cmddesc objecter_requests hook 0x55680f44d4a0 EEXIST 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:40:38.681+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding auth protocol: cephx 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding auth protocol: cephx 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding auth protocol: cephx 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:39.012 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: crc 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:40:38.681+0000 7fa455e24800 5 AuthRegistry(0x55680f446c48) adding con mode: secure 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:40:38.681+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:40:38.682+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:40:38.682+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key cmddesc rotate-key hook 0x55680f446d90 EEXIST 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f472200 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f4725e0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x55680f484f30 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:39.013 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1589.994766s 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f4725e0 auth_method 0 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f472200 auth_method 0 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x55680f484f30 auth_method 0 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.014 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:40:38.682+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:40:38.682+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6531 payload 824 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:40:38.682+0000 7fa45364b640 1 monclient: found mon.noname-a 2024-02-23T06:40:39.015 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:40:38.682+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: dump: 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.016 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: _finish_auth 0 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: _check_auth_tickets 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:40:38.682+0000 7fa33d602640 10 monclient: dump: 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.017 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:40:38.682+0000 7fa455e24800 5 monclient: authenticate success, global_id 6531 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:40:38.682+0000 7fa45464d640 4 set_mon_vals no callback set 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:40:38.682+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:40:38.684+0000 7fa33d602640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:40:38.684+0000 7fa33d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:40:38.684+0000 7fa33d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:40:38.684+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa32c069dc0 auth_method 0 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: get_monmap_and_config 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:40:38.684+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:39.018 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding auth protocol: cephx 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding auth protocol: cephx 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding auth protocol: cephx 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:39.019 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: crc 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x55680f48fc20) adding con mode: secure 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:40:38.684+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:40:38.684+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding auth protocol: cephx 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding auth protocol: cephx 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding auth protocol: cephx 2024-02-23T06:40:39.020 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: crc 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:40:38.684+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779070) adding con mode: secure 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:40:38.685+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:40:38.685+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:40:38.685+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key cmddesc rotate-key hook 0x7ffd857791b8 EEXIST 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:39.021 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient: _add_conns ranks=[0,1,2] 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f4c4530 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x55680f4c4910 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f4bece0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1589.998058s 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f4c4530 auth_method 0 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x55680f4bece0 auth_method 0 2024-02-23T06:40:39.022 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:40:38.685+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f4c4910 auth_method 0 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:40:38.685+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6534 payload 274 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:39.023 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:40:38.685+0000 7fa45364b640 1 monclient: found mon.noname-a 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:40:38.685+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: dump: 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.024 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: _finish_auth 0 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: _check_auth_tickets 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:40:38.685+0000 7fa336ffd640 10 monclient: dump: 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.025 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:40:38.685+0000 7fa455e24800 5 monclient: authenticate success, global_id 6534 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:40:38.685+0000 7fa455e24800 10 monclient: get_monmap_and_config success 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:40:38.685+0000 7fa455e24800 4 set_mon_vals no callback set 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:40:38.686+0000 7fa455e24800 10 monclient: shutdown 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:40:38.686+0000 7fa455e24800 10 monclient: build_initial_monmap 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:40:38.686+0000 7fa455e24800 1 build_initial for_mkfs: 0 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:40:38.686+0000 7fa455e24800 10 monclient: monmap: 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:40:39.026 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding auth protocol: cephx 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding auth protocol: cephx 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding auth protocol: cephx 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:39.027 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: crc 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 AuthRegistry(0x55680f48fbd0) adding con mode: secure 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:40:38.686+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:40:38.686+0000 7fa455e24800 1 librados: starting msgr at 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:40:38.686+0000 7fa455e24800 1 librados: starting objecter 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:40:38.686+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command objecter_requests cmddesc objecter_requests hook 0x55680f471d90 EEXIST 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:40:38.687+0000 7fa455e24800 1 librados: setting wanted keys 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:40:38.687+0000 7fa455e24800 1 librados: calling monclient init 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient: init 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding auth protocol: cephx 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding auth protocol: cephx 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding auth protocol: cephx 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:39.028 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: crc 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 AuthRegistry(0x55680f487e10) adding con mode: secure 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:40:38.687+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:40:38.687+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:40:38.687+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command rotate-key cmddesc rotate-key hook 0x55680f487f58 EEXIST 2024-02-23T06:40:39.029 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient: _reopen_session rank -1 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-a con 0x55680f4bece0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-c con 0x55680f4c4530 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): picked mon.noname-b con 0x55680f4cf120 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): start opening mon connection 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): _renew_subs 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:40:38.687+0000 7fa455e24800 10 monclient(hunting): authenticate will time out at 1590.000220s 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): get_auth_request con 0x55680f4bece0 auth_method 0 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): get_auth_request con 0x55680f4c4530 auth_method 0 2024-02-23T06:40:39.030 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:40:38.687+0000 7fa452e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): get_auth_request con 0x55680f4cf120 auth_method 0 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:40:39.031 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:40:38.687+0000 7fa453e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient(hunting): handle_auth_done global_id 6537 payload 824 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient: _finish_hunting 0 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:40:38.687+0000 7fa45364b640 1 monclient: found mon.noname-a 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:40:38.687+0000 7fa45364b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: dump: 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.032 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: _finish_auth 0 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: _check_auth_tickets 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:40:38.688+0000 7fa3357fa640 10 monclient: dump: 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:40:39.033 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:40:38.688+0000 7fa455e24800 5 monclient: authenticate success, global_id 6537 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:40:38.688+0000 7fa336ffd640 4 set_mon_vals no callback set 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _renew_subs 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:40:38.688+0000 7fa455e24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:40:38.688+0000 7fa455e24800 1 librados: init done 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:40:38.688+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cr dump hook 0x55680f4bd028 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:40:38.689+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:40:38.689+0000 7fa3357fa640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:40:39.034 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:40:38.689+0000 7fa3357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:40:38.689+0000 7fa3357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:40:38.689+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa31c069eb0 auth_method 0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:40:38.690+0000 7fa453e4c640 10 monclient: get_auth_request con 0x55680f4de940 auth_method 0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 realm 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:40:38.690+0000 7fa455e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:40:38.690+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:40:38.691+0000 7fa45364b640 10 monclient: get_auth_request con 0x55680f4e2c80 auth_method 0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.035 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:40:38.691+0000 7fa455e24800 20 searching for the correct realm 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:40:38.692+0000 7fa452e4a640 10 monclient: get_auth_request con 0x55680f4e7d70 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:40:38.692+0000 7fa3357fa640 1 client.6537.objecter ms_handle_reset 0x55680f4e7d70 session 0x55680f4e76f0 osd.3 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:40:38.692+0000 7fa3357fa640 10 monclient: _renew_subs 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:40:38.692+0000 7fa3357fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:40:38.692+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa31c07a5e0 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:40:38.693+0000 7fa453e4c640 10 monclient: get_auth_request con 0x7fa4480a1040 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:40:38.693+0000 7fa45364b640 0 -- 172.21.15.142:0/589834851 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7fa44c00e040 msgr2=0x7fa44c010440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:40:38.693+0000 7fa45364b640 10 monclient: get_auth_request con 0x7fa44c00e040 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:40:38.894+0000 7fa45364b640 10 monclient: get_auth_request con 0x7fa44c00e040 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:40:38.895+0000 7fa452e4a640 10 monclient: get_auth_request con 0x7fa44401d060 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:40:38.897+0000 7fa453e4c640 10 monclient: get_auth_request con 0x7fa4480b2920 auth_method 0 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:40:38.898+0000 7fa453e4c640 0 -- 172.21.15.142:0/589834851 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fa4480a1040 msgr2=0x7fa4480a0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:39.036 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:40:38.898+0000 7fa3357fa640 1 client.6537.objecter ms_handle_reset 0x7fa4480a1040 session 0x7fa44808c070 osd.7 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:40:38.898+0000 7fa453e4c640 10 monclient: get_auth_request con 0x55680f4e7d70 auth_method 0 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:40:38.899+0000 7fa45364b640 10 monclient: get_auth_request con 0x7fa448064950 auth_method 0 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:40:38.904+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:39.037 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 zone default found 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:40:38.905+0000 7fa455e24800 4 Realm: () 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:40:38.905+0000 7fa455e24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:40:38.905+0000 7fa455e24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:40:38.905+0000 7fa455e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 zonegroup default 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 started sync module instance, tier type = 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:40:38.905+0000 7fa455e24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=0 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=1 2024-02-23T06:40:39.038 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=2 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=3 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=4 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=5 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:40:38.914+0000 7fa455e24800 20 add_watcher() i=6 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:40:38.915+0000 7fa455e24800 20 add_watcher() i=7 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:40:38.915+0000 7fa455e24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding auth protocol: cephx 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding auth protocol: cephx 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding auth protocol: cephx 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:40:38.917+0000 7fa309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:39.039 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: crc 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 AuthRegistry(0x7ffd85779500) adding con mode: secure 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:40:38.917+0000 7fa455e24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache list hook 0x55680f4b9e70 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache inspect hook 0x55680f4b9e70 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache erase hook 0x55680f4b9e70 2024-02-23T06:40:39.040 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command cache zap hook 0x55680f4b9e70 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 note: GC not initialized 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:40:38.917+0000 7fa308fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace show hook 0x7fa44406e070 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace history hook 0x7fa44406e070 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace active hook 0x7fa44406e070 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:40:38.917+0000 7fa455e24800 5 asok(0x55680f1d5620) register_command sync trace active_short hook 0x7fa44406e070 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:40:38.917+0000 7fa455e24800 20 Filter name: none 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:40:38.918+0000 7fa2827fc640 20 reqs_thread_entry: start 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-02-23T06:40:39.041 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:40:38.918+0000 7fa455e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 : miss 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:40:38.918+0000 7fa455e24800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:40:38.919+0000 7fa455e24800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:40:38.919+0000 7fa455e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:40:38.924+0000 7fa455e24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23, ofs0, ns] 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693259 cookie 93905421787872 notifier 6537 bl.length()=877 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:39.042 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:40:38.924+0000 7fa336ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_sources= new_sources= 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential sources added=[] removed=[] 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_dests= new_dests= 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:40:38.924+0000 7fa455e24800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential dests added=[] removed=[] 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:40:38.925+0000 7fa455e24800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa455e24800 time 2024-02-23T06:40:38.925828+0000 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa459180e86] 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:40:39.043 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:40:38.926+0000 7fa455e24800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7fa455e24800 thread_name:radosgw-admin 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa458054db0] 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa4580a154c] 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa459180ee0] 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fa459181044] 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55680ddafc61] 2024-02-23T06:40:39.044 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55680ddbc4d4] 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa45803feb0] 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:40:39.045 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:40:39.046 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:40:39.047 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:40:39.048 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:40:39.049 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:40:39.050 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa2827fc640 / http_manager 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa308fe1640 / http_manager 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa309fe3640 / rgw_dt_lg_renew 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa3357fa640 / ms_dispatch 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa336ffd640 / io_context_pool 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa33d602640 / ms_dispatch 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa33fe07640 / ms_dispatch 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa34160a640 / io_context_pool 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa452e4a640 / msgr-worker-2 2024-02-23T06:40:39.051 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa45364b640 / msgr-worker-1 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa453e4c640 / msgr-worker-0 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa45464d640 / io_context_pool 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr: 7fa455e24800 / radosgw-admin 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/lib/ceph/crash/2024-02-23T06:40:38.927194Z_cc998f10-9a16-4b76-8e41-e7782ba6d9cf/log 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:40:39.052 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.996+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 realm 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.998+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.999+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:39.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.999+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.999+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:39.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:38.999+0000 7fac72424800 20 searching for the correct realm 2024-02-23T06:40:39.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.001+0000 7fac6fc4b640 0 -- 172.21.15.142:0/3715989222 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7fac5c003bd0 msgr2=0x7fac68025430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:39.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.206+0000 7fac7044c640 0 -- 172.21.15.142:0/3715989222 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fac58078940 msgr2=0x7fac58088420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:39.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:39.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.212+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 20 zone default found 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 4 Realm: () 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 20 zonegroup default 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.213+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.214+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.214+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.214+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.214+0000 7fac72424800 20 started sync module instance, tier type = 2024-02-23T06:40:39.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.214+0000 7fac72424800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:39.223 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=0 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=1 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=2 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=3 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=4 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=5 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.223+0000 7fac72424800 20 add_watcher() i=6 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.224+0000 7fac72424800 20 add_watcher() i=7 2024-02-23T06:40:39.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.224+0000 7fac72424800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:39.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fab25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:39.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fac72424800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:39.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fac72424800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:39.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fac72424800 5 note: GC not initialized 2024-02-23T06:40:39.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fab24fe1640 20 reqs_thread_entry: start 2024-02-23T06:40:39.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fac72424800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:39.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fac72424800 20 Filter name: none 2024-02-23T06:40:39.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7faa9e7fc640 20 reqs_thread_entry: start 2024-02-23T06:40:39.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.226+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.227+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:39.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.227+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.227+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=405 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.228+0000 7fac72424800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.228+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.228+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.228+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.228+0000 7fac72424800 20 rados_obj.operate() r=0 bl.length=405 2024-02-23T06:40:39.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.228+0000 7fac72424800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:40:39.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.229+0000 7fac72424800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.229+0000 7fac72424800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.230+0000 7fab25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:39.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.232+0000 7fac72424800 20 remove_watcher() i=0 2024-02-23T06:40:39.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.232+0000 7fac72424800 2 removed watcher, disabling cache 2024-02-23T06:40:39.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.233+0000 7fac72424800 20 remove_watcher() i=1 2024-02-23T06:40:39.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.234+0000 7fac72424800 20 remove_watcher() i=2 2024-02-23T06:40:39.235 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.235+0000 7fac72424800 20 remove_watcher() i=3 2024-02-23T06:40:39.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.236+0000 7fac72424800 20 remove_watcher() i=4 2024-02-23T06:40:39.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.237+0000 7fac72424800 20 remove_watcher() i=5 2024-02-23T06:40:39.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.238+0000 7fac72424800 20 remove_watcher() i=6 2024-02-23T06:40:39.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.239+0000 7fac72424800 20 remove_watcher() i=7 2024-02-23T06:40:39.248 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.249 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:40:39.249 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-block-writes id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:40:39.249 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:40:39.305 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:40:39.331 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:40:39.332 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:40:39.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.365+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 realm 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.367 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.366+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.367+0000 7fefab013800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:39.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.367+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.368 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.368+0000 7fefab013800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:40:39.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.368+0000 7fefab013800 20 searching for the correct realm 2024-02-23T06:40:39.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.370+0000 7fefa3fff640 0 -- 172.21.15.142:0/112257500 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fef9c096c00 msgr2=0x7fef9c074410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:39.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.575+0000 7fefa884b640 0 -- 172.21.15.142:0/112257500 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fef94064720 msgr2=0x7fef9405dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.781+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 zone default found 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 4 Realm: () 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 zonegroup default 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.782+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.784 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:40:39.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 started sync module instance, tier type = 2024-02-23T06:40:39.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.783+0000 7fefab013800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=0 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=1 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=2 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=3 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=4 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=5 2024-02-23T06:40:39.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=6 2024-02-23T06:40:39.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 20 add_watcher() i=7 2024-02-23T06:40:39.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.793+0000 7fefab013800 2 all 8 watchers are set, enabling cache 2024-02-23T06:40:39.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.795+0000 7fee5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 5 note: GC not initialized 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fee5dfe3640 20 reqs_thread_entry: start 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 20 init_complete bucket index max shards: 11 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 20 Filter name: none 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fedcf7fe640 20 reqs_thread_entry: start 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.796+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:40:39.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 : miss 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 20 rados->read ofs=0 len=0 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 20 rados_obj.operate() r=0 bl.length=405 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:40:39.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.797+0000 7fefab013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 2024-02-23T06:40:39.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.799+0000 7fefab013800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to be held by another RGW process; skipping for now 2024-02-23T06:40:39.800 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.800+0000 7fee5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:40:39.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.802+0000 7fefab013800 20 remove_watcher() i=0 2024-02-23T06:40:39.802 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.802+0000 7fefab013800 2 removed watcher, disabling cache 2024-02-23T06:40:39.803 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.803+0000 7fefab013800 20 remove_watcher() i=1 2024-02-23T06:40:39.804 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.804+0000 7fefab013800 20 remove_watcher() i=2 2024-02-23T06:40:39.805 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.805+0000 7fefab013800 20 remove_watcher() i=3 2024-02-23T06:40:39.807 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.806+0000 7fefab013800 20 remove_watcher() i=4 2024-02-23T06:40:39.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.807+0000 7fefab013800 20 remove_watcher() i=5 2024-02-23T06:40:39.808 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.808+0000 7fefab013800 20 remove_watcher() i=6 2024-02-23T06:40:39.809 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:40:39.809+0000 7fefab013800 20 remove_watcher() i=7 2024-02-23T06:40:39.819 INFO:tasks.workunit.client.0.smithi142.stderr:waiting 30 seconds for reshard lock to expire... 2024-02-23T06:41:09.828 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:41:09.862 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:09.862 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:09.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.899+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:09.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:09.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 realm 2024-02-23T06:41:09.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:09.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:09.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:09.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:09.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:09.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.901+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:09.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.902+0000 7f4f66731800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:09.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.902+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:09.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.902+0000 7f4f66731800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:09.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.902+0000 7f4f66731800 20 searching for the correct realm 2024-02-23T06:41:09.906 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.906+0000 7f4f629a4640 0 -- 172.21.15.142:0/3563392502 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f4f58087070 msgr2=0x7f4f58079450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:09.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:09.909+0000 7f4f621a3640 0 -- 172.21.15.142:0/3563392502 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f4f58079450 msgr2=0x7f4f580798d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:10.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.116+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 zone default found 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 4 Realm: () 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 zonegroup default 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.117+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.118+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.118+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.118+0000 7f4f66731800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.118+0000 7f4f66731800 20 started sync module instance, tier type = 2024-02-23T06:41:10.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.118+0000 7f4f66731800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=0 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=1 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=2 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=3 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=4 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=5 2024-02-23T06:41:10.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.128+0000 7f4f66731800 20 add_watcher() i=6 2024-02-23T06:41:10.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.129+0000 7f4f66731800 20 add_watcher() i=7 2024-02-23T06:41:10.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.129+0000 7f4f66731800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:10.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.130+0000 7f4e18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:10.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:10.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 5 note: GC not initialized 2024-02-23T06:41:10.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4d937fe640 20 reqs_thread_entry: start 2024-02-23T06:41:10.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:10.132 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 20 Filter name: none 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4d917fa640 20 reqs_thread_entry: start 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.131+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.132+0000 7f4f66731800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.132+0000 7f4f66731800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.132+0000 7f4f66731800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.132+0000 7f4f66731800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 : miss 2024-02-23T06:41:10.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.132+0000 7f4f66731800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.133+0000 7f4f66731800 20 rados_obj.operate() r=0 bl.length=405 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.133+0000 7f4f66731800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.133+0000 7f4f66731800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.133+0000 7f4f66731800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.133+0000 7f4f66731800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.133+0000 7f4f66731800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 2024-02-23T06:41:10.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.134+0000 7f4f66731800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-02-23T06:41:10.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.141+0000 7f4f66731800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:41:10.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.141+0000 7f4f66731800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:41:10.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.141+0000 7f4f66731800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:10.142 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.141+0000 7f4f66731800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23, ofs0, ns] 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4e457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693260 cookie 94295328452080 notifier 6272 bl.length()=877 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4e457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4e457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4e457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_sources= new_sources= 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential sources added=[] removed=[] 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_dests= new_dests= 2024-02-23T06:41:10.143 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.142+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential dests added=[] removed=[] 2024-02-23T06:41:10.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.0 2024-02-23T06:41:10.145 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.0 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.1 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.1 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.2 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.2 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.3 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.3 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.4 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.4 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.5 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.5 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.6 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.6 2024-02-23T06:41:10.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.7 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.7 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.8 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.8 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.9 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.9 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.10 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.10 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.11 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2.11 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.0 2024-02-23T06:41:10.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.145+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.1 2024-02-23T06:41:10.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.146+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.2 2024-02-23T06:41:10.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.146+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.3 2024-02-23T06:41:10.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.147+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.4 2024-02-23T06:41:10.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.147+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.5 2024-02-23T06:41:10.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.147+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.6 2024-02-23T06:41:10.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.148+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.7 2024-02-23T06:41:10.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.148+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.8 2024-02-23T06:41:10.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.149+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.9 2024-02-23T06:41:10.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.150+0000 7f4f66731800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23.10 2024-02-23T06:41:10.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.153+0000 7f4f66731800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 : hit (requested=0x17, cached=0x17) 2024-02-23T06:41:10.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.153+0000 7f4f66731800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4f66731800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4f66731800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4f66731800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4f66731800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23, ofs0, ns] 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4e457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693261 cookie 94295328452080 notifier 6272 bl.length()=845 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4e457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 info.flags=0x17 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4e457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 to cache LRU end 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.154+0000 7f4e457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:10.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.155+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_sources= new_sources= 2024-02-23T06:41:10.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.155+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential sources added=[] removed=[] 2024-02-23T06:41:10.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.155+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): orig_dests= new_dests= 2024-02-23T06:41:10.156 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.155+0000 7f4f66731800 20 handle_bi_update(): bucket=:abort-at-block-writes[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23]): potential dests added=[] removed=[] 2024-02-23T06:41:10.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.157+0000 7f4f66731800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-02-23T06:41:10.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.159+0000 7f4e18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.161+0000 7f4f66731800 20 remove_watcher() i=0 2024-02-23T06:41:10.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.161+0000 7f4f66731800 2 removed watcher, disabling cache 2024-02-23T06:41:10.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.162+0000 7f4f66731800 20 remove_watcher() i=1 2024-02-23T06:41:10.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.163+0000 7f4f66731800 20 remove_watcher() i=2 2024-02-23T06:41:10.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.164+0000 7f4f66731800 20 remove_watcher() i=3 2024-02-23T06:41:10.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.165+0000 7f4f66731800 20 remove_watcher() i=4 2024-02-23T06:41:10.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.166+0000 7f4f66731800 20 remove_watcher() i=5 2024-02-23T06:41:10.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.167+0000 7f4f66731800 20 remove_watcher() i=6 2024-02-23T06:41:10.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.168+0000 7f4f66731800 20 remove_watcher() i=7 2024-02-23T06:41:10.180 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-02-23T06:41:10.208 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:10.208 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:10.241 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.240+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 realm 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.243 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.242+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.243+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.243+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.243+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:10.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.243+0000 7f6b6d816800 20 searching for the correct realm 2024-02-23T06:41:10.246 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.246+0000 7f6b63fff640 0 -- 172.21.15.142:0/3650616332 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f6b5c0c3310 msgr2=0x7f6b5c098a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:10.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.451+0000 7f6b68d4f640 0 -- 172.21.15.142:0/3650616332 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f6b64073190 msgr2=0x7f6b6405a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:10.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.457+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.459 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 zone default found 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 4 Realm: () 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 zonegroup default 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.458+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.459+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.459+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.459+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.459+0000 7f6b6d816800 20 started sync module instance, tier type = 2024-02-23T06:41:10.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.459+0000 7f6b6d816800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:10.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=0 2024-02-23T06:41:10.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=1 2024-02-23T06:41:10.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=2 2024-02-23T06:41:10.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=3 2024-02-23T06:41:10.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=4 2024-02-23T06:41:10.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=5 2024-02-23T06:41:10.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.468+0000 7f6b6d816800 20 add_watcher() i=6 2024-02-23T06:41:10.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.469+0000 7f6b6d816800 20 add_watcher() i=7 2024-02-23T06:41:10.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.469+0000 7f6b6d816800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:10.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6a1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6b6d816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6b6d816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6b6d816800 5 note: GC not initialized 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6a1dfe3640 20 reqs_thread_entry: start 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6b6d816800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6b6d816800 20 Filter name: none 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f698f7fe640 20 reqs_thread_entry: start 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.471+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.472 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.472+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:41:10.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.472+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.472+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:41:10.473 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.472+0000 7f6b6d816800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.472+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.473+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=189 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.473+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.473+0000 7f6b6d816800 20 rados_obj.operate() r=0 bl.length=373 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.473+0000 7f6b6d816800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.474+0000 7f6b6d816800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.474+0000 7f6b6d816800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.475+0000 7f6a1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.477+0000 7f6b6d816800 20 remove_watcher() i=0 2024-02-23T06:41:10.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.477+0000 7f6b6d816800 2 removed watcher, disabling cache 2024-02-23T06:41:10.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.478+0000 7f6b6d816800 20 remove_watcher() i=1 2024-02-23T06:41:10.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.480+0000 7f6b6d816800 20 remove_watcher() i=2 2024-02-23T06:41:10.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.481+0000 7f6b6d816800 20 remove_watcher() i=3 2024-02-23T06:41:10.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.482+0000 7f6b6d816800 20 remove_watcher() i=4 2024-02-23T06:41:10.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.483+0000 7f6b6d816800 20 remove_watcher() i=5 2024-02-23T06:41:10.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.483+0000 7f6b6d816800 20 remove_watcher() i=6 2024-02-23T06:41:10.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.484+0000 7f6b6d816800 20 remove_watcher() i=7 2024-02-23T06:41:10.494 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:10.495 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:10.495 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-block-writes id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:41:10.495 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:10.585 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-02-23T06:41:10.585 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:10.796 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-02-23T06:41:10.825 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:10.825 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:10.857 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.857+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.858+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.858+0000 7f3e2e639800 20 realm 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.858+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.859+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.859+0000 7f3e2e639800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.859+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.859 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.859+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.859+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.860+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.860+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.860+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:10.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.860+0000 7f3e2e639800 20 searching for the correct realm 2024-02-23T06:41:10.863 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.863+0000 7f3e23fff640 0 -- 172.21.15.142:0/1146048327 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x55793bd4bc10 msgr2=0x55793bd4e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:10.867 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.867+0000 7f3e23fff640 0 -- 172.21.15.142:0/1146048327 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f3e1c089bc0 msgr2=0x7f3e1c07d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:10.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:10.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:10.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:10.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:10.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:10.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:10.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:10.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 zone default found 2024-02-23T06:41:10.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 4 Realm: () 2024-02-23T06:41:10.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:10.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:10.873 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 zonegroup default 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.871+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 started sync module instance, tier type = 2024-02-23T06:41:10.874 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.872+0000 7f3e2e639800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:10.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=0 2024-02-23T06:41:10.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=1 2024-02-23T06:41:10.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=2 2024-02-23T06:41:10.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=3 2024-02-23T06:41:10.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=4 2024-02-23T06:41:10.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=5 2024-02-23T06:41:10.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.880+0000 7f3e2e639800 20 add_watcher() i=6 2024-02-23T06:41:10.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.881+0000 7f3e2e639800 20 add_watcher() i=7 2024-02-23T06:41:10.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.881+0000 7f3e2e639800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.883+0000 7f3cdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.883+0000 7f3e2e639800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.883+0000 7f3e2e639800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.883+0000 7f3e2e639800 5 note: GC not initialized 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3cde7e4640 20 reqs_thread_entry: start 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3e2e639800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:10.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3e2e639800 20 Filter name: none 2024-02-23T06:41:10.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3c4ffff640 20 reqs_thread_entry: start 2024-02-23T06:41:10.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:10.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.884+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.885+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:10.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.885+0000 7f3e2e639800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:10.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.885+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.885+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:10.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.886+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.886 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.886+0000 7f3e2e639800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:10.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.886+0000 7f3e2e639800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:10.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.887+0000 7f3e2e639800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.887+0000 7f3e2e639800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.888+0000 7f3cdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.890+0000 7f3e2e639800 20 remove_watcher() i=0 2024-02-23T06:41:10.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.890+0000 7f3e2e639800 2 removed watcher, disabling cache 2024-02-23T06:41:10.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.891+0000 7f3e2e639800 20 remove_watcher() i=1 2024-02-23T06:41:10.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.892+0000 7f3e2e639800 20 remove_watcher() i=2 2024-02-23T06:41:10.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.892+0000 7f3e2e639800 20 remove_watcher() i=3 2024-02-23T06:41:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.893+0000 7f3e2e639800 20 remove_watcher() i=4 2024-02-23T06:41:10.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.894+0000 7f3e2e639800 20 remove_watcher() i=5 2024-02-23T06:41:10.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.895+0000 7f3e2e639800 20 remove_watcher() i=6 2024-02-23T06:41:10.896 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.896+0000 7f3e2e639800 20 remove_watcher() i=7 2024-02-23T06:41:10.906 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:10.906 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:10.906 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:10.906 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:10.907 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-02-23T06:41:10.940 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:10.940 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:10.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.972+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.973+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.973+0000 7fafd500f800 20 realm 2024-02-23T06:41:10.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.973+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.974+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.974+0000 7fafd500f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:10.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.974+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.974+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.975 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.974+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.975+0000 7fafd500f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.975+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.975+0000 7fafd500f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:10.976 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.975+0000 7fafd500f800 20 searching for the correct realm 2024-02-23T06:41:10.978 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.978+0000 7fafd0d50640 0 -- 172.21.15.142:0/1084247723 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fafb8036070 msgr2=0x7fafb8047480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:10.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.981+0000 7fafd054f640 0 -- 172.21.15.142:0/1084247723 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fafb8057920 msgr2=0x7fafb8037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:10.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:10.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:10.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:10.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:10.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:10.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 zone default found 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 4 Realm: () 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 zonegroup default 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.985+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.988 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:10.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:10.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 started sync module instance, tier type = 2024-02-23T06:41:10.989 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.986+0000 7fafd500f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:10.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=0 2024-02-23T06:41:10.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=1 2024-02-23T06:41:10.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=2 2024-02-23T06:41:10.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=3 2024-02-23T06:41:10.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=4 2024-02-23T06:41:10.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=5 2024-02-23T06:41:10.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.995+0000 7fafd500f800 20 add_watcher() i=6 2024-02-23T06:41:10.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.996+0000 7fafd500f800 20 add_watcher() i=7 2024-02-23T06:41:10.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.996+0000 7fafd500f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:10.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.997+0000 7fae86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:10.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.997+0000 7fafd500f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:10.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.997+0000 7fafd500f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:10.998 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 5 note: GC not initialized 2024-02-23T06:41:10.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fae85fe3640 20 reqs_thread_entry: start 2024-02-23T06:41:10.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:10.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 20 Filter name: none 2024-02-23T06:41:10.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fae7f7fe640 20 reqs_thread_entry: start 2024-02-23T06:41:10.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-02-23T06:41:10.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:11.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:11.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-02-23T06:41:11.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 : miss 2024-02-23T06:41:11.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.998+0000 7fafd500f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.000 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.999+0000 7fafd500f800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:11.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.999+0000 7fafd500f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.999+0000 7fafd500f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.999+0000 7fafd500f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:11.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.999+0000 7fafd500f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:10.999+0000 7fafd500f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7fafd500f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7fafd500f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7fafd500f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7fafd500f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24, ofs0, ns] 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7faeaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693210 cookie 94746849623904 notifier 6654 bl.length()=893 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7faeaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7faeaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.005+0000 7faeaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.006+0000 7fafd500f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): orig_sources= new_sources= 2024-02-23T06:41:11.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.006+0000 7fafd500f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): potential sources added=[] removed=[] 2024-02-23T06:41:11.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.006+0000 7fafd500f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): orig_dests= new_dests= 2024-02-23T06:41:11.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.006+0000 7fafd500f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): potential dests added=[] removed=[] 2024-02-23T06:41:11.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.0 2024-02-23T06:41:11.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.0 2024-02-23T06:41:11.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.1 2024-02-23T06:41:11.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.1 2024-02-23T06:41:11.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.2 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.2 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.3 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.3 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.4 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.4 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.5 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.5 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.6 2024-02-23T06:41:11.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.6 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.7 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.7 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.8 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.8 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.9 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.9 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.10 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.10 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.11 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1.11 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.008+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.0 2024-02-23T06:41:11.011 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.009+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.009+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.010+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.3 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.010+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.4 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.010+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.5 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.011+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.6 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.011+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.7 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.012+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.8 2024-02-23T06:41:11.013 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.012+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.9 2024-02-23T06:41:11.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.013+0000 7fafd500f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.10 2024-02-23T06:41:11.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.018+0000 7fafd500f800 -1 Injecting error=-5 at location=commit_target_layout 2024-02-23T06:41:11.021 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.018+0000 7fafd500f800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-02-23T06:41:11.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.022+0000 7fae86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.023+0000 7fafd500f800 20 remove_watcher() i=0 2024-02-23T06:41:11.024 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.023+0000 7fafd500f800 2 removed watcher, disabling cache 2024-02-23T06:41:11.025 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.024+0000 7fafd500f800 20 remove_watcher() i=1 2024-02-23T06:41:11.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.025+0000 7fafd500f800 20 remove_watcher() i=2 2024-02-23T06:41:11.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.026+0000 7fafd500f800 20 remove_watcher() i=3 2024-02-23T06:41:11.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.027+0000 7fafd500f800 20 remove_watcher() i=4 2024-02-23T06:41:11.028 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.028+0000 7fafd500f800 20 remove_watcher() i=5 2024-02-23T06:41:11.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.029+0000 7fafd500f800 20 remove_watcher() i=6 2024-02-23T06:41:11.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.030+0000 7fafd500f800 20 remove_watcher() i=7 2024-02-23T06:41:11.041 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-02-23T06:41:11.069 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:11.069 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:11.102 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.101+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.103 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 realm 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.104 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.103+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.104+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:11.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.104+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.104+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:11.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.104+0000 7fa1cc430800 20 searching for the correct realm 2024-02-23T06:41:11.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.107+0000 7fa1c6c4a640 0 -- 172.21.15.142:0/1221357905 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fa1b80856d0 msgr2=0x7fa1b8099040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:11.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.110+0000 7fa1c744b640 0 -- 172.21.15.142:0/1221357905 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fa1bc04d390 msgr2=0x7fa1bc04d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:11.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:11.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.316+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 zone default found 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 4 Realm: () 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:11.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:11.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:11.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 zonegroup default 2024-02-23T06:41:11.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 started sync module instance, tier type = 2024-02-23T06:41:11.320 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.317+0000 7fa1cc430800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=0 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=1 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=2 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=3 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=4 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=5 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.326+0000 7fa1cc430800 20 add_watcher() i=6 2024-02-23T06:41:11.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.327+0000 7fa1cc430800 20 add_watcher() i=7 2024-02-23T06:41:11.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.327+0000 7fa1cc430800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:11.329 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.329+0000 7fa07dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.329+0000 7fa1cc430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:11.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.329+0000 7fa1cc430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:11.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.329+0000 7fa1cc430800 5 note: GC not initialized 2024-02-23T06:41:11.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.329+0000 7fa07cfe1640 20 reqs_thread_entry: start 2024-02-23T06:41:11.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.330+0000 7fa1cc430800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:11.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.330+0000 7fa1cc430800 20 Filter name: none 2024-02-23T06:41:11.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.330+0000 7f9ff67fc640 20 reqs_thread_entry: start 2024-02-23T06:41:11.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.330+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.330+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.330+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=413 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 rados_obj.operate() r=0 bl.length=413 2024-02-23T06:41:11.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.331+0000 7fa1cc430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:11.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.332+0000 7fa1cc430800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.332+0000 7fa1cc430800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.333+0000 7fa07dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.335+0000 7fa1cc430800 20 remove_watcher() i=0 2024-02-23T06:41:11.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.335+0000 7fa1cc430800 2 removed watcher, disabling cache 2024-02-23T06:41:11.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.336+0000 7fa1cc430800 20 remove_watcher() i=1 2024-02-23T06:41:11.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.337+0000 7fa1cc430800 20 remove_watcher() i=2 2024-02-23T06:41:11.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.338+0000 7fa1cc430800 20 remove_watcher() i=3 2024-02-23T06:41:11.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.339+0000 7fa1cc430800 20 remove_watcher() i=4 2024-02-23T06:41:11.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.340+0000 7fa1cc430800 20 remove_watcher() i=5 2024-02-23T06:41:11.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.341+0000 7fa1cc430800 20 remove_watcher() i=6 2024-02-23T06:41:11.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.342+0000 7fa1cc430800 20 remove_watcher() i=7 2024-02-23T06:41:11.352 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:11.352 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:11.352 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:11.352 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:11.405 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:41:11.435 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:11.435 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:11.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.467+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 realm 2024-02-23T06:41:11.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:11.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.469+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.470+0000 7f5efbf33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:11.470 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.470+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.470+0000 7f5efbf33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:11.471 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.470+0000 7f5efbf33800 20 searching for the correct realm 2024-02-23T06:41:11.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.473+0000 7f5ef81a4640 0 -- 172.21.15.142:0/1671533303 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x564064e1fac0 msgr2=0x564064e21f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:11.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.477+0000 7f5ef79a3640 0 -- 172.21.15.142:0/1671533303 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f5ee00a7580 msgr2=0x7f5ee00d30e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:11.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:11.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:11.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 zone default found 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 4 Realm: () 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:11.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 zonegroup default 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.481+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 started sync module instance, tier type = 2024-02-23T06:41:11.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.482+0000 7f5efbf33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:11.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=0 2024-02-23T06:41:11.491 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=1 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=2 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=3 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=4 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=5 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.490+0000 7f5efbf33800 20 add_watcher() i=6 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.491+0000 7f5efbf33800 20 add_watcher() i=7 2024-02-23T06:41:11.492 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.491+0000 7f5efbf33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:11.493 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.493+0000 7f5dadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.494 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.493+0000 7f5efbf33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.493+0000 7f5efbf33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.493+0000 7f5efbf33800 5 note: GC not initialized 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5dacfe1640 20 reqs_thread_entry: start 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 20 Filter name: none 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5d267fc640 20 reqs_thread_entry: start 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 : miss 2024-02-23T06:41:11.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.494+0000 7f5efbf33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.495+0000 7f5efbf33800 20 rados_obj.operate() r=0 bl.length=413 2024-02-23T06:41:11.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.495+0000 7f5efbf33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.495+0000 7f5efbf33800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.495+0000 7f5efbf33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:11.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.495+0000 7f5efbf33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.495+0000 7f5efbf33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 2024-02-23T06:41:11.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.496+0000 7f5efbf33800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-02-23T06:41:11.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5efbf33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5efbf33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5efbf33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5efbf33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24, ofs0, ns] 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5dd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693211 cookie 94834570477376 notifier 6359 bl.length()=893 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5dd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5dd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.502+0000 7f5dd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.503+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): orig_sources= new_sources= 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.503+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): potential sources added=[] removed=[] 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.503+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): orig_dests= new_dests= 2024-02-23T06:41:11.503 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.503+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): potential dests added=[] removed=[] 2024-02-23T06:41:11.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.0 2024-02-23T06:41:11.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.0 2024-02-23T06:41:11.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.1 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.1 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.2 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.2 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.3 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.3 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.4 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.4 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.5 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.5 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.6 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.6 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.7 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.7 2024-02-23T06:41:11.506 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.8 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.8 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.9 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.9 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.10 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.10 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.11 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2.11 2024-02-23T06:41:11.507 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.0 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.505+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.1 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.506+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.2 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.506+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.3 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.507+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.4 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.507+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.5 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.507+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.6 2024-02-23T06:41:11.508 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.508+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.7 2024-02-23T06:41:11.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.508+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.8 2024-02-23T06:41:11.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.509+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.9 2024-02-23T06:41:11.509 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.509+0000 7f5efbf33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24.10 2024-02-23T06:41:11.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.512+0000 7f5efbf33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 : hit (requested=0x17, cached=0x17) 2024-02-23T06:41:11.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.512+0000 7f5efbf33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 2024-02-23T06:41:11.513 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24, ofs0, ns] 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5dd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693212 cookie 94834570477376 notifier 6359 bl.length()=861 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5dd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 info.flags=0x17 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5dd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 to cache LRU end 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5dd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): orig_sources= new_sources= 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): potential sources added=[] removed=[] 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): orig_dests= new_dests= 2024-02-23T06:41:11.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.513+0000 7f5efbf33800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24]): potential dests added=[] removed=[] 2024-02-23T06:41:11.516 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.515+0000 7f5efbf33800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-02-23T06:41:11.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.517+0000 7f5dadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.519+0000 7f5efbf33800 20 remove_watcher() i=0 2024-02-23T06:41:11.519 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.519+0000 7f5efbf33800 2 removed watcher, disabling cache 2024-02-23T06:41:11.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.520+0000 7f5efbf33800 20 remove_watcher() i=1 2024-02-23T06:41:11.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.521+0000 7f5efbf33800 20 remove_watcher() i=2 2024-02-23T06:41:11.522 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.522+0000 7f5efbf33800 20 remove_watcher() i=3 2024-02-23T06:41:11.523 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.523+0000 7f5efbf33800 20 remove_watcher() i=4 2024-02-23T06:41:11.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.524+0000 7f5efbf33800 20 remove_watcher() i=5 2024-02-23T06:41:11.525 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.525+0000 7f5efbf33800 20 remove_watcher() i=6 2024-02-23T06:41:11.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.526+0000 7f5efbf33800 20 remove_watcher() i=7 2024-02-23T06:41:11.537 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-02-23T06:41:11.565 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:11.565 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:11.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.597+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 realm 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.599+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.600+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:11.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.600+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.601+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:11.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.601+0000 7fc0e932a800 20 searching for the correct realm 2024-02-23T06:41:11.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.603+0000 7fc0dc5a2640 0 -- 172.21.15.142:0/1321744436 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fc0d4068070 msgr2=0x7fc0d40aeac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:11.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.606+0000 7fc0e4da3640 0 -- 172.21.15.142:0/1321744436 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fc0cc069040 msgr2=0x7fc0cc069420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:11.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:11.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:11.813 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.812+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 zone default found 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 4 Realm: () 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:11.814 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:11.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 zonegroup default 2024-02-23T06:41:11.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.815 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 started sync module instance, tier type = 2024-02-23T06:41:11.816 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.813+0000 7fc0e932a800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=0 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=1 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=2 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=3 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=4 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=5 2024-02-23T06:41:11.823 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.823+0000 7fc0e932a800 20 add_watcher() i=6 2024-02-23T06:41:11.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.824+0000 7fc0e932a800 20 add_watcher() i=7 2024-02-23T06:41:11.824 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.824+0000 7fc0e932a800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:11.825 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.825+0000 7fbf9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.825+0000 7fc0e932a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:11.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.825+0000 7fc0e932a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:11.826 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.825+0000 7fc0e932a800 5 note: GC not initialized 2024-02-23T06:41:11.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fbf99fe3640 20 reqs_thread_entry: start 2024-02-23T06:41:11.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fc0e932a800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:11.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fc0e932a800 20 Filter name: none 2024-02-23T06:41:11.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fbf0b7fe640 20 reqs_thread_entry: start 2024-02-23T06:41:11.827 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.826+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.827+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.827+0000 7fc0e932a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.827+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.828+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:11.828 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.828+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.828+0000 7fc0e932a800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:11.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.828+0000 7fc0e932a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:11.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.829+0000 7fc0e932a800 20 rados->read ofs=0 len=0 2024-02-23T06:41:11.829 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.829+0000 7fc0e932a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:11.830 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.830+0000 7fbf9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:11.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.832+0000 7fc0e932a800 20 remove_watcher() i=0 2024-02-23T06:41:11.832 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.832+0000 7fc0e932a800 2 removed watcher, disabling cache 2024-02-23T06:41:11.833 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.833+0000 7fc0e932a800 20 remove_watcher() i=1 2024-02-23T06:41:11.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.834+0000 7fc0e932a800 20 remove_watcher() i=2 2024-02-23T06:41:11.835 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.835+0000 7fc0e932a800 20 remove_watcher() i=3 2024-02-23T06:41:11.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.836+0000 7fc0e932a800 20 remove_watcher() i=4 2024-02-23T06:41:11.837 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.837+0000 7fc0e932a800 20 remove_watcher() i=5 2024-02-23T06:41:11.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.838+0000 7fc0e932a800 20 remove_watcher() i=6 2024-02-23T06:41:11.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:11.839+0000 7fc0e932a800 20 remove_watcher() i=7 2024-02-23T06:41:11.849 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:11.849 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:11.849 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:41:11.849 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:11.941 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-02-23T06:41:11.941 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:12.142 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-02-23T06:41:12.168 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:12.169 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:12.201 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.201+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.202+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.202+0000 7f821a8c0800 20 realm 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.202+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.203+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.203+0000 7f821a8c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.203+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.203+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.203 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.203+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.204+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:12.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.204+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.204+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:12.204 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.204+0000 7f821a8c0800 20 searching for the correct realm 2024-02-23T06:41:12.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.207+0000 7f82189a4640 0 -- 172.21.15.142:0/1932024009 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x55b7d4934ea0 msgr2=0x55b7d4937340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:12.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.210+0000 7f820ffff640 0 -- 172.21.15.142:0/1932024009 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f8208082060 msgr2=0x7f82080a2ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:12.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:12.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:12.214 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:12.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.214+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:12.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 zone default found 2024-02-23T06:41:12.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 4 Realm: () 2024-02-23T06:41:12.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:12.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 zonegroup default 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 started sync module instance, tier type = 2024-02-23T06:41:12.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.215+0000 7f821a8c0800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:12.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=0 2024-02-23T06:41:12.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=1 2024-02-23T06:41:12.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=2 2024-02-23T06:41:12.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=3 2024-02-23T06:41:12.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=4 2024-02-23T06:41:12.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=5 2024-02-23T06:41:12.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.224+0000 7f821a8c0800 20 add_watcher() i=6 2024-02-23T06:41:12.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.227+0000 7f821a8c0800 20 add_watcher() i=7 2024-02-23T06:41:12.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.227+0000 7f821a8c0800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:12.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.229+0000 7f80cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:12.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f821a8c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f821a8c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f821a8c0800 5 note: GC not initialized 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f80ccfe1640 20 reqs_thread_entry: start 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f821a8c0800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f821a8c0800 20 Filter name: none 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f80467fc640 20 reqs_thread_entry: start 2024-02-23T06:41:12.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.230+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.231+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.231+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.231+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.231+0000 7f821a8c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.231+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.232+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:12.232 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.232+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.232+0000 7f821a8c0800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:12.233 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.232+0000 7f821a8c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:12.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.233+0000 7f821a8c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.233+0000 7f821a8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.234 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.234+0000 7f80cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:12.236 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.236+0000 7f821a8c0800 20 remove_watcher() i=0 2024-02-23T06:41:12.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.236+0000 7f821a8c0800 2 removed watcher, disabling cache 2024-02-23T06:41:12.237 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.237+0000 7f821a8c0800 20 remove_watcher() i=1 2024-02-23T06:41:12.238 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.238+0000 7f821a8c0800 20 remove_watcher() i=2 2024-02-23T06:41:12.239 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.239+0000 7f821a8c0800 20 remove_watcher() i=3 2024-02-23T06:41:12.240 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.240+0000 7f821a8c0800 20 remove_watcher() i=4 2024-02-23T06:41:12.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.241+0000 7f821a8c0800 20 remove_watcher() i=5 2024-02-23T06:41:12.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.242+0000 7f821a8c0800 20 remove_watcher() i=6 2024-02-23T06:41:12.244 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.243+0000 7f821a8c0800 20 remove_watcher() i=7 2024-02-23T06:41:12.253 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:12.253 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:12.253 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:12.253 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:12.255 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-02-23T06:41:12.289 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:12.289 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:12.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.321+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 realm 2024-02-23T06:41:12.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:12.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.323+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.324+0000 7f457652d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:12.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.324+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.324+0000 7f457652d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:12.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.324+0000 7f457652d800 20 searching for the correct realm 2024-02-23T06:41:12.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.327+0000 7f4572750640 0 -- 172.21.15.142:0/3130149388 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f4568097060 msgr2=0x7f456808e020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:12.330 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.330+0000 7f4571f4f640 0 -- 172.21.15.142:0/3130149388 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f456805e040 msgr2=0x7f4568097440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:12.537 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.536+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 zone default found 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 4 Realm: () 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 zonegroup default 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.537+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.538+0000 7f457652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.538+0000 7f457652d800 20 started sync module instance, tier type = 2024-02-23T06:41:12.539 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.538+0000 7f457652d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:12.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=0 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=1 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=2 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=3 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=4 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=5 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.547+0000 7f457652d800 20 add_watcher() i=6 2024-02-23T06:41:12.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.548+0000 7f457652d800 20 add_watcher() i=7 2024-02-23T06:41:12.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.548+0000 7f457652d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:12.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.549+0000 7f441b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:12.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:12.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 5 note: GC not initialized 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f441a7fc640 20 reqs_thread_entry: start 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 20 Filter name: none 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f4393fff640 20 reqs_thread_entry: start 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.550+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 : miss 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.552 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:12.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 info.flags=0x17 2024-02-23T06:41:12.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 to cache LRU end 2024-02-23T06:41:12.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:12.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:12.553 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.551+0000 7f457652d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 2024-02-23T06:41:12.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f457652d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 info.flags=0x17 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f457652d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 to cache LRU end 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f457652d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f457652d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25, ofs0, ns] 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f44557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693215 cookie 94168797372032 notifier 6413 bl.length()=893 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f44557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 info.flags=0x17 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f44557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 to cache LRU end 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.556+0000 7f44557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.557+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): orig_sources= new_sources= 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.557+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): potential sources added=[] removed=[] 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.557+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): orig_dests= new_dests= 2024-02-23T06:41:12.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.557+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): potential dests added=[] removed=[] 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.0 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.0 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.1 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.1 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.2 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.2 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.3 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.3 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.4 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.4 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.5 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.5 2024-02-23T06:41:12.560 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.6 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.6 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.7 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.7 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.8 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.8 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.9 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.9 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.10 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.10 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.11 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1.11 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.0 2024-02-23T06:41:12.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.559+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.1 2024-02-23T06:41:12.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.560+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.2 2024-02-23T06:41:12.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.560+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.3 2024-02-23T06:41:12.562 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.561+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.4 2024-02-23T06:41:12.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.561+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.5 2024-02-23T06:41:12.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.562+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.6 2024-02-23T06:41:12.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.562+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.7 2024-02-23T06:41:12.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.563+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.8 2024-02-23T06:41:12.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.563+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.9 2024-02-23T06:41:12.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.564+0000 7f457652d800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25.10 2024-02-23T06:41:12.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.567+0000 7f457652d800 -1 Injecting error=-125 at location=commit_target_layout 2024-02-23T06:41:12.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.567+0000 7f457652d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 : hit (requested=0x17, cached=0x17) 2024-02-23T06:41:12.568 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.567+0000 7f457652d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 2024-02-23T06:41:12.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 info.flags=0x17 2024-02-23T06:41:12.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 to cache LRU end 2024-02-23T06:41:12.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:12.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25, ofs0, ns] 2024-02-23T06:41:12.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f44557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693216 cookie 94168797372032 notifier 6413 bl.length()=861 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f44557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 info.flags=0x17 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f44557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 to cache LRU end 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f44557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): orig_sources= new_sources= 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): potential sources added=[] removed=[] 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): orig_dests= new_dests= 2024-02-23T06:41:12.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.569+0000 7f457652d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25]): potential dests added=[] removed=[] 2024-02-23T06:41:12.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.571+0000 7f457652d800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-02-23T06:41:12.573 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.573+0000 7f441b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:12.575 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.575+0000 7f457652d800 20 remove_watcher() i=0 2024-02-23T06:41:12.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.575+0000 7f457652d800 2 removed watcher, disabling cache 2024-02-23T06:41:12.576 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.576+0000 7f457652d800 20 remove_watcher() i=1 2024-02-23T06:41:12.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.577+0000 7f457652d800 20 remove_watcher() i=2 2024-02-23T06:41:12.578 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.578+0000 7f457652d800 20 remove_watcher() i=3 2024-02-23T06:41:12.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.580+0000 7f457652d800 20 remove_watcher() i=4 2024-02-23T06:41:12.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.581+0000 7f457652d800 20 remove_watcher() i=5 2024-02-23T06:41:12.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.581+0000 7f457652d800 20 remove_watcher() i=6 2024-02-23T06:41:12.582 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.582+0000 7f457652d800 20 remove_watcher() i=7 2024-02-23T06:41:12.594 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-02-23T06:41:12.621 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:12.621 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:12.654 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.653+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 realm 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.656 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.655+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.656+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:12.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.656+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.656+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:12.657 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.656+0000 7ff5efe30800 20 searching for the correct realm 2024-02-23T06:41:12.659 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.659+0000 7ff5ea64a640 0 -- 172.21.15.142:0/23345559 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7ff5dc078040 msgr2=0x7ff5dc05eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:12.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.662+0000 7ff5eae4b640 0 -- 172.21.15.142:0/23345559 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7ff5e0048410 msgr2=0x7ff5e0048890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:12.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:12.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:12.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:12.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:12.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:12.869 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.867+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 zone default found 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 4 Realm: () 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 zonegroup default 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.868+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.870 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.871 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 started sync module instance, tier type = 2024-02-23T06:41:12.872 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.869+0000 7ff5efe30800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:12.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=0 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=1 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=2 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=3 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=4 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=5 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.878+0000 7ff5efe30800 20 add_watcher() i=6 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.879+0000 7ff5efe30800 20 add_watcher() i=7 2024-02-23T06:41:12.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.879+0000 7ff5efe30800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:12.881 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff4a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff5efe30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff5efe30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff5efe30800 5 note: GC not initialized 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff41bfff640 20 reqs_thread_entry: start 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff5efe30800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff5efe30800 20 Filter name: none 2024-02-23T06:41:12.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff419ffb640 20 reqs_thread_entry: start 2024-02-23T06:41:12.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.881+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.882+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:12.883 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.882+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.882+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.882+0000 7ff5efe30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.882+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.883+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.883+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.883+0000 7ff5efe30800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:12.884 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.883+0000 7ff5efe30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:12.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.884+0000 7ff5efe30800 20 rados->read ofs=0 len=0 2024-02-23T06:41:12.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.884+0000 7ff5efe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:12.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.885+0000 7ff4a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:12.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.887+0000 7ff5efe30800 20 remove_watcher() i=0 2024-02-23T06:41:12.887 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.887+0000 7ff5efe30800 2 removed watcher, disabling cache 2024-02-23T06:41:12.888 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.888+0000 7ff5efe30800 20 remove_watcher() i=1 2024-02-23T06:41:12.889 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.889+0000 7ff5efe30800 20 remove_watcher() i=2 2024-02-23T06:41:12.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.890+0000 7ff5efe30800 20 remove_watcher() i=3 2024-02-23T06:41:12.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.891+0000 7ff5efe30800 20 remove_watcher() i=4 2024-02-23T06:41:12.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.892+0000 7ff5efe30800 20 remove_watcher() i=5 2024-02-23T06:41:12.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.893+0000 7ff5efe30800 20 remove_watcher() i=6 2024-02-23T06:41:12.894 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:12.894+0000 7ff5efe30800 20 remove_watcher() i=7 2024-02-23T06:41:12.903 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:12.904 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:12.904 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25 num_objects: 20 size_kb: 1 num_shards: 12 2024-02-23T06:41:12.904 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.000 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-02-23T06:41:13.000 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.243 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-02-23T06:41:13.270 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:13.270 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:13.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.302+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.303+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.303+0000 7f5c98f1f800 20 realm 2024-02-23T06:41:13.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.303+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.304+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.304+0000 7f5c98f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:13.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.304+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.304+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.304+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.305+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.305+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.305+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:13.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.305+0000 7f5c98f1f800 20 searching for the correct realm 2024-02-23T06:41:13.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.309+0000 7f5c8ffff640 0 -- 172.21.15.142:0/3195450428 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f5c8803a400 msgr2=0x7f5c8803a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.312+0000 7f5c8ffff640 0 -- 172.21.15.142:0/3195450428 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f5b6007a5e0 msgr2=0x7f5b6007ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:13.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.315+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 zone default found 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 4 Realm: () 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 zonegroup default 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.316+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.317+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.317+0000 7f5c98f1f800 20 started sync module instance, tier type = 2024-02-23T06:41:13.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.317+0000 7f5c98f1f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:13.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=0 2024-02-23T06:41:13.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=1 2024-02-23T06:41:13.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=2 2024-02-23T06:41:13.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=3 2024-02-23T06:41:13.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=4 2024-02-23T06:41:13.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=5 2024-02-23T06:41:13.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.326+0000 7f5c98f1f800 20 add_watcher() i=6 2024-02-23T06:41:13.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.327+0000 7f5c98f1f800 20 add_watcher() i=7 2024-02-23T06:41:13.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.327+0000 7f5c98f1f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.328+0000 7f5b4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.328+0000 7f5c98f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.328+0000 7f5c98f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5c98f1f800 5 note: GC not initialized 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5b49fe3640 20 reqs_thread_entry: start 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5c98f1f800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:13.331 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5c98f1f800 20 Filter name: none 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5abb7fe640 20 reqs_thread_entry: start 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.329+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.330+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.330+0000 7f5c98f1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.330+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.330+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.330+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.331+0000 7f5c98f1f800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:13.332 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.331+0000 7f5c98f1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:13.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.332+0000 7f5c98f1f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.332+0000 7f5c98f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.333+0000 7f5b4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.335+0000 7f5c98f1f800 20 remove_watcher() i=0 2024-02-23T06:41:13.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.335+0000 7f5c98f1f800 2 removed watcher, disabling cache 2024-02-23T06:41:13.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.336+0000 7f5c98f1f800 20 remove_watcher() i=1 2024-02-23T06:41:13.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.337+0000 7f5c98f1f800 20 remove_watcher() i=2 2024-02-23T06:41:13.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.338+0000 7f5c98f1f800 20 remove_watcher() i=3 2024-02-23T06:41:13.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.339+0000 7f5c98f1f800 20 remove_watcher() i=4 2024-02-23T06:41:13.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.340+0000 7f5c98f1f800 20 remove_watcher() i=5 2024-02-23T06:41:13.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.341+0000 7f5c98f1f800 20 remove_watcher() i=6 2024-02-23T06:41:13.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.342+0000 7f5c98f1f800 20 remove_watcher() i=7 2024-02-23T06:41:13.351 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.352 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:13.352 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:13.352 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.353 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-02-23T06:41:13.386 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:13.386 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:13.419 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.419+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 realm 2024-02-23T06:41:13.420 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:13.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.421 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:13.422 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.421+0000 7f3449b33800 20 searching for the correct realm 2024-02-23T06:41:13.425 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.425+0000 7f343ce4a640 0 -- 172.21.15.142:0/545215538 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f3438056070 msgr2=0x7f34380c5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.428 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.428+0000 7f343ce4a640 0 -- 172.21.15.142:0/545215538 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f331007a5e0 msgr2=0x7f331007ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:13.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:13.433 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.431+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 zone default found 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 4 Realm: () 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:13.434 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 zonegroup default 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.433+0000 7f3449b33800 20 started sync module instance, tier type = 2024-02-23T06:41:13.435 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.433+0000 7f3449b33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:13.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=0 2024-02-23T06:41:13.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=1 2024-02-23T06:41:13.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=2 2024-02-23T06:41:13.442 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=3 2024-02-23T06:41:13.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=4 2024-02-23T06:41:13.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=5 2024-02-23T06:41:13.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=6 2024-02-23T06:41:13.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.442+0000 7f3449b33800 20 add_watcher() i=7 2024-02-23T06:41:13.443 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.442+0000 7f3449b33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:13.444 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f32fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f3449b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:13.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f3449b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:13.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f3449b33800 5 note: GC not initialized 2024-02-23T06:41:13.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f32fa7e4640 20 reqs_thread_entry: start 2024-02-23T06:41:13.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f3449b33800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.444+0000 7f3449b33800 20 Filter name: none 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f326bfff640 20 reqs_thread_entry: start 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 : miss 2024-02-23T06:41:13.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:13.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:13.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.445+0000 7f3449b33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.450+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.450+0000 7f3449b33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.450+0000 7f3449b33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.450+0000 7f3449b33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26, ofs0, ns] 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693255 cookie 93845899362304 notifier 6792 bl.length()=893 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_sources= new_sources= 2024-02-23T06:41:13.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential sources added=[] removed=[] 2024-02-23T06:41:13.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_dests= new_dests= 2024-02-23T06:41:13.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential dests added=[] removed=[] 2024-02-23T06:41:13.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:13.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:13.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:13.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.0 2024-02-23T06:41:13.456 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1 2024-02-23T06:41:13.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.2 2024-02-23T06:41:13.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.3 2024-02-23T06:41:13.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.4 2024-02-23T06:41:13.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.456+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.5 2024-02-23T06:41:13.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.456+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.6 2024-02-23T06:41:13.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.7 2024-02-23T06:41:13.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.8 2024-02-23T06:41:13.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.9 2024-02-23T06:41:13.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.458+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.10 2024-02-23T06:41:13.461 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3449b33800 time 2024-02-23T06:41:13.461952+0000 2024-02-23T06:41:13.461 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:13.461 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f344b180e86] 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.461+0000 7f3449b33800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3449b33800 time 2024-02-23T06:41:13.461952+0000 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.462 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f344b180e86] 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr:*** Caught signal (Aborted) ** 2024-02-23T06:41:13.463 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f3449b33800 thread_name:radosgw-admin 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f344a054db0] 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f344a0a154c] 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f344b180ee0] 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.481 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.462+0000 7f3449b33800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f3449b33800 thread_name:radosgw-admin 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f344a054db0] 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f344a0a154c] 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f344b180ee0] 2024-02-23T06:41:13.482 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.483 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:41:13.404+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:41:13.405+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:41:13.405+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key hook 0x555a336f2df8 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _add_conns ranks=[2,1,0] 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a3359d840 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.484 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a335a7cd0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a33637430 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.717926s 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): get_auth_request con 0x555a3359d840 auth_method 0 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a33637430 auth_method 0 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.485 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a335a7cd0 auth_method 0 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.486 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_done global_id 6458 payload 824 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:41:13.405+0000 7f344564b640 1 monclient: found mon.noname-c 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: dump: 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.487 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: dump: 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.488 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:41:13.405+0000 7f3449b33800 5 monclient: authenticate success, global_id 6458 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:41:13.405+0000 7f3333606640 4 set_mon_vals no callback set 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:41:13.405+0000 7f3449b33800 1 librados: init done 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:41:13.407+0000 7f3331e03640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:13.489 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:41:13.407+0000 7f3331e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:41:13.407+0000 7f3331e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:41:13.407+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f332c069eb0 auth_method 0 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:41:13.407+0000 7f3445e4c640 10 monclient: get_auth_request con 0x555a3371e5a0 auth_method 0 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:41:13.408+0000 7f344564b640 10 monclient: get_auth_request con 0x555a3373e1c0 auth_method 0 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:41:13.409+0000 7f343ce4a640 10 monclient: get_auth_request con 0x555a33743250 auth_method 0 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:41:13.410+0000 7f3449b33800 10 monclient: build_initial_monmap 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:41:13.410+0000 7f3449b33800 1 build_initial for_mkfs: 0 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:41:13.410+0000 7f3449b33800 10 monclient: monmap: 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:13.490 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding auth protocol: cephx 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding auth protocol: cephx 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding auth protocol: cephx 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.491 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:41:13.410+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 asok(0x555a334d5620) register_command objecter_requests cmddesc objecter_requests hook 0x555a3374acf0 EEXIST 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient: init 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding auth protocol: cephx 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding auth protocol: cephx 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding auth protocol: cephx 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.492 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:41:13.411+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:41:13.411+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key cmddesc rotate-key hook 0x555a33746200 EEXIST 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.493 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient: _add_conns ranks=[1,2,0] 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a33771520 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a33771900 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a337842b0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.724260s 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a33771900 auth_method 0 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a337842b0 auth_method 0 2024-02-23T06:41:13.494 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): get_auth_request con 0x555a33771520 auth_method 0 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_done global_id 6786 payload 824 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.495 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:41:13.411+0000 7f3445e4c640 1 monclient: found mon.noname-a 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: dump: 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.496 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: dump: 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.497 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:41:13.412+0000 7f3449b33800 5 monclient: authenticate success, global_id 6786 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:41:13.412+0000 7f344664d640 4 set_mon_vals no callback set 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:41:13.413+0000 7f332affd640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:41:13.413+0000 7f332affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:41:13.413+0000 7f332affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:41:13.413+0000 7f344564b640 10 monclient: get_auth_request con 0x7f3320069df0 auth_method 0 2024-02-23T06:41:13.498 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: get_monmap_and_config 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: build_initial_monmap 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:41:13.414+0000 7f3449b33800 1 build_initial for_mkfs: 0 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: monmap: 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.499 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding auth protocol: cephx 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding auth protocol: cephx 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding auth protocol: cephx 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.500 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:41:13.414+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: init 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding auth protocol: cephx 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding auth protocol: cephx 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding auth protocol: cephx 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.501 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:41:13.414+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:41:13.414+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:41:13.415+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key cmddesc rotate-key hook 0x7ffd185a2068 EEXIST 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient: _add_conns ranks=[1,0,2] 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a337c3af0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a33794b40 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a337bf460 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.502 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.727761s 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a337bf460 auth_method 0 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a33794b40 auth_method 0 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.503 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_done global_id 6464 payload 274 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:41:13.415+0000 7f3445e4c640 1 monclient: found mon.noname-c 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: dump: 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.504 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: dump: 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.505 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:41:13.415+0000 7f3449b33800 5 monclient: authenticate success, global_id 6464 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient: get_monmap_and_config success 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:41:13.415+0000 7f3449b33800 4 set_mon_vals no callback set 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: shutdown 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: build_initial_monmap 2024-02-23T06:41:13.506 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 build_initial for_mkfs: 0 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: monmap: 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding auth protocol: cephx 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding auth protocol: cephx 2024-02-23T06:41:13.507 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding auth protocol: cephx 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:41:13.416+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.508 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: starting msgr at 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: starting objecter 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 asok(0x555a334d5620) register_command objecter_requests cmddesc objecter_requests hook 0x555a33791bc0 EEXIST 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: setting wanted keys 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: calling monclient init 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: init 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding auth protocol: cephx 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding auth protocol: cephx 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding auth protocol: cephx 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.509 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:41:13.416+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:41:13.417+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:41:13.417+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key cmddesc rotate-key hook 0x555a33787008 EEXIST 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a33794b40 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a337bf460 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a337c3af0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.510 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.729828s 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a337bf460 auth_method 0 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): get_auth_request con 0x555a33794b40 auth_method 0 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.511 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a337c3af0 auth_method 0 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_done global_id 6792 payload 824 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:41:13.417+0000 7f344564b640 1 monclient: found mon.noname-a 2024-02-23T06:41:13.512 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: dump: 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.513 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: dump: 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.514 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:41:13.417+0000 7f3449b33800 5 monclient: authenticate success, global_id 6792 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:41:13.417+0000 7f3328ff9640 4 set_mon_vals no callback set 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:41:13.417+0000 7f3449b33800 1 librados: init done 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:41:13.417+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cr dump hook 0x555a337b1f28 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:41:13.419+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:41:13.419+0000 7f3316ffd640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:41:13.419+0000 7f3316ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:41:13.419+0000 7f3316ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.515 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:41:13.419+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f3310069eb0 auth_method 0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:41:13.419+0000 7f3445e4c640 10 monclient: get_auth_request con 0x555a337deb50 auth_method 0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 realm 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:41:13.420+0000 7f3449b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:41:13.420+0000 7f344564b640 10 monclient: get_auth_request con 0x555a337e2e10 auth_method 0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:13.516 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 searching for the correct realm 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:41:13.421+0000 7f343ce4a640 10 monclient: get_auth_request con 0x555a337e8060 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:41:13.422+0000 7f3445e4c640 10 monclient: get_auth_request con 0x7f343003c040 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:41:13.423+0000 7f344564b640 10 monclient: get_auth_request con 0x7f3440061360 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:41:13.423+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f3438056070 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:41:13.425+0000 7f343ce4a640 0 -- 172.21.15.142:0/545215538 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f3438056070 msgr2=0x7f34380c5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:41:13.425+0000 7f3316ffd640 1 client.6792.objecter ms_handle_reset 0x7f3438056070 session 0x7f3438005040 osd.4 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:41:13.425+0000 7f3316ffd640 10 monclient: _renew_subs 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:41:13.425+0000 7f3316ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:41:13.425+0000 7f3445e4c640 10 monclient: get_auth_request con 0x7f343002f040 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:41:13.425+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f331007a5e0 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:41:13.427+0000 7f344564b640 10 monclient: get_auth_request con 0x7f343000b040 auth_method 0 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:41:13.428+0000 7f343ce4a640 0 -- 172.21.15.142:0/545215538 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f331007a5e0 msgr2=0x7f331007ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:41:13.428+0000 7f3316ffd640 1 client.6792.objecter ms_handle_reset 0x7f331007a5e0 session 0x7f3438005040 osd.4 2024-02-23T06:41:13.517 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:41:13.428+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f3438056070 auth_method 0 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:13.518 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 zone default found 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:41:13.432+0000 7f3449b33800 4 Realm: () 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:41:13.432+0000 7f3449b33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:41:13.432+0000 7f3449b33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:13.519 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:41:13.432+0000 7f3449b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 zonegroup default 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 started sync module instance, tier type = 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=0 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=1 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=2 2024-02-23T06:41:13.520 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=3 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=4 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=5 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=6 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:41:13.442+0000 7f3449b33800 20 add_watcher() i=7 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:41:13.442+0000 7f3449b33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding auth protocol: cephx 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding auth protocol: cephx 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding auth protocol: cephx 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.521 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:41:13.444+0000 7f32fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:41:13.444+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache list hook 0x555a337bc880 2024-02-23T06:41:13.522 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache inspect hook 0x555a337bc880 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache erase hook 0x555a337bc880 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache zap hook 0x555a337bc880 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 note: GC not initialized 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:41:13.444+0000 7f32fa7e4640 20 reqs_thread_entry: start 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace show hook 0x7f3440004860 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace history hook 0x7f3440004860 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace active hook 0x7f3440004860 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace active_short hook 0x7f3440004860 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 Filter name: none 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:41:13.445+0000 7f326bfff640 20 reqs_thread_entry: start 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.523 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 : miss 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.524 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26, ofs0, ns] 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693255 cookie 93845899362304 notifier 6792 bl.length()=893 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_sources= new_sources= 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential sources added=[] removed=[] 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_dests= new_dests= 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential dests added=[] removed=[] 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:13.525 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:13.526 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.0 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.2 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.3 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.4 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:41:13.456+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.5 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:41:13.456+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.6 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.7 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.8 2024-02-23T06:41:13.527 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.9 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:41:13.458+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.10 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:41:13.461+0000 7f3449b33800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3449b33800 time 2024-02-23T06:41:13.461952+0000 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f344b180e86] 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:13.528 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:41:13.462+0000 7f3449b33800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f3449b33800 thread_name:radosgw-admin 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f344a054db0] 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f344a0a154c] 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f344b180ee0] 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.529 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:41:13.530 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:41:13.531 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:41:13.532 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:41:13.533 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:41:13.534 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:41:13.535 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:41:13.536 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f326bfff640 / http_manager 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f32fa7e4640 / http_manager 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f32fb7e6640 / rgw_dt_lg_renew 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3316ffd640 / ms_dispatch 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3317fff640 / io_context_pool 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3328ff9640 / io_context_pool 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f332affd640 / ms_dispatch 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3331e03640 / ms_dispatch 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3333606640 / io_context_pool 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f343ce4a640 / msgr-worker-2 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f344564b640 / msgr-worker-1 2024-02-23T06:41:13.537 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3445e4c640 / msgr-worker-0 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: 7f344664d640 / io_context_pool 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3449b33800 / radosgw-admin 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/log/ceph/ceph-client.admin.106314.log 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.538 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: crc 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:41:13.404+0000 7f3449b33800 5 AuthRegistry(0x555a336f2cb0) adding con mode: secure 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:41:13.404+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:41:13.405+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:41:13.405+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key hook 0x555a336f2df8 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _add_conns ranks=[2,1,0] 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a3359d840 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a335a7cd0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a33637430 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.539 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.717926s 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): get_auth_request con 0x555a3359d840 auth_method 0 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a33637430 auth_method 0 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.540 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:41:13.405+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a335a7cd0 auth_method 0 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:41:13.405+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient(hunting): handle_auth_done global_id 6458 payload 824 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.541 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:41:13.405+0000 7f344564b640 1 monclient: found mon.noname-c 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:41:13.405+0000 7f344564b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: dump: 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.542 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:41:13.405+0000 7f3331e03640 10 monclient: dump: 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.543 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:41:13.405+0000 7f3449b33800 5 monclient: authenticate success, global_id 6458 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:41:13.405+0000 7f3333606640 4 set_mon_vals no callback set 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:41:13.405+0000 7f3449b33800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:41:13.405+0000 7f3449b33800 1 librados: init done 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:41:13.407+0000 7f3331e03640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:41:13.407+0000 7f3331e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:41:13.407+0000 7f3331e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.544 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:41:13.407+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f332c069eb0 auth_method 0 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:41:13.407+0000 7f3445e4c640 10 monclient: get_auth_request con 0x555a3371e5a0 auth_method 0 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:41:13.408+0000 7f344564b640 10 monclient: get_auth_request con 0x555a3373e1c0 auth_method 0 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:41:13.409+0000 7f343ce4a640 10 monclient: get_auth_request con 0x555a33743250 auth_method 0 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:41:13.410+0000 7f3449b33800 10 monclient: build_initial_monmap 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:41:13.410+0000 7f3449b33800 1 build_initial for_mkfs: 0 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:41:13.410+0000 7f3449b33800 10 monclient: monmap: 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:13.545 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding auth protocol: cephx 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding auth protocol: cephx 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding auth protocol: cephx 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.546 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: crc 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:41:13.410+0000 7f3449b33800 5 AuthRegistry(0x555a33747030) adding con mode: secure 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:41:13.410+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 asok(0x555a334d5620) register_command objecter_requests cmddesc objecter_requests hook 0x555a3374acf0 EEXIST 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient: init 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding auth protocol: cephx 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding auth protocol: cephx 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding auth protocol: cephx 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.547 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: crc 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 AuthRegistry(0x555a337460b8) adding con mode: secure 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:41:13.411+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:41:13.411+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:41:13.411+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key cmddesc rotate-key hook 0x555a33746200 EEXIST 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient: _add_conns ranks=[1,2,0] 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a33771520 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a33771900 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.548 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a337842b0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:41:13.411+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.724260s 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a33771900 auth_method 0 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a337842b0 auth_method 0 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.549 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:41:13.411+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): get_auth_request con 0x555a33771520 auth_method 0 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:41:13.411+0000 7f344564b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient(hunting): handle_auth_done global_id 6786 payload 824 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:41:13.411+0000 7f3445e4c640 1 monclient: found mon.noname-a 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:41:13.411+0000 7f3445e4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.550 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: dump: 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.551 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:41:13.412+0000 7f332affd640 10 monclient: dump: 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.552 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:41:13.412+0000 7f3449b33800 5 monclient: authenticate success, global_id 6786 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:41:13.412+0000 7f344664d640 4 set_mon_vals no callback set 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:41:13.412+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:41:13.413+0000 7f332affd640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:41:13.413+0000 7f332affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:41:13.413+0000 7f332affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:41:13.413+0000 7f344564b640 10 monclient: get_auth_request con 0x7f3320069df0 auth_method 0 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: get_monmap_and_config 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: build_initial_monmap 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:41:13.414+0000 7f3449b33800 1 build_initial for_mkfs: 0 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: monmap: 2024-02-23T06:41:13.553 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding auth protocol: cephx 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding auth protocol: cephx 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding auth protocol: cephx 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.554 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: crc 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x555a3378ef30) adding con mode: secure 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:41:13.414+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:41:13.414+0000 7f3449b33800 10 monclient: init 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding auth protocol: cephx 2024-02-23T06:41:13.555 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding auth protocol: cephx 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding auth protocol: cephx 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: crc 2024-02-23T06:41:13.556 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:41:13.414+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a1f20) adding con mode: secure 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:41:13.414+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:41:13.414+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:41:13.415+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key cmddesc rotate-key hook 0x7ffd185a2068 EEXIST 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient: _add_conns ranks=[1,0,2] 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a337c3af0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a33794b40 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a337bf460 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.727761s 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a337bf460 auth_method 0 2024-02-23T06:41:13.557 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a33794b40 auth_method 0 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:41:13.415+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.558 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient(hunting): handle_auth_done global_id 6464 payload 274 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:41:13.415+0000 7f3445e4c640 1 monclient: found mon.noname-c 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:41:13.415+0000 7f3445e4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: dump: 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.559 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:41:13.415+0000 7f3328ff9640 10 monclient: dump: 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.560 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:41:13.415+0000 7f3449b33800 5 monclient: authenticate success, global_id 6464 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:41:13.415+0000 7f3449b33800 10 monclient: get_monmap_and_config success 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:41:13.415+0000 7f3449b33800 4 set_mon_vals no callback set 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: shutdown 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: build_initial_monmap 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 build_initial for_mkfs: 0 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: monmap: 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:13.561 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding auth protocol: cephx 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding auth protocol: cephx 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding auth protocol: cephx 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.562 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: crc 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a3378eee0) adding con mode: secure 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:41:13.416+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: starting msgr at 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: starting objecter 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 asok(0x555a334d5620) register_command objecter_requests cmddesc objecter_requests hook 0x555a33791bc0 EEXIST 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: setting wanted keys 2024-02-23T06:41:13.563 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:41:13.416+0000 7f3449b33800 1 librados: calling monclient init 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:41:13.416+0000 7f3449b33800 10 monclient: init 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding auth protocol: cephx 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding auth protocol: cephx 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding auth protocol: cephx 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.564 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: crc 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:41:13.416+0000 7f3449b33800 5 AuthRegistry(0x555a33786ec0) adding con mode: secure 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:41:13.416+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:41:13.417+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:41:13.417+0000 7f3449b33800 5 asok(0x555a334d5620) register_command rotate-key cmddesc rotate-key hook 0x555a33787008 EEXIST 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-a con 0x555a33794b40 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-c con 0x555a337bf460 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): picked mon.noname-b con 0x555a337c3af0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.565 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient(hunting): authenticate will time out at 1624.729828s 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): get_auth_request con 0x555a337bf460 auth_method 0 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): get_auth_request con 0x555a33794b40 auth_method 0 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:41:13.417+0000 7f343ce4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.566 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): get_auth_request con 0x555a337c3af0 auth_method 0 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:41:13.417+0000 7f3445e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient(hunting): handle_auth_done global_id 6792 payload 824 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient: _finish_hunting 0 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:41:13.417+0000 7f344564b640 1 monclient: found mon.noname-a 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:41:13.417+0000 7f344564b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.567 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: dump: 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: _finish_auth 0 2024-02-23T06:41:13.568 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: _check_auth_tickets 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:41:13.417+0000 7f3316ffd640 10 monclient: dump: 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:13.569 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:41:13.417+0000 7f3449b33800 5 monclient: authenticate success, global_id 6792 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:41:13.417+0000 7f3328ff9640 4 set_mon_vals no callback set 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _renew_subs 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:41:13.417+0000 7f3449b33800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:41:13.417+0000 7f3449b33800 1 librados: init done 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:41:13.417+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cr dump hook 0x555a337b1f28 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:41:13.419+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:41:13.419+0000 7f3316ffd640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:41:13.419+0000 7f3316ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:41:13.419+0000 7f3316ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:13.570 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:41:13.419+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f3310069eb0 auth_method 0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:41:13.419+0000 7f3445e4c640 10 monclient: get_auth_request con 0x555a337deb50 auth_method 0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 realm 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:41:13.420+0000 7f3449b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:41:13.420+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:41:13.420+0000 7f344564b640 10 monclient: get_auth_request con 0x555a337e2e10 auth_method 0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.571 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:41:13.421+0000 7f3449b33800 20 searching for the correct realm 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:41:13.421+0000 7f343ce4a640 10 monclient: get_auth_request con 0x555a337e8060 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:41:13.422+0000 7f3445e4c640 10 monclient: get_auth_request con 0x7f343003c040 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:41:13.423+0000 7f344564b640 10 monclient: get_auth_request con 0x7f3440061360 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:41:13.423+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f3438056070 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:41:13.425+0000 7f343ce4a640 0 -- 172.21.15.142:0/545215538 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f3438056070 msgr2=0x7f34380c5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:41:13.425+0000 7f3316ffd640 1 client.6792.objecter ms_handle_reset 0x7f3438056070 session 0x7f3438005040 osd.4 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:41:13.425+0000 7f3316ffd640 10 monclient: _renew_subs 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:41:13.425+0000 7f3316ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:41:13.425+0000 7f3445e4c640 10 monclient: get_auth_request con 0x7f343002f040 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:41:13.425+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f331007a5e0 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:41:13.427+0000 7f344564b640 10 monclient: get_auth_request con 0x7f343000b040 auth_method 0 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:41:13.428+0000 7f343ce4a640 0 -- 172.21.15.142:0/545215538 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f331007a5e0 msgr2=0x7f331007ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.572 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:41:13.428+0000 7f3316ffd640 1 client.6792.objecter ms_handle_reset 0x7f331007a5e0 session 0x7f3438005040 osd.4 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:41:13.428+0000 7f343ce4a640 10 monclient: get_auth_request con 0x7f3438056070 auth_method 0 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:41:13.431+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.573 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 zone default found 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:41:13.432+0000 7f3449b33800 4 Realm: () 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:41:13.432+0000 7f3449b33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:41:13.432+0000 7f3449b33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:41:13.432+0000 7f3449b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 zonegroup default 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:41:13.432+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.574 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 started sync module instance, tier type = 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:41:13.433+0000 7f3449b33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=0 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=1 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=2 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=3 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=4 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=5 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:41:13.441+0000 7f3449b33800 20 add_watcher() i=6 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:41:13.442+0000 7f3449b33800 20 add_watcher() i=7 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:41:13.442+0000 7f3449b33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding auth protocol: cephx 2024-02-23T06:41:13.575 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding auth protocol: cephx 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding auth protocol: cephx 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:41:13.444+0000 7f32fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.576 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: crc 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 AuthRegistry(0x7ffd185a23b0) adding con mode: secure 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:41:13.444+0000 7f3449b33800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache list hook 0x555a337bc880 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache inspect hook 0x555a337bc880 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache erase hook 0x555a337bc880 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command cache zap hook 0x555a337bc880 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 note: GC not initialized 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:41:13.444+0000 7f32fa7e4640 20 reqs_thread_entry: start 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace show hook 0x7f3440004860 2024-02-23T06:41:13.577 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace history hook 0x7f3440004860 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace active hook 0x7f3440004860 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:41:13.444+0000 7f3449b33800 5 asok(0x555a334d5620) register_command sync trace active_short hook 0x7f3440004860 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:41:13.444+0000 7f3449b33800 20 Filter name: none 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:41:13.445+0000 7f326bfff640 20 reqs_thread_entry: start 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 : miss 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.578 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:41:13.445+0000 7f3449b33800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:41:13.445+0000 7f3449b33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:41:13.450+0000 7f3449b33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26, ofs0, ns] 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693255 cookie 93845899362304 notifier 6792 bl.length()=893 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:13.579 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:41:13.451+0000 7f3317fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_sources= new_sources= 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential sources added=[] removed=[] 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_dests= new_dests= 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:41:13.451+0000 7f3449b33800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential dests added=[] removed=[] 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:13.580 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:13.581 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:41:13.454+0000 7f3449b33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.0 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:41:13.454+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.2 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.3 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:41:13.455+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.4 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:41:13.456+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.5 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:41:13.456+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.6 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.7 2024-02-23T06:41:13.582 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.8 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:41:13.457+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.9 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:41:13.458+0000 7f3449b33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.10 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:41:13.461+0000 7f3449b33800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3449b33800 time 2024-02-23T06:41:13.461952+0000 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f344b180e86] 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.583 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:41:13.462+0000 7f3449b33800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f3449b33800 thread_name:radosgw-admin 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f344a054db0] 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f344a0a154c] 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f344b180ee0] 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f344b181044] 2024-02-23T06:41:13.584 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a329e0c61] 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x555a329ed7e8] 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f344a03feb0] 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:41:13.585 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:41:13.586 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:41:13.587 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:41:13.588 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:41:13.589 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:41:13.590 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:41:13.591 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f326bfff640 / http_manager 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f32fa7e4640 / http_manager 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f32fb7e6640 / rgw_dt_lg_renew 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3316ffd640 / ms_dispatch 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3317fff640 / io_context_pool 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3328ff9640 / io_context_pool 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f332affd640 / ms_dispatch 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3331e03640 / ms_dispatch 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3333606640 / io_context_pool 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f343ce4a640 / msgr-worker-2 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f344564b640 / msgr-worker-1 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3445e4c640 / msgr-worker-0 2024-02-23T06:41:13.592 INFO:tasks.workunit.client.0.smithi142.stderr: 7f344664d640 / io_context_pool 2024-02-23T06:41:13.593 INFO:tasks.workunit.client.0.smithi142.stderr: 7f3449b33800 / radosgw-admin 2024-02-23T06:41:13.593 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:41:13.593 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:41:13.593 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/lib/ceph/crash/2024-02-23T06:41:13.463320Z_ba5bc937-68c4-4958-bf8f-f47cf3b7a2c6/log 2024-02-23T06:41:13.593 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:41:13.593 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-02-23T06:41:13.598 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:13.598 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:13.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.532+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.533+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.533+0000 7f9159024800 20 realm 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.533+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.534+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.534+0000 7f9159024800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.534+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.534+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.534+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.535+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.535+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.535+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.535+0000 7f9159024800 20 searching for the correct realm 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.538+0000 7f914ffff640 0 -- 172.21.15.142:0/3294889393 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x56004616b9f0 msgr2=0x56004616de60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.541+0000 7f914ffff640 0 -- 172.21.15.142:0/3294889393 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f9148066d40 msgr2=0x7f9148011000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.545+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 zone default found 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 4 Realm: () 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 zonegroup default 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.546+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.547+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.547+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.547+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.547+0000 7f9159024800 20 started sync module instance, tier type = 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.547+0000 7f9159024800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=0 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=1 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=2 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=3 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=4 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=5 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.556+0000 7f9159024800 20 add_watcher() i=6 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.557+0000 7f9159024800 20 add_watcher() i=7 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.557+0000 7f9159024800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.558+0000 7f900d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:13.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 5 note: GC not initialized 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f8f87fff640 20 reqs_thread_entry: start 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 Filter name: none 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f8f85ffb640 20 reqs_thread_entry: start 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.559+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.560+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=413 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.560+0000 7f9159024800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.560+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.560+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.560+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.561+0000 7f9159024800 20 rados_obj.operate() r=0 bl.length=413 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.561+0000 7f9159024800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.561+0000 7f9159024800 20 rados->read ofs=0 len=0 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.562+0000 7f9159024800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.562+0000 7f900d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.564+0000 7f9159024800 20 remove_watcher() i=0 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.564+0000 7f9159024800 2 removed watcher, disabling cache 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.565+0000 7f9159024800 20 remove_watcher() i=1 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.566+0000 7f9159024800 20 remove_watcher() i=2 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.567+0000 7f9159024800 20 remove_watcher() i=3 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.568+0000 7f9159024800 20 remove_watcher() i=4 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.569+0000 7f9159024800 20 remove_watcher() i=5 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.570+0000 7f9159024800 20 remove_watcher() i=6 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:13.571+0000 7f9159024800 20 remove_watcher() i=7 2024-02-23T06:41:13.604 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:13.605 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:13.605 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:13.605 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:43.668 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:41:43.701 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:43.701 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:43.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.739+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 realm 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.740+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.741+0000 7fb03452f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:43.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.742+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.742+0000 7fb03452f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:43.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.742+0000 7fb03452f800 20 searching for the correct realm 2024-02-23T06:41:43.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.745+0000 7fb0277a2640 0 -- 172.21.15.142:0/329040157 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fb020039070 msgr2=0x7fb020062e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:43.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.749+0000 7fb02ffa3640 0 -- 172.21.15.142:0/329040157 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fb0180cd960 msgr2=0x7fb0180a5930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.957 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:43.958 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.956+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:43.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 20 zone default found 2024-02-23T06:41:43.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 4 Realm: () 2024-02-23T06:41:43.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:43.960 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:43.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:43.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 20 zonegroup default 2024-02-23T06:41:43.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.961 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.957+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.958+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.958+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.958+0000 7fb03452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:43.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.958+0000 7fb03452f800 20 started sync module instance, tier type = 2024-02-23T06:41:43.962 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.958+0000 7fb03452f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:43.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=0 2024-02-23T06:41:43.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=1 2024-02-23T06:41:43.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=2 2024-02-23T06:41:43.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=3 2024-02-23T06:41:43.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=4 2024-02-23T06:41:43.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=5 2024-02-23T06:41:43.969 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.968+0000 7fb03452f800 20 add_watcher() i=6 2024-02-23T06:41:43.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.969+0000 7fb03452f800 20 add_watcher() i=7 2024-02-23T06:41:43.970 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.969+0000 7fb03452f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:43.971 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.971+0000 7faee5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:43.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.971+0000 7fb03452f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:43.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.971+0000 7fb03452f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:43.972 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.971+0000 7fb03452f800 5 note: GC not initialized 2024-02-23T06:41:43.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.971+0000 7faee4fe1640 20 reqs_thread_entry: start 2024-02-23T06:41:43.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:43.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 20 Filter name: none 2024-02-23T06:41:43.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fae5e7fc640 20 reqs_thread_entry: start 2024-02-23T06:41:43.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-02-23T06:41:43.973 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 : miss 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.972+0000 7fb03452f800 20 rados->read ofs=0 len=0 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.973+0000 7fb03452f800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.973+0000 7fb03452f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.973+0000 7fb03452f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.973+0000 7fb03452f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.973+0000 7fb03452f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:43.974 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.973+0000 7fb03452f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 2024-02-23T06:41:43.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.978+0000 7fb03452f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:43.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.978+0000 7fb03452f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:43.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.978+0000 7fb03452f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:43.979 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.978+0000 7fb03452f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26, ofs0, ns] 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7faf0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693257 cookie 94227951563552 notifier 6500 bl.length()=893 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7faf0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7faf0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7faf0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_sources= new_sources= 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential sources added=[] removed=[] 2024-02-23T06:41:43.980 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_dests= new_dests= 2024-02-23T06:41:43.981 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.979+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential dests added=[] removed=[] 2024-02-23T06:41:43.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:43.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.0 2024-02-23T06:41:43.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:43.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.1 2024-02-23T06:41:43.982 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.2 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.3 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.4 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.5 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.6 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.7 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.8 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:43.983 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.9 2024-02-23T06:41:43.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:43.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.10 2024-02-23T06:41:43.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:43.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1.11 2024-02-23T06:41:43.984 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.0 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.982+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.1 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.983+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.2 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.983+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.3 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.984+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.4 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.984+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.5 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.984+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.6 2024-02-23T06:41:43.985 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.985+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.7 2024-02-23T06:41:43.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.986+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.8 2024-02-23T06:41:43.986 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.986+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.9 2024-02-23T06:41:43.987 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.987+0000 7fb03452f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26.10 2024-02-23T06:41:43.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.990+0000 7fb03452f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 : hit (requested=0x17, cached=0x17) 2024-02-23T06:41:43.990 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.990+0000 7fb03452f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 2024-02-23T06:41:43.991 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7fb03452f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7fb03452f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7fb03452f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7fb03452f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26, ofs0, ns] 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7faf0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693258 cookie 94227951563552 notifier 6500 bl.length()=861 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7faf0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 info.flags=0x17 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7faf0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 to cache LRU end 2024-02-23T06:41:43.992 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.991+0000 7faf0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:43.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.992+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_sources= new_sources= 2024-02-23T06:41:43.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.992+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential sources added=[] removed=[] 2024-02-23T06:41:43.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.992+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): orig_dests= new_dests= 2024-02-23T06:41:43.993 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.992+0000 7fb03452f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26]): potential dests added=[] removed=[] 2024-02-23T06:41:43.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.995+0000 7fb03452f800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-02-23T06:41:43.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.997+0000 7faee5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:43.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.999+0000 7fb03452f800 20 remove_watcher() i=0 2024-02-23T06:41:43.999 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:43.999+0000 7fb03452f800 2 removed watcher, disabling cache 2024-02-23T06:41:44.001 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.000+0000 7fb03452f800 20 remove_watcher() i=1 2024-02-23T06:41:44.002 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.002+0000 7fb03452f800 20 remove_watcher() i=2 2024-02-23T06:41:44.003 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.003+0000 7fb03452f800 20 remove_watcher() i=3 2024-02-23T06:41:44.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.004+0000 7fb03452f800 20 remove_watcher() i=4 2024-02-23T06:41:44.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.005+0000 7fb03452f800 20 remove_watcher() i=5 2024-02-23T06:41:44.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.006+0000 7fb03452f800 20 remove_watcher() i=6 2024-02-23T06:41:44.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.007+0000 7fb03452f800 20 remove_watcher() i=7 2024-02-23T06:41:44.019 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-02-23T06:41:44.047 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:44.047 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:44.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.079+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 realm 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.081+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.082+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:44.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.082+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.082+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:44.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.082+0000 7f36b9412800 20 searching for the correct realm 2024-02-23T06:41:44.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.086+0000 7f36b4fa4640 0 -- 172.21.15.142:0/3462749285 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x55a2b09c3030 msgr2=0x55a2b09c54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:44.090 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.089+0000 7f36b3fa2640 0 -- 172.21.15.142:0/3462749285 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f36a401e060 msgr2=0x7f36a4080140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:44.093 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.094 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.093+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.095 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 zone default found 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 4 Realm: () 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 zonegroup default 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.094+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.095+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.095+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.096 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.095+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.095+0000 7f36b9412800 20 started sync module instance, tier type = 2024-02-23T06:41:44.097 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.095+0000 7f36b9412800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=0 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=1 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=2 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=3 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=4 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=5 2024-02-23T06:41:44.105 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.104+0000 7f36b9412800 20 add_watcher() i=6 2024-02-23T06:41:44.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.105+0000 7f36b9412800 20 add_watcher() i=7 2024-02-23T06:41:44.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.105+0000 7f36b9412800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:44.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.107+0000 7f356a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:44.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.107+0000 7f36b9412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:44.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.107+0000 7f36b9412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:44.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.107+0000 7f36b9412800 5 note: GC not initialized 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.107+0000 7f35697e2640 20 reqs_thread_entry: start 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.108+0000 7f36b9412800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.108+0000 7f36b9412800 20 Filter name: none 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.108+0000 7f34daffd640 20 reqs_thread_entry: start 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.108+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.108+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:44.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.108+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=197 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 rados_obj.operate() r=0 bl.length=381 2024-02-23T06:41:44.110 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.109+0000 7f36b9412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:44.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.110+0000 7f36b9412800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.110+0000 7f36b9412800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.111 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.111+0000 7f356a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:44.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.114+0000 7f36b9412800 20 remove_watcher() i=0 2024-02-23T06:41:44.114 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.114+0000 7f36b9412800 2 removed watcher, disabling cache 2024-02-23T06:41:44.115 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.115+0000 7f36b9412800 20 remove_watcher() i=1 2024-02-23T06:41:44.116 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.116+0000 7f36b9412800 20 remove_watcher() i=2 2024-02-23T06:41:44.117 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.117+0000 7f36b9412800 20 remove_watcher() i=3 2024-02-23T06:41:44.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.118+0000 7f36b9412800 20 remove_watcher() i=4 2024-02-23T06:41:44.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.119+0000 7f36b9412800 20 remove_watcher() i=5 2024-02-23T06:41:44.120 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.120+0000 7f36b9412800 20 remove_watcher() i=6 2024-02-23T06:41:44.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.121+0000 7f36b9412800 20 remove_watcher() i=7 2024-02-23T06:41:44.131 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:44.131 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:44.131 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-commit-target-layout id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:41:44.131 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:44.225 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-02-23T06:41:44.225 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:44.437 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-02-23T06:41:44.464 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:44.464 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:44.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.496+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 realm 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.499 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.498+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.499+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:44.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.499+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.499+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:44.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.499+0000 7ff74d444800 20 searching for the correct realm 2024-02-23T06:41:44.502 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.502+0000 7ff742542640 0 -- 172.21.15.142:0/2572476438 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7ff73c06d0f0 msgr2=0x7ff73c062a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:44.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.707+0000 7ff74ad43640 0 -- 172.21.15.142:0/2572476438 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7ff7340b4b80 msgr2=0x7ff73406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:44.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:44.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:44.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.913+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 zone default found 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 4 Realm: () 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:44.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:44.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 zonegroup default 2024-02-23T06:41:44.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.914+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.915+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.915+0000 7ff74d444800 20 started sync module instance, tier type = 2024-02-23T06:41:44.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.915+0000 7ff74d444800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:44.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=0 2024-02-23T06:41:44.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=1 2024-02-23T06:41:44.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=2 2024-02-23T06:41:44.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=3 2024-02-23T06:41:44.925 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=4 2024-02-23T06:41:44.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=5 2024-02-23T06:41:44.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.925+0000 7ff74d444800 20 add_watcher() i=6 2024-02-23T06:41:44.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.926+0000 7ff74d444800 20 add_watcher() i=7 2024-02-23T06:41:44.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.926+0000 7ff74d444800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:44.928 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.927+0000 7ff6017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff74d444800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff74d444800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff74d444800 5 note: GC not initialized 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff57bfff640 20 reqs_thread_entry: start 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff74d444800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff74d444800 20 Filter name: none 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff579ffb640 20 reqs_thread_entry: start 2024-02-23T06:41:44.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.928+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.929+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:44.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.929+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.929+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:44.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.929+0000 7ff74d444800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:44.930 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.930+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.930+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:44.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.930+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.930+0000 7ff74d444800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:44.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.930+0000 7ff74d444800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:44.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.931+0000 7ff74d444800 20 rados->read ofs=0 len=0 2024-02-23T06:41:44.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.931+0000 7ff74d444800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:44.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.932+0000 7ff6017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:44.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.934+0000 7ff74d444800 20 remove_watcher() i=0 2024-02-23T06:41:44.935 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.934+0000 7ff74d444800 2 removed watcher, disabling cache 2024-02-23T06:41:44.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.936+0000 7ff74d444800 20 remove_watcher() i=1 2024-02-23T06:41:44.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.937+0000 7ff74d444800 20 remove_watcher() i=2 2024-02-23T06:41:44.938 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.938+0000 7ff74d444800 20 remove_watcher() i=3 2024-02-23T06:41:44.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.939+0000 7ff74d444800 20 remove_watcher() i=4 2024-02-23T06:41:44.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.940+0000 7ff74d444800 20 remove_watcher() i=5 2024-02-23T06:41:44.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.941+0000 7ff74d444800 20 remove_watcher() i=6 2024-02-23T06:41:44.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:44.942+0000 7ff74d444800 20 remove_watcher() i=7 2024-02-23T06:41:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:44.952 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:44.952 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-do-reshard id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:44.952 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:44.954 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-02-23T06:41:44.987 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:44.987 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:45.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.020+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 realm 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.022 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.021+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.022+0000 7f61184c0800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.022+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.022+0000 7f61184c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:45.023 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.022+0000 7f61184c0800 20 searching for the correct realm 2024-02-23T06:41:45.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.026+0000 7f610ffff640 0 -- 172.21.15.142:0/3333375342 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x558fe3360fe0 msgr2=0x558fe33634a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:45.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.029+0000 7f6115da3640 0 -- 172.21.15.142:0/3333375342 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f6100058070 msgr2=0x7f6100079a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.033+0000 7f61184c0800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 zone default found 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 4 Realm: () 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 zonegroup default 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.034+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.035+0000 7f61184c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.035+0000 7f61184c0800 20 started sync module instance, tier type = 2024-02-23T06:41:45.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.035+0000 7f61184c0800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:45.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=0 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=1 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=2 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=3 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=4 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=5 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.043+0000 7f61184c0800 20 add_watcher() i=6 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.044+0000 7f61184c0800 20 add_watcher() i=7 2024-02-23T06:41:45.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.044+0000 7f61184c0800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:45.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.045+0000 7f5fc77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 5 note: GC not initialized 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f5fc67fc640 20 reqs_thread_entry: start 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 20 Filter name: none 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f5f37fff640 20 reqs_thread_entry: start 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-02-23T06:41:45.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.046+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 : miss 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:45.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:45.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.049 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.047+0000 7f61184c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 2024-02-23T06:41:45.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f61184c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.052 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f61184c0800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f61184c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f61184c0800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27, ofs0, ns] 2024-02-23T06:41:45.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f5ff97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693264 cookie 94076480679360 notifier 6551 bl.length()=873 2024-02-23T06:41:45.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f5ff97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f5ff97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.053 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.052+0000 7f5ff97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.053+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_sources= new_sources= 2024-02-23T06:41:45.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.053+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential sources added=[] removed=[] 2024-02-23T06:41:45.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.053+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_dests= new_dests= 2024-02-23T06:41:45.054 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.053+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential dests added=[] removed=[] 2024-02-23T06:41:45.055 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.055+0000 7f61184c0800 -1 Injecting error=-5 at location=do_reshard 2024-02-23T06:41:45.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.060+0000 7f61184c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 : hit (requested=0x17, cached=0x17) 2024-02-23T06:41:45.060 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.060+0000 7f61184c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 2024-02-23T06:41:45.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f61184c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f61184c0800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f61184c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f61184c0800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27, ofs0, ns] 2024-02-23T06:41:45.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f5ff8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693265 cookie 94076480679360 notifier 6551 bl.length()=841 2024-02-23T06:41:45.062 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f5ff8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f5ff8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.061+0000 7f5ff8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.062+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_sources= new_sources= 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.062+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential sources added=[] removed=[] 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.062+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_dests= new_dests= 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.062+0000 7f61184c0800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential dests added=[] removed=[] 2024-02-23T06:41:45.063 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.062+0000 7f61184c0800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-02-23T06:41:45.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.063+0000 7f5fc77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:45.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.066+0000 7f61184c0800 20 remove_watcher() i=0 2024-02-23T06:41:45.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.066+0000 7f61184c0800 2 removed watcher, disabling cache 2024-02-23T06:41:45.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.067+0000 7f61184c0800 20 remove_watcher() i=1 2024-02-23T06:41:45.068 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.068+0000 7f61184c0800 20 remove_watcher() i=2 2024-02-23T06:41:45.069 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.069+0000 7f61184c0800 20 remove_watcher() i=3 2024-02-23T06:41:45.071 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.071+0000 7f61184c0800 20 remove_watcher() i=4 2024-02-23T06:41:45.072 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.071+0000 7f61184c0800 20 remove_watcher() i=5 2024-02-23T06:41:45.073 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.072+0000 7f61184c0800 20 remove_watcher() i=6 2024-02-23T06:41:45.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.074+0000 7f61184c0800 20 remove_watcher() i=7 2024-02-23T06:41:45.085 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-02-23T06:41:45.113 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:45.113 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:45.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.145+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 realm 2024-02-23T06:41:45.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.148 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:45.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.148+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.149+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.149+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.149 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.149+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:45.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.149+0000 7eff5ef24800 20 searching for the correct realm 2024-02-23T06:41:45.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.152+0000 7eff5b1a4640 0 -- 172.21.15.142:0/1427638461 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7eff44068390 msgr2=0x7eff44020770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:45.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.155+0000 7eff5a9a3640 0 -- 172.21.15.142:0/1427638461 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7eff440661f0 msgr2=0x7eff44089820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:45.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:45.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:45.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:45.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:45.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:45.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:45.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.361+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.363 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 zone default found 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 4 Realm: () 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 zonegroup default 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.362+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.363+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.363+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.363+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.363+0000 7eff5ef24800 20 started sync module instance, tier type = 2024-02-23T06:41:45.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.363+0000 7eff5ef24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.373+0000 7eff5ef24800 20 add_watcher() i=0 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.373+0000 7eff5ef24800 20 add_watcher() i=1 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.373+0000 7eff5ef24800 20 add_watcher() i=2 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.373+0000 7eff5ef24800 20 add_watcher() i=3 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.373+0000 7eff5ef24800 20 add_watcher() i=4 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.373+0000 7eff5ef24800 20 add_watcher() i=5 2024-02-23T06:41:45.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.374+0000 7eff5ef24800 20 add_watcher() i=6 2024-02-23T06:41:45.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.374+0000 7eff5ef24800 20 add_watcher() i=7 2024-02-23T06:41:45.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.374+0000 7eff5ef24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:45.376 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.376+0000 7efe117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.376+0000 7eff5ef24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.376+0000 7eff5ef24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.376+0000 7eff5ef24800 5 note: GC not initialized 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7efd8bfff640 20 reqs_thread_entry: start 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7eff5ef24800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7eff5ef24800 20 Filter name: none 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7efd89ffb640 20 reqs_thread_entry: start 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:45.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.377+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.378+0000 7eff5ef24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:45.380 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.379+0000 7eff5ef24800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.379+0000 7eff5ef24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.381 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.380+0000 7efe117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:45.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.382+0000 7eff5ef24800 20 remove_watcher() i=0 2024-02-23T06:41:45.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.382+0000 7eff5ef24800 2 removed watcher, disabling cache 2024-02-23T06:41:45.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.383+0000 7eff5ef24800 20 remove_watcher() i=1 2024-02-23T06:41:45.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.384+0000 7eff5ef24800 20 remove_watcher() i=2 2024-02-23T06:41:45.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.385+0000 7eff5ef24800 20 remove_watcher() i=3 2024-02-23T06:41:45.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.386+0000 7eff5ef24800 20 remove_watcher() i=4 2024-02-23T06:41:45.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.387+0000 7eff5ef24800 20 remove_watcher() i=5 2024-02-23T06:41:45.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.388+0000 7eff5ef24800 20 remove_watcher() i=6 2024-02-23T06:41:45.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.389+0000 7eff5ef24800 20 remove_watcher() i=7 2024-02-23T06:41:45.399 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:45.399 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:45.399 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-do-reshard id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:45.399 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:45.452 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:41:45.482 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:45.482 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:45.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.515+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 realm 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.517 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.516+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.517+0000 7faa92f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.517+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.517+0000 7faa92f33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:45.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.517+0000 7faa92f33800 20 searching for the correct realm 2024-02-23T06:41:45.520 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.520+0000 7faa8f24c640 0 -- 172.21.15.142:0/3173492269 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7faa7806b970 msgr2=0x7faa78001930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:45.524 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.523+0000 7faa8ea4b640 0 -- 172.21.15.142:0/3173492269 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7faa780982f0 msgr2=0x7faa78017730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:45.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:45.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:45.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:45.734 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:45.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:45.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:45.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.729+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:45.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 zone default found 2024-02-23T06:41:45.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 4 Realm: () 2024-02-23T06:41:45.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:45.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:45.737 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:45.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 zonegroup default 2024-02-23T06:41:45.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.730+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.731+0000 7faa92f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.731+0000 7faa92f33800 20 started sync module instance, tier type = 2024-02-23T06:41:45.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.731+0000 7faa92f33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:45.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=0 2024-02-23T06:41:45.741 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=1 2024-02-23T06:41:45.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=2 2024-02-23T06:41:45.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=3 2024-02-23T06:41:45.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=4 2024-02-23T06:41:45.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=5 2024-02-23T06:41:45.742 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=6 2024-02-23T06:41:45.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 20 add_watcher() i=7 2024-02-23T06:41:45.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.741+0000 7faa92f33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:45.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.743+0000 7fa9457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:45.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:45.746 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 5 note: GC not initialized 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7fa8bffff640 20 reqs_thread_entry: start 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 Filter name: none 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7fa8bdffb640 20 reqs_thread_entry: start 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 : miss 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.744+0000 7faa92f33800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.745+0000 7faa92f33800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.745+0000 7faa92f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.745+0000 7faa92f33800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.745+0000 7faa92f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.745+0000 7faa92f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.745+0000 7faa92f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 2024-02-23T06:41:45.751 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27, ofs0, ns] 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7fa9727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693266 cookie 94495021920240 notifier 6584 bl.length()=873 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7fa9727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7fa9727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7fa9727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_sources= new_sources= 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential sources added=[] removed=[] 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_dests= new_dests= 2024-02-23T06:41:45.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.751+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential dests added=[] removed=[] 2024-02-23T06:41:45.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.0 2024-02-23T06:41:45.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.0 2024-02-23T06:41:45.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.1 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.1 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.2 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.2 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.3 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.3 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.4 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.4 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.5 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.5 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.6 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.6 2024-02-23T06:41:45.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.7 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.7 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.8 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.8 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.9 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.9 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.10 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.10 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.11 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1.11 2024-02-23T06:41:45.758 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.0 2024-02-23T06:41:45.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.756+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.1 2024-02-23T06:41:45.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.757+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.2 2024-02-23T06:41:45.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.758+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.3 2024-02-23T06:41:45.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.758+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.4 2024-02-23T06:41:45.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.759+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.5 2024-02-23T06:41:45.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.759+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.6 2024-02-23T06:41:45.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.759+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.7 2024-02-23T06:41:45.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.760+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.8 2024-02-23T06:41:45.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.761+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.9 2024-02-23T06:41:45.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.761+0000 7faa92f33800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27.10 2024-02-23T06:41:45.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.764+0000 7faa92f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 : hit (requested=0x17, cached=0x17) 2024-02-23T06:41:45.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.764+0000 7faa92f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7faa92f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7faa92f33800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7faa92f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7faa92f33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27, ofs0, ns] 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7fa9727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693267 cookie 94495021920240 notifier 6584 bl.length()=841 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7fa9727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 info.flags=0x17 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7fa9727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 to cache LRU end 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.765+0000 7fa9727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:45.766 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.766+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_sources= new_sources= 2024-02-23T06:41:45.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.766+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential sources added=[] removed=[] 2024-02-23T06:41:45.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.766+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): orig_dests= new_dests= 2024-02-23T06:41:45.767 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.766+0000 7faa92f33800 20 handle_bi_update(): bucket=:error-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27]): potential dests added=[] removed=[] 2024-02-23T06:41:45.768 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.768+0000 7faa92f33800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-02-23T06:41:45.770 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.770+0000 7fa9457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:45.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.772+0000 7faa92f33800 20 remove_watcher() i=0 2024-02-23T06:41:45.772 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.772+0000 7faa92f33800 2 removed watcher, disabling cache 2024-02-23T06:41:45.773 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.773+0000 7faa92f33800 20 remove_watcher() i=1 2024-02-23T06:41:45.774 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.774+0000 7faa92f33800 20 remove_watcher() i=2 2024-02-23T06:41:45.775 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.775+0000 7faa92f33800 20 remove_watcher() i=3 2024-02-23T06:41:45.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.776+0000 7faa92f33800 20 remove_watcher() i=4 2024-02-23T06:41:45.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.777+0000 7faa92f33800 20 remove_watcher() i=5 2024-02-23T06:41:45.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.778+0000 7faa92f33800 20 remove_watcher() i=6 2024-02-23T06:41:45.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.778+0000 7faa92f33800 20 remove_watcher() i=7 2024-02-23T06:41:45.790 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-02-23T06:41:45.817 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:45.817 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:45.850 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.849+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.851 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 realm 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:45.852 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.851+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.852+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:45.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.852+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:45.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.852+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:45.853 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.852+0000 7feec8613800 20 searching for the correct realm 2024-02-23T06:41:45.855 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.855+0000 7feec664c640 0 -- 172.21.15.142:0/560336465 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7feeb0076070 msgr2=0x7feeb0084420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:45.860 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:45.858+0000 7feec5e4b640 0 -- 172.21.15.142:0/560336465 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7feeb0077910 msgr2=0x7feeb0076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:46.064 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.063+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.065 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 zone default found 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 4 Realm: () 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 zonegroup default 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.066 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.064+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.065+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.065+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.065+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.065+0000 7feec8613800 20 started sync module instance, tier type = 2024-02-23T06:41:46.067 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.065+0000 7feec8613800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.073+0000 7feec8613800 20 add_watcher() i=0 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.073+0000 7feec8613800 20 add_watcher() i=1 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 20 add_watcher() i=2 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 20 add_watcher() i=3 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 20 add_watcher() i=4 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 20 add_watcher() i=5 2024-02-23T06:41:46.074 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 20 add_watcher() i=6 2024-02-23T06:41:46.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 20 add_watcher() i=7 2024-02-23T06:41:46.075 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.074+0000 7feec8613800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:46.076 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7fed777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:46.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7feec8613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:46.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7feec8613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:46.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7feec8613800 5 note: GC not initialized 2024-02-23T06:41:46.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7fed767fc640 20 reqs_thread_entry: start 2024-02-23T06:41:46.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7feec8613800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:46.077 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.076+0000 7feec8613800 20 Filter name: none 2024-02-23T06:41:46.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7fece7fff640 20 reqs_thread_entry: start 2024-02-23T06:41:46.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:46.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:46.078 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7feec8613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.077+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.078+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.078+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.078+0000 7feec8613800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.078+0000 7feec8613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.079+0000 7feec8613800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.079 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.079+0000 7feec8613800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.080 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.080+0000 7fed777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:46.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.082+0000 7feec8613800 20 remove_watcher() i=0 2024-02-23T06:41:46.082 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.082+0000 7feec8613800 2 removed watcher, disabling cache 2024-02-23T06:41:46.083 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.083+0000 7feec8613800 20 remove_watcher() i=1 2024-02-23T06:41:46.084 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.084+0000 7feec8613800 20 remove_watcher() i=2 2024-02-23T06:41:46.085 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.085+0000 7feec8613800 20 remove_watcher() i=3 2024-02-23T06:41:46.086 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.086+0000 7feec8613800 20 remove_watcher() i=4 2024-02-23T06:41:46.087 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.087+0000 7feec8613800 20 remove_watcher() i=5 2024-02-23T06:41:46.088 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.087+0000 7feec8613800 20 remove_watcher() i=6 2024-02-23T06:41:46.089 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.088+0000 7feec8613800 20 remove_watcher() i=7 2024-02-23T06:41:46.098 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:46.098 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:46.098 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: error-at-do-reshard id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:41:46.098 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:46.192 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: reshard bucket with abort at do_reshard 2024-02-23T06:41:46.193 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:46.401 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-02-23T06:41:46.429 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:46.429 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:46.461 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.460+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 realm 2024-02-23T06:41:46.462 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:46.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.462+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.463 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.463+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:46.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.463+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.463+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:46.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.463+0000 7fbe9a413800 20 searching for the correct realm 2024-02-23T06:41:46.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.466+0000 7fbe95fa4640 0 -- 172.21.15.142:0/1427018574 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fbe80038070 msgr2=0x7fbe80038960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:46.469 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.469+0000 7fbe957a3640 0 -- 172.21.15.142:0/1427018574 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fbe80039910 msgr2=0x7fbe800453f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:46.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:46.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.675+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 zone default found 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 4 Realm: () 2024-02-23T06:41:46.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:46.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:46.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:46.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 zonegroup default 2024-02-23T06:41:46.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.676+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.677+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.677+0000 7fbe9a413800 20 started sync module instance, tier type = 2024-02-23T06:41:46.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.677+0000 7fbe9a413800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:46.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=0 2024-02-23T06:41:46.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=1 2024-02-23T06:41:46.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=2 2024-02-23T06:41:46.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=3 2024-02-23T06:41:46.686 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=4 2024-02-23T06:41:46.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=5 2024-02-23T06:41:46.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.686+0000 7fbe9a413800 20 add_watcher() i=6 2024-02-23T06:41:46.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.687+0000 7fbe9a413800 20 add_watcher() i=7 2024-02-23T06:41:46.687 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.687+0000 7fbe9a413800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.688+0000 7fbd4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbe9a413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbe9a413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbe9a413800 5 note: GC not initialized 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbd4a7e4640 20 reqs_thread_entry: start 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbe9a413800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbe9a413800 20 Filter name: none 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbcbbfff640 20 reqs_thread_entry: start 2024-02-23T06:41:46.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.689+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.690+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.690+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.690+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.690+0000 7fbe9a413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.690+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.691+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:46.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.691+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.691+0000 7fbe9a413800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:46.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.691+0000 7fbe9a413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:46.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.692+0000 7fbe9a413800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.692+0000 7fbe9a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.693+0000 7fbd4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:46.695 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.695+0000 7fbe9a413800 20 remove_watcher() i=0 2024-02-23T06:41:46.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.695+0000 7fbe9a413800 2 removed watcher, disabling cache 2024-02-23T06:41:46.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.696+0000 7fbe9a413800 20 remove_watcher() i=1 2024-02-23T06:41:46.698 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.697+0000 7fbe9a413800 20 remove_watcher() i=2 2024-02-23T06:41:46.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.698+0000 7fbe9a413800 20 remove_watcher() i=3 2024-02-23T06:41:46.700 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.699+0000 7fbe9a413800 20 remove_watcher() i=4 2024-02-23T06:41:46.701 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.700+0000 7fbe9a413800 20 remove_watcher() i=5 2024-02-23T06:41:46.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.701+0000 7fbe9a413800 20 remove_watcher() i=6 2024-02-23T06:41:46.702 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.702+0000 7fbe9a413800 20 remove_watcher() i=7 2024-02-23T06:41:46.712 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:46.712 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:46.712 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-do-reshard id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:46.712 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:46.713 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-02-23T06:41:46.746 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:46.747 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:46.780 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.779+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.780+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.780+0000 7f8617030800 20 realm 2024-02-23T06:41:46.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.780+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.781+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.781 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.781+0000 7f8617030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:46.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.781+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.781+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.781+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.782 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.782+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:46.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.782+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.782+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:46.783 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.782+0000 7f8617030800 20 searching for the correct realm 2024-02-23T06:41:46.785 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.785+0000 7f860984a640 0 -- 172.21.15.142:0/2796695832 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f8604043040 msgr2=0x7f8604042920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:46.789 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.788+0000 7f861204b640 0 -- 172.21.15.142:0/2796695832 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f85fc05ef00 msgr2=0x7f85fc027600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:46.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:46.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:46.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:46.994 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.993+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:46.995 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:46.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 zone default found 2024-02-23T06:41:46.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 4 Realm: () 2024-02-23T06:41:46.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:46.996 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 zonegroup default 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 started sync module instance, tier type = 2024-02-23T06:41:46.997 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:46.995+0000 7f8617030800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=0 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=1 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=2 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=3 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=4 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=5 2024-02-23T06:41:47.005 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=6 2024-02-23T06:41:47.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.005+0000 7f8617030800 20 add_watcher() i=7 2024-02-23T06:41:47.006 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.005+0000 7f8617030800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:47.007 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.007+0000 7f84c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.007+0000 7f8617030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.007+0000 7f8617030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.007+0000 7f8617030800 5 note: GC not initialized 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.007+0000 7f84437fe640 20 reqs_thread_entry: start 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.007+0000 7f8617030800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 20 Filter name: none 2024-02-23T06:41:47.008 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f84417fa640 20 reqs_thread_entry: start 2024-02-23T06:41:47.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-02-23T06:41:47.009 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 : miss 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.008+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.009+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.009+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.009+0000 7f8617030800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.009+0000 7f8617030800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.009+0000 7f8617030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.010 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.009+0000 7f8617030800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 2024-02-23T06:41:47.014 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f8617030800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f8617030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f8617030800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28, ofs0, ns] 2024-02-23T06:41:47.015 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693271 cookie 94263881799008 notifier 6635 bl.length()=873 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_sources= new_sources= 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential sources added=[] removed=[] 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_dests= new_dests= 2024-02-23T06:41:47.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential dests added=[] removed=[] 2024-02-23T06:41:47.017 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8617030800 time 2024-02-23T06:41:47.017727+0000 2024-02-23T06:41:47.017 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:47.017 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.017 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8617b80e86] 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.017+0000 7f8617030800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8617030800 time 2024-02-23T06:41:47.017727+0000 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8617b80e86] 2024-02-23T06:41:47.018 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr:*** Caught signal (Aborted) ** 2024-02-23T06:41:47.019 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f8617030800 thread_name:radosgw-admin 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8616a54db0] 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8616aa154c] 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8617b80ee0] 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.040 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.018+0000 7f8617030800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f8617030800 thread_name:radosgw-admin 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8616a54db0] 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8616aa154c] 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8617b80ee0] 2024-02-23T06:41:47.041 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:41:46.764+0000 7f8500608640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:41:46.764+0000 7f8500608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:41:46.764+0000 7f8500608640 10 monclient: dump: 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.042 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:41:46.764+0000 7f8617030800 5 monclient: authenticate success, global_id 6969 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:41:46.764+0000 7f8617030800 10 monclient: get_monmap_and_config success 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:41:46.764+0000 7f8617030800 4 set_mon_vals no callback set 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: shutdown 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:41:46.765+0000 7f8617030800 5 asok(0x55bb84fef620) unregister_commands rotate-key 2024-02-23T06:41:47.043 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:41:46.765+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding auth protocol: cephx 2024-02-23T06:41:47.044 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding auth protocol: cephx 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding auth protocol: cephx 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.045 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:41:46.765+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: starting msgr at 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: starting objecter 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:41:46.765+0000 7f8617030800 5 asok(0x55bb84fef620) register_command objecter_requests hook 0x55bb8523a230 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: setting wanted keys 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: calling monclient init 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding auth protocol: cephx 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding auth protocol: cephx 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding auth protocol: cephx 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.046 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:41:46.765+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:41:46.766+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:41:46.766+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key hook 0x55bb8520b568 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _add_conns ranks=[1,2,0] 2024-02-23T06:41:47.047 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb850b7840 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb850b7c20 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb850c1cd0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.078803s 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): get_auth_request con 0x55bb850c1cd0 auth_method 0 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.048 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb850b7c20 auth_method 0 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb850b7840 auth_method 0 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.049 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_done global_id 6972 payload 824 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:41:46.766+0000 7f861284c640 1 monclient: found mon.noname-a 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: dump: 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.050 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: dump: 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.051 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:41:46.766+0000 7f8617030800 5 monclient: authenticate success, global_id 6972 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:41:46.766+0000 7f8500608640 4 set_mon_vals no callback set 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.052 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:41:46.766+0000 7f8617030800 1 librados: init done 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:41:46.768+0000 7f84fee05640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:41:46.768+0000 7f84fee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:41:46.768+0000 7f84fee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:41:46.768+0000 7f861204b640 10 monclient: get_auth_request con 0x7f84f8069eb0 auth_method 0 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:41:46.768+0000 7f860984a640 10 monclient: get_auth_request con 0x55bb8524e9d0 auth_method 0 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:41:46.769+0000 7f861204b640 10 monclient: get_auth_request con 0x55bb852581a0 auth_method 0 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:41:46.770+0000 7f860984a640 10 monclient: get_auth_request con 0x55bb8525d230 auth_method 0 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:41:46.771+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:41:46.771+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:41:46.771+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.053 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding auth protocol: cephx 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding auth protocol: cephx 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding auth protocol: cephx 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.054 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:41:46.771+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:41:46.771+0000 7f8617030800 5 asok(0x55bb84fef620) register_command objecter_requests cmddesc objecter_requests hook 0x55bb852667d0 EEXIST 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:41:46.771+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.055 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding auth protocol: cephx 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding auth protocol: cephx 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding auth protocol: cephx 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.056 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:41:46.772+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:41:46.772+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:41:46.772+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key cmddesc rotate-key hook 0x55bb85260200 EEXIST 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient: _add_conns ranks=[0,1,2] 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb8528b530 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb8528b910 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb852869d0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.057 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.085055s 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): get_auth_request con 0x55bb852869d0 auth_method 0 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb8528b530 auth_method 0 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb8528b910 auth_method 0 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.058 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_done global_id 6629 payload 824 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:41:46.772+0000 7f861284c640 1 monclient: found mon.noname-c 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.059 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: dump: 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.060 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: dump: 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.061 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:41:46.773+0000 7f8617030800 5 monclient: authenticate success, global_id 6629 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:41:46.773+0000 7f861304d640 4 set_mon_vals no callback set 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:41:46.774+0000 7f84f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:41:46.774+0000 7f84f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:41:46.774+0000 7f84f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:41:46.774+0000 7f861204b640 10 monclient: get_auth_request con 0x7f84ec069dc0 auth_method 0 2024-02-23T06:41:47.062 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:41:46.774+0000 7f8617030800 10 monclient: get_monmap_and_config 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:41:46.774+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:41:46.774+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:41:46.774+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.063 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding auth protocol: cephx 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding auth protocol: cephx 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding auth protocol: cephx 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.064 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:41:46.775+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding auth protocol: cephx 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding auth protocol: cephx 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding auth protocol: cephx 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.065 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:41:46.775+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:41:46.775+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:41:46.775+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key cmddesc rotate-key hook 0x7ffdd25a0b08 EEXIST 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient: _add_conns ranks=[2,1,0] 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb852dd1b0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb852dd590 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb852cf210 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.066 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.088306s 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb852dd1b0 auth_method 0 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): get_auth_request con 0x55bb852cf210 auth_method 0 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.067 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb852dd590 auth_method 0 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_done global_id 6978 payload 274 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:41:46.775+0000 7f861284c640 1 monclient: found mon.noname-a 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.068 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: dump: 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.069 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: dump: 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.070 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:41:46.776+0000 7f8617030800 5 monclient: authenticate success, global_id 6978 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: get_monmap_and_config success 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:41:46.776+0000 7f8617030800 4 set_mon_vals no callback set 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: shutdown 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:41:46.776+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.071 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding auth protocol: cephx 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding auth protocol: cephx 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding auth protocol: cephx 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.072 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.073 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.073 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.094 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.094 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.094 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:41:46.777+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.094 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: starting msgr at 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: starting objecter 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:41:46.777+0000 7f8617030800 5 asok(0x55bb84fef620) register_command objecter_requests cmddesc objecter_requests hook 0x55bb8528be90 EEXIST 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: setting wanted keys 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: calling monclient init 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding auth protocol: cephx 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding auth protocol: cephx 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding auth protocol: cephx 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.095 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:41:46.777+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:41:46.777+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:41:46.777+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key cmddesc rotate-key hook 0x55bb852a8398 EEXIST 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:41:47.096 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb852cf210 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb852dd1b0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb852cbb50 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.090431s 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb852dd1b0 auth_method 0 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb852cf210 auth_method 0 2024-02-23T06:41:47.097 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:41:46.778+0000 7f860984a640 10 monclient(hunting): handle_auth_done global_id 6635 payload 824 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:41:46.778+0000 7f860984a640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:41:46.778+0000 7f860984a640 1 monclient: found mon.noname-c 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:41:46.778+0000 7f860984a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.098 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: dump: 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:41:46.778+0000 7f8617030800 5 monclient: authenticate success, global_id 6635 2024-02-23T06:41:47.099 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: dump: 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.100 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:41:46.778+0000 7f84f5ffb640 4 set_mon_vals no callback set 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:41:46.778+0000 7f8617030800 1 librados: init done 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:41:46.778+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cr dump hook 0x55bb852d5f08 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:41:46.779+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:41:46.780+0000 7f84e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:41:46.780+0000 7f84e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:41:46.780+0000 7f84e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:41:46.780+0000 7f861204b640 10 monclient: get_auth_request con 0x7f84dc069eb0 auth_method 0 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:41:46.780+0000 7f861284c640 10 monclient: get_auth_request con 0x55bb852f7840 auth_method 0 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:41:46.780+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:41:46.780+0000 7f8617030800 20 realm 2024-02-23T06:41:47.101 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:41:46.780+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:41:46.781+0000 7f8617030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:41:46.781+0000 7f861204b640 10 monclient: get_auth_request con 0x55bb852fb9f0 auth_method 0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:41:46.782+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:41:46.782+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:41:46.782+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:41:46.782+0000 7f8617030800 20 searching for the correct realm 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:41:46.782+0000 7f860984a640 10 monclient: get_auth_request con 0x55bb85300cc0 auth_method 0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:41:46.783+0000 7f861284c640 10 monclient: get_auth_request con 0x7f85fc05e7d0 auth_method 0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:41:46.784+0000 7f861204b640 10 monclient: get_auth_request con 0x7f860c05c040 auth_method 0 2024-02-23T06:41:47.102 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:41:46.784+0000 7f860984a640 10 monclient: get_auth_request con 0x7f8604043040 auth_method 0 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:41:46.785+0000 7f860984a640 0 -- 172.21.15.142:0/2796695832 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f8604043040 msgr2=0x7f8604042920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:41:46.785+0000 7f84e3fff640 1 client.6635.objecter ms_handle_reset 0x7f8604043040 session 0x7f860402e070 osd.4 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:41:46.785+0000 7f84e3fff640 10 monclient: _renew_subs 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:41:46.785+0000 7f84e3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:41:46.785+0000 7f860984a640 10 monclient: get_auth_request con 0x7f84dc07a5c0 auth_method 0 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:41:46.786+0000 7f861284c640 10 monclient: get_auth_request con 0x7f85fc0667f0 auth_method 0 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:41:46.788+0000 7f861204b640 10 monclient: get_auth_request con 0x7f85fc05ef00 auth_method 0 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:41:46.788+0000 7f861204b640 0 -- 172.21.15.142:0/2796695832 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f85fc05ef00 msgr2=0x7f85fc027600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:41:46.989+0000 7f861204b640 10 monclient: get_auth_request con 0x7f85fc05ef00 auth_method 0 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:47.103 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:41:46.993+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:41:46.994+0000 7f8617030800 20 zone default found 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:41:46.994+0000 7f8617030800 4 Realm: () 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:41:46.994+0000 7f8617030800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:47.104 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:41:46.994+0000 7f8617030800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:41:46.994+0000 7f8617030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:41:46.994+0000 7f8617030800 20 zonegroup default 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:41:46.995+0000 7f8617030800 20 started sync module instance, tier type = 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:41:46.995+0000 7f8617030800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=0 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=1 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=2 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=3 2024-02-23T06:41:47.105 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=4 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=5 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=6 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:41:47.005+0000 7f8617030800 20 add_watcher() i=7 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:41:47.005+0000 7f8617030800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding auth protocol: cephx 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding auth protocol: cephx 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding auth protocol: cephx 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.106 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:41:47.007+0000 7f84c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:41:47.007+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:41:47.007+0000 7f8617030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:41:47.007+0000 7f8617030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache list hook 0x55bb852aacf0 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache inspect hook 0x55bb852aacf0 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache erase hook 0x55bb852aacf0 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache zap hook 0x55bb852aacf0 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:41:47.007+0000 7f8617030800 5 note: GC not initialized 2024-02-23T06:41:47.107 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:41:47.007+0000 7f84437fe640 20 reqs_thread_entry: start 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace show hook 0x7f860401f040 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace history hook 0x7f860401f040 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace active hook 0x7f860401f040 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace active_short hook 0x7f860401f040 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:41:47.007+0000 7f8617030800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:41:47.008+0000 7f8617030800 20 Filter name: none 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:41:47.008+0000 7f84417fa640 20 reqs_thread_entry: start 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:41:47.008+0000 7f8617030800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:41:47.008+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:41:47.008+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:41:47.008+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:41:47.008+0000 7f8617030800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-02-23T06:41:47.108 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:41:47.008+0000 7f8617030800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 : miss 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:41:47.008+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:41:47.009+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:41:47.009+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:41:47.009+0000 7f8617030800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:41:47.009+0000 7f8617030800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:41:47.009+0000 7f8617030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:41:47.009+0000 7f8617030800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:41:47.013+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:41:47.013+0000 7f8617030800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:41:47.013+0000 7f8617030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:41:47.013+0000 7f8617030800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28, ofs0, ns] 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693271 cookie 94263881799008 notifier 6635 bl.length()=873 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.109 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_sources= new_sources= 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential sources added=[] removed=[] 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_dests= new_dests= 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential dests added=[] removed=[] 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:41:47.017+0000 7f8617030800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8617030800 time 2024-02-23T06:41:47.017727+0000 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8617b80e86] 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.110 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:41:47.018+0000 7f8617030800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f8617030800 thread_name:radosgw-admin 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8616a54db0] 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8616aa154c] 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8617b80ee0] 2024-02-23T06:41:47.111 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:41:47.112 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:41:47.113 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:41:47.114 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:41:47.115 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:41:47.116 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:41:47.117 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:41:47.118 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84417fa640 / http_manager 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84437fe640 / http_manager 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84c8fe1640 / rgw_dt_lg_renew 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84e3fff640 / ms_dispatch 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84f57fa640 / io_context_pool 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84f5ffb640 / io_context_pool 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84f7fff640 / ms_dispatch 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84fee05640 / ms_dispatch 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f8500608640 / io_context_pool 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f860984a640 / msgr-worker-2 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f861204b640 / msgr-worker-1 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f861284c640 / msgr-worker-0 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f861304d640 / io_context_pool 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: 7f8617030800 / radosgw-admin 2024-02-23T06:41:47.119 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/log/ceph/ceph-client.admin.112204.log 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:--- begin dump of recent events --- 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr: -499> 2024-02-23T06:41:46.764+0000 7f8500608640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr: -498> 2024-02-23T06:41:46.764+0000 7f8500608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr: -497> 2024-02-23T06:41:46.764+0000 7f8500608640 10 monclient: dump: 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.120 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -496> 2024-02-23T06:41:46.764+0000 7f8617030800 5 monclient: authenticate success, global_id 6969 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -495> 2024-02-23T06:41:46.764+0000 7f8617030800 10 monclient: get_monmap_and_config success 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -494> 2024-02-23T06:41:46.764+0000 7f8617030800 4 set_mon_vals no callback set 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -493> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: shutdown 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -492> 2024-02-23T06:41:46.765+0000 7f8617030800 5 asok(0x55bb84fef620) unregister_commands rotate-key 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -491> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -490> 2024-02-23T06:41:46.765+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr: -489> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.121 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: -488> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding auth protocol: cephx 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: -487> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding auth protocol: cephx 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: -486> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding auth protocol: cephx 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: -485> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: -484> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.122 INFO:tasks.workunit.client.0.smithi142.stderr: -483> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -482> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -481> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -480> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -479> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -478> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -477> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -476> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -475> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: crc 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -474> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb85212370) adding con mode: secure 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -473> 2024-02-23T06:41:46.765+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -472> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: starting msgr at 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -471> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: starting objecter 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -470> 2024-02-23T06:41:46.765+0000 7f8617030800 5 asok(0x55bb84fef620) register_command objecter_requests hook 0x55bb8523a230 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -469> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: setting wanted keys 2024-02-23T06:41:47.123 INFO:tasks.workunit.client.0.smithi142.stderr: -468> 2024-02-23T06:41:46.765+0000 7f8617030800 1 librados: calling monclient init 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -467> 2024-02-23T06:41:46.765+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -466> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding auth protocol: cephx 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -465> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding auth protocol: cephx 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -464> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding auth protocol: cephx 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -463> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -462> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -461> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -460> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -459> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -458> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -457> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -456> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -455> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.124 INFO:tasks.workunit.client.0.smithi142.stderr: -454> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -453> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: crc 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -452> 2024-02-23T06:41:46.765+0000 7f8617030800 5 AuthRegistry(0x55bb8520b420) adding con mode: secure 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -451> 2024-02-23T06:41:46.765+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -450> 2024-02-23T06:41:46.766+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -449> 2024-02-23T06:41:46.766+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key hook 0x55bb8520b568 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -448> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -447> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _add_conns ranks=[1,2,0] 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -446> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb850b7840 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -445> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb850b7c20 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -444> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb850c1cd0 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -443> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -442> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.125 INFO:tasks.workunit.client.0.smithi142.stderr: -441> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -440> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -439> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.078803s 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -438> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): get_auth_request con 0x55bb850c1cd0 auth_method 0 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -437> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -436> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -435> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -434> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb850b7c20 auth_method 0 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -433> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -432> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -431> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -430> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -429> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -428> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.126 INFO:tasks.workunit.client.0.smithi142.stderr: -427> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb850b7840 auth_method 0 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -426> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -425> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -424> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -423> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -422> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -421> 2024-02-23T06:41:46.766+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -420> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -419> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -418> 2024-02-23T06:41:46.766+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -417> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient(hunting): handle_auth_done global_id 6972 payload 824 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -416> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -415> 2024-02-23T06:41:46.766+0000 7f861284c640 1 monclient: found mon.noname-a 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -414> 2024-02-23T06:41:46.766+0000 7f861284c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.127 INFO:tasks.workunit.client.0.smithi142.stderr: -413> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr: -412> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr: -411> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: dump: 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.128 INFO:tasks.workunit.client.0.smithi142.stderr: -410> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: -409> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: -408> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: -407> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: -406> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: -405> 2024-02-23T06:41:46.766+0000 7f84fee05640 10 monclient: dump: 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.129 INFO:tasks.workunit.client.0.smithi142.stderr: -404> 2024-02-23T06:41:46.766+0000 7f8617030800 5 monclient: authenticate success, global_id 6972 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -403> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -402> 2024-02-23T06:41:46.766+0000 7f8500608640 4 set_mon_vals no callback set 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -401> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -400> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -399> 2024-02-23T06:41:46.766+0000 7f8617030800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -398> 2024-02-23T06:41:46.766+0000 7f8617030800 1 librados: init done 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -397> 2024-02-23T06:41:46.768+0000 7f84fee05640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -396> 2024-02-23T06:41:46.768+0000 7f84fee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -395> 2024-02-23T06:41:46.768+0000 7f84fee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -394> 2024-02-23T06:41:46.768+0000 7f861204b640 10 monclient: get_auth_request con 0x7f84f8069eb0 auth_method 0 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -393> 2024-02-23T06:41:46.768+0000 7f860984a640 10 monclient: get_auth_request con 0x55bb8524e9d0 auth_method 0 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -392> 2024-02-23T06:41:46.769+0000 7f861204b640 10 monclient: get_auth_request con 0x55bb852581a0 auth_method 0 2024-02-23T06:41:47.130 INFO:tasks.workunit.client.0.smithi142.stderr: -391> 2024-02-23T06:41:46.770+0000 7f860984a640 10 monclient: get_auth_request con 0x55bb8525d230 auth_method 0 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr: -390> 2024-02-23T06:41:46.771+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr: -389> 2024-02-23T06:41:46.771+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr: -388> 2024-02-23T06:41:46.771+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr: -387> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding auth protocol: cephx 2024-02-23T06:41:47.131 INFO:tasks.workunit.client.0.smithi142.stderr: -386> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding auth protocol: cephx 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -385> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding auth protocol: cephx 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -384> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -383> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -382> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -381> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -380> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -379> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -378> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -377> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -376> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -375> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -374> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: crc 2024-02-23T06:41:47.132 INFO:tasks.workunit.client.0.smithi142.stderr: -373> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb85260fe0) adding con mode: secure 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -372> 2024-02-23T06:41:46.771+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -371> 2024-02-23T06:41:46.771+0000 7f8617030800 5 asok(0x55bb84fef620) register_command objecter_requests cmddesc objecter_requests hook 0x55bb852667d0 EEXIST 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -370> 2024-02-23T06:41:46.771+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -369> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding auth protocol: cephx 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -368> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding auth protocol: cephx 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -367> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding auth protocol: cephx 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -366> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -365> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -364> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -363> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -362> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -361> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -360> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.133 INFO:tasks.workunit.client.0.smithi142.stderr: -359> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -358> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -357> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -356> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: crc 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -355> 2024-02-23T06:41:46.771+0000 7f8617030800 5 AuthRegistry(0x55bb852600b8) adding con mode: secure 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -354> 2024-02-23T06:41:46.772+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -353> 2024-02-23T06:41:46.772+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -352> 2024-02-23T06:41:46.772+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key cmddesc rotate-key hook 0x55bb85260200 EEXIST 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -351> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -350> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient: _add_conns ranks=[0,1,2] 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -349> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb8528b530 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -348> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb8528b910 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -347> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb852869d0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -346> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.134 INFO:tasks.workunit.client.0.smithi142.stderr: -345> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -344> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -343> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -342> 2024-02-23T06:41:46.772+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.085055s 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -341> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): get_auth_request con 0x55bb852869d0 auth_method 0 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -340> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -339> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -338> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -337> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb8528b530 auth_method 0 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -336> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -335> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -334> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -333> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb8528b910 auth_method 0 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -332> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -331> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.135 INFO:tasks.workunit.client.0.smithi142.stderr: -330> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -329> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -328> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -327> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -326> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -325> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -324> 2024-02-23T06:41:46.772+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -323> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -322> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -321> 2024-02-23T06:41:46.772+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -320> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient(hunting): handle_auth_done global_id 6629 payload 824 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -319> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -318> 2024-02-23T06:41:46.772+0000 7f861284c640 1 monclient: found mon.noname-c 2024-02-23T06:41:47.136 INFO:tasks.workunit.client.0.smithi142.stderr: -317> 2024-02-23T06:41:46.772+0000 7f861284c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr: -316> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr: -315> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr: -314> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: dump: 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr: -313> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.137 INFO:tasks.workunit.client.0.smithi142.stderr: -312> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr: -311> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr: -310> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr: -309> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr: -308> 2024-02-23T06:41:46.773+0000 7f84f7fff640 10 monclient: dump: 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.138 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -307> 2024-02-23T06:41:46.773+0000 7f8617030800 5 monclient: authenticate success, global_id 6629 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -306> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -305> 2024-02-23T06:41:46.773+0000 7f861304d640 4 set_mon_vals no callback set 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -304> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -303> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -302> 2024-02-23T06:41:46.773+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -301> 2024-02-23T06:41:46.774+0000 7f84f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -300> 2024-02-23T06:41:46.774+0000 7f84f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -299> 2024-02-23T06:41:46.774+0000 7f84f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -298> 2024-02-23T06:41:46.774+0000 7f861204b640 10 monclient: get_auth_request con 0x7f84ec069dc0 auth_method 0 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -297> 2024-02-23T06:41:46.774+0000 7f8617030800 10 monclient: get_monmap_and_config 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -296> 2024-02-23T06:41:46.774+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -295> 2024-02-23T06:41:46.774+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.139 INFO:tasks.workunit.client.0.smithi142.stderr: -294> 2024-02-23T06:41:46.774+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr: -293> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding auth protocol: cephx 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr: -292> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding auth protocol: cephx 2024-02-23T06:41:47.140 INFO:tasks.workunit.client.0.smithi142.stderr: -291> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding auth protocol: cephx 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -290> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -289> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -288> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -287> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -286> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -285> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -284> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -283> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -282> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -281> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -280> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: crc 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -279> 2024-02-23T06:41:46.774+0000 7f8617030800 5 AuthRegistry(0x55bb852a9080) adding con mode: secure 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -278> 2024-02-23T06:41:46.775+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.141 INFO:tasks.workunit.client.0.smithi142.stderr: -277> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -276> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding auth protocol: cephx 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -275> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding auth protocol: cephx 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -274> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding auth protocol: cephx 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -273> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -272> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -271> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -270> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -269> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -268> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -267> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -266> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -265> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -264> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.142 INFO:tasks.workunit.client.0.smithi142.stderr: -263> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: crc 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -262> 2024-02-23T06:41:46.775+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a09c0) adding con mode: secure 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -261> 2024-02-23T06:41:46.775+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -260> 2024-02-23T06:41:46.775+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -259> 2024-02-23T06:41:46.775+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key cmddesc rotate-key hook 0x7ffdd25a0b08 EEXIST 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -258> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -257> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient: _add_conns ranks=[2,1,0] 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -256> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb852dd1b0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -255> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb852dd590 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -254> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb852cf210 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -253> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -252> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -251> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -250> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -249> 2024-02-23T06:41:46.775+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.088306s 2024-02-23T06:41:47.143 INFO:tasks.workunit.client.0.smithi142.stderr: -248> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb852dd1b0 auth_method 0 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -247> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -246> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -245> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -244> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): get_auth_request con 0x55bb852cf210 auth_method 0 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -243> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -242> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -241> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -240> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -239> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -238> 2024-02-23T06:41:46.775+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -237> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -236> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.144 INFO:tasks.workunit.client.0.smithi142.stderr: -235> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -234> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb852dd590 auth_method 0 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -233> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -232> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -231> 2024-02-23T06:41:46.775+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -230> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient(hunting): handle_auth_done global_id 6978 payload 274 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -229> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -228> 2024-02-23T06:41:46.775+0000 7f861284c640 1 monclient: found mon.noname-a 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -227> 2024-02-23T06:41:46.775+0000 7f861284c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.142:3300/0 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -226> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -225> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr: -224> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: dump: 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.145 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: -223> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: -222> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: -221> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: -220> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: -219> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr: -218> 2024-02-23T06:41:46.776+0000 7f84f5ffb640 10 monclient: dump: 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.146 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -217> 2024-02-23T06:41:46.776+0000 7f8617030800 5 monclient: authenticate success, global_id 6978 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -216> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: get_monmap_and_config success 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -215> 2024-02-23T06:41:46.776+0000 7f8617030800 4 set_mon_vals no callback set 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -214> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: shutdown 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -213> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: build_initial_monmap 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -212> 2024-02-23T06:41:46.776+0000 7f8617030800 1 build_initial for_mkfs: 0 2024-02-23T06:41:47.147 INFO:tasks.workunit.client.0.smithi142.stderr: -211> 2024-02-23T06:41:46.776+0000 7f8617030800 10 monclient: monmap: 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 0 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 0.000000 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:created 0.000000 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 0 (unknown) 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.noname-a 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.noname-c 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr: -210> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding auth protocol: cephx 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr: -209> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding auth protocol: cephx 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr: -208> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding auth protocol: cephx 2024-02-23T06:41:47.148 INFO:tasks.workunit.client.0.smithi142.stderr: -207> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -206> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -205> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -204> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -203> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -202> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -201> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -200> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -199> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -198> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -197> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: crc 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -196> 2024-02-23T06:41:46.776+0000 7f8617030800 5 AuthRegistry(0x55bb852ae020) adding con mode: secure 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -195> 2024-02-23T06:41:46.777+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -194> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: starting msgr at 2024-02-23T06:41:47.149 INFO:tasks.workunit.client.0.smithi142.stderr: -193> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: starting objecter 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -192> 2024-02-23T06:41:46.777+0000 7f8617030800 5 asok(0x55bb84fef620) register_command objecter_requests cmddesc objecter_requests hook 0x55bb8528be90 EEXIST 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -191> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: setting wanted keys 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -190> 2024-02-23T06:41:46.777+0000 7f8617030800 1 librados: calling monclient init 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -189> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient: init 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -188> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding auth protocol: cephx 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -187> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding auth protocol: cephx 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -186> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding auth protocol: cephx 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -185> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -184> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -183> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -182> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -181> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.150 INFO:tasks.workunit.client.0.smithi142.stderr: -180> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -179> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -178> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -177> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -176> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -175> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: crc 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -174> 2024-02-23T06:41:46.777+0000 7f8617030800 5 AuthRegistry(0x55bb852a8250) adding con mode: secure 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -173> 2024-02-23T06:41:46.777+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -172> 2024-02-23T06:41:46.777+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -171> 2024-02-23T06:41:46.777+0000 7f8617030800 5 asok(0x55bb84fef620) register_command rotate-key cmddesc rotate-key hook 0x55bb852a8398 EEXIST 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -170> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient: _reopen_session rank -1 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -169> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient: _add_conns ranks=[0,2,1] 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -168> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): picked mon.noname-a con 0x55bb852cf210 addr [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-23T06:41:47.151 INFO:tasks.workunit.client.0.smithi142.stderr: -167> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): picked mon.noname-c con 0x55bb852dd1b0 addr [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -166> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): picked mon.noname-b con 0x55bb852cbb50 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -165> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -164> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -163> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): start opening mon connection 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -162> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): _renew_subs 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -161> 2024-02-23T06:41:46.777+0000 7f8617030800 10 monclient(hunting): authenticate will time out at 1658.090431s 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -160> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): get_auth_request con 0x55bb852dd1b0 auth_method 0 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -159> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.152 INFO:tasks.workunit.client.0.smithi142.stderr: -158> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -157> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -156> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): get_auth_request con 0x55bb852cf210 auth_method 0 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -155> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -154> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): _init_auth method 2 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -153> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): _init_auth creating new auth 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -152> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -151> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -150> 2024-02-23T06:41:46.777+0000 7f860984a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -149> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -148> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -147> 2024-02-23T06:41:46.777+0000 7f861204b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -146> 2024-02-23T06:41:46.778+0000 7f860984a640 10 monclient(hunting): handle_auth_done global_id 6635 payload 824 2024-02-23T06:41:47.153 INFO:tasks.workunit.client.0.smithi142.stderr: -145> 2024-02-23T06:41:46.778+0000 7f860984a640 10 monclient: _finish_hunting 0 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr: -144> 2024-02-23T06:41:46.778+0000 7f860984a640 1 monclient: found mon.noname-c 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr: -143> 2024-02-23T06:41:46.778+0000 7f860984a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr: -142> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr: -141> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr: -140> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: dump: 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.154 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -139> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: _finish_auth 0 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -138> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: _check_auth_tickets 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -137> 2024-02-23T06:41:46.778+0000 7f8617030800 5 monclient: authenticate success, global_id 6635 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -136> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -135> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -134> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: handle_config config(0 keys) v1 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -133> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -132> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr: -131> 2024-02-23T06:41:46.778+0000 7f84e3fff640 10 monclient: dump: 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr:epoch 1 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr:fsid fe79781e-fbfa-43ae-96f3-8cb6bda71da9 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr:last_changed 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr:created 2024-02-23T06:26:56.630946+0000 2024-02-23T06:41:47.155 INFO:tasks.workunit.client.0.smithi142.stderr:min_mon_release 19 (squid) 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr:election_strategy: 1 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -130> 2024-02-23T06:41:46.778+0000 7f84f5ffb640 4 set_mon_vals no callback set 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -129> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _renew_subs 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -128> 2024-02-23T06:41:46.778+0000 7f8617030800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -127> 2024-02-23T06:41:46.778+0000 7f8617030800 1 librados: init done 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -126> 2024-02-23T06:41:46.778+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cr dump hook 0x55bb852d5f08 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -125> 2024-02-23T06:41:46.779+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -124> 2024-02-23T06:41:46.780+0000 7f84e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-02-23T06:41:47.156 INFO:tasks.workunit.client.0.smithi142.stderr: -123> 2024-02-23T06:41:46.780+0000 7f84e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -122> 2024-02-23T06:41:46.780+0000 7f84e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.142:6832/271480492,v1:172.21.15.142:6833/271480492] 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -121> 2024-02-23T06:41:46.780+0000 7f861204b640 10 monclient: get_auth_request con 0x7f84dc069eb0 auth_method 0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -120> 2024-02-23T06:41:46.780+0000 7f861284c640 10 monclient: get_auth_request con 0x55bb852f7840 auth_method 0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -119> 2024-02-23T06:41:46.780+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -118> 2024-02-23T06:41:46.780+0000 7f8617030800 20 realm 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -117> 2024-02-23T06:41:46.780+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -116> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -115> 2024-02-23T06:41:46.781+0000 7f8617030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -114> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -113> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -112> 2024-02-23T06:41:46.781+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -111> 2024-02-23T06:41:46.781+0000 7f861204b640 10 monclient: get_auth_request con 0x55bb852fb9f0 auth_method 0 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -110> 2024-02-23T06:41:46.782+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:47.157 INFO:tasks.workunit.client.0.smithi142.stderr: -109> 2024-02-23T06:41:46.782+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -108> 2024-02-23T06:41:46.782+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -107> 2024-02-23T06:41:46.782+0000 7f8617030800 20 searching for the correct realm 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -106> 2024-02-23T06:41:46.782+0000 7f860984a640 10 monclient: get_auth_request con 0x55bb85300cc0 auth_method 0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -105> 2024-02-23T06:41:46.783+0000 7f861284c640 10 monclient: get_auth_request con 0x7f85fc05e7d0 auth_method 0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -104> 2024-02-23T06:41:46.784+0000 7f861204b640 10 monclient: get_auth_request con 0x7f860c05c040 auth_method 0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -103> 2024-02-23T06:41:46.784+0000 7f860984a640 10 monclient: get_auth_request con 0x7f8604043040 auth_method 0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -102> 2024-02-23T06:41:46.785+0000 7f860984a640 0 -- 172.21.15.142:0/2796695832 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f8604043040 msgr2=0x7f8604042920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -101> 2024-02-23T06:41:46.785+0000 7f84e3fff640 1 client.6635.objecter ms_handle_reset 0x7f8604043040 session 0x7f860402e070 osd.4 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -100> 2024-02-23T06:41:46.785+0000 7f84e3fff640 10 monclient: _renew_subs 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -99> 2024-02-23T06:41:46.785+0000 7f84e3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.142:3301/0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -98> 2024-02-23T06:41:46.785+0000 7f860984a640 10 monclient: get_auth_request con 0x7f84dc07a5c0 auth_method 0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -97> 2024-02-23T06:41:46.786+0000 7f861284c640 10 monclient: get_auth_request con 0x7f85fc0667f0 auth_method 0 2024-02-23T06:41:47.158 INFO:tasks.workunit.client.0.smithi142.stderr: -96> 2024-02-23T06:41:46.788+0000 7f861204b640 10 monclient: get_auth_request con 0x7f85fc05ef00 auth_method 0 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -95> 2024-02-23T06:41:46.788+0000 7f861204b640 0 -- 172.21.15.142:0/2796695832 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f85fc05ef00 msgr2=0x7f85fc027600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -94> 2024-02-23T06:41:46.989+0000 7f861204b640 10 monclient: get_auth_request con 0x7f85fc05ef00 auth_method 0 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -93> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -92> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -91> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -90> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -89> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -88> 2024-02-23T06:41:46.993+0000 7f8617030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -87> 2024-02-23T06:41:46.993+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -86> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -85> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -84> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:47.159 INFO:tasks.workunit.client.0.smithi142.stderr: -83> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -82> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -81> 2024-02-23T06:41:46.994+0000 7f8617030800 20 zone default found 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -80> 2024-02-23T06:41:46.994+0000 7f8617030800 4 Realm: () 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -79> 2024-02-23T06:41:46.994+0000 7f8617030800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -78> 2024-02-23T06:41:46.994+0000 7f8617030800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -77> 2024-02-23T06:41:46.994+0000 7f8617030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -76> 2024-02-23T06:41:46.994+0000 7f8617030800 20 zonegroup default 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -75> 2024-02-23T06:41:46.994+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -74> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -73> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -72> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -71> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.160 INFO:tasks.workunit.client.0.smithi142.stderr: -70> 2024-02-23T06:41:46.995+0000 7f8617030800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -69> 2024-02-23T06:41:46.995+0000 7f8617030800 20 started sync module instance, tier type = 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -68> 2024-02-23T06:41:46.995+0000 7f8617030800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -67> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=0 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -66> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=1 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -65> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=2 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -64> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=3 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -63> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=4 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -62> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=5 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -61> 2024-02-23T06:41:47.004+0000 7f8617030800 20 add_watcher() i=6 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -60> 2024-02-23T06:41:47.005+0000 7f8617030800 20 add_watcher() i=7 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -59> 2024-02-23T06:41:47.005+0000 7f8617030800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -58> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding auth protocol: cephx 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -57> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding auth protocol: cephx 2024-02-23T06:41:47.161 INFO:tasks.workunit.client.0.smithi142.stderr: -56> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding auth protocol: cephx 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -55> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -54> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -53> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -52> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -51> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -50> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -49> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -48> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -47> 2024-02-23T06:41:47.007+0000 7f84c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -46> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -45> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -44> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: crc 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -43> 2024-02-23T06:41:47.007+0000 7f8617030800 5 AuthRegistry(0x7ffdd25a0e50) adding con mode: secure 2024-02-23T06:41:47.162 INFO:tasks.workunit.client.0.smithi142.stderr: -42> 2024-02-23T06:41:47.007+0000 7f8617030800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -41> 2024-02-23T06:41:47.007+0000 7f8617030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -40> 2024-02-23T06:41:47.007+0000 7f8617030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -39> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache list hook 0x55bb852aacf0 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -38> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache inspect hook 0x55bb852aacf0 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -37> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache erase hook 0x55bb852aacf0 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -36> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command cache zap hook 0x55bb852aacf0 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -35> 2024-02-23T06:41:47.007+0000 7f8617030800 5 note: GC not initialized 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -34> 2024-02-23T06:41:47.007+0000 7f84437fe640 20 reqs_thread_entry: start 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -33> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace show hook 0x7f860401f040 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -32> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace history hook 0x7f860401f040 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -31> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace active hook 0x7f860401f040 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -30> 2024-02-23T06:41:47.007+0000 7f8617030800 5 asok(0x55bb84fef620) register_command sync trace active_short hook 0x7f860401f040 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -29> 2024-02-23T06:41:47.007+0000 7f8617030800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -28> 2024-02-23T06:41:47.008+0000 7f8617030800 20 Filter name: none 2024-02-23T06:41:47.163 INFO:tasks.workunit.client.0.smithi142.stderr: -27> 2024-02-23T06:41:47.008+0000 7f84417fa640 20 reqs_thread_entry: start 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -26> 2024-02-23T06:41:47.008+0000 7f8617030800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -25> 2024-02-23T06:41:47.008+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -24> 2024-02-23T06:41:47.008+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -23> 2024-02-23T06:41:47.008+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -22> 2024-02-23T06:41:47.008+0000 7f8617030800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -21> 2024-02-23T06:41:47.008+0000 7f8617030800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 : miss 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -20> 2024-02-23T06:41:47.008+0000 7f8617030800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -19> 2024-02-23T06:41:47.009+0000 7f8617030800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -18> 2024-02-23T06:41:47.009+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -17> 2024-02-23T06:41:47.009+0000 7f8617030800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -16> 2024-02-23T06:41:47.009+0000 7f8617030800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -15> 2024-02-23T06:41:47.009+0000 7f8617030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.164 INFO:tasks.workunit.client.0.smithi142.stderr: -14> 2024-02-23T06:41:47.009+0000 7f8617030800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -13> 2024-02-23T06:41:47.013+0000 7f8617030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -12> 2024-02-23T06:41:47.013+0000 7f8617030800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -11> 2024-02-23T06:41:47.013+0000 7f8617030800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -10> 2024-02-23T06:41:47.013+0000 7f8617030800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28, ofs0, ns] 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -9> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693271 cookie 94263881799008 notifier 6635 bl.length()=873 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -8> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -7> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -6> 2024-02-23T06:41:47.013+0000 7f84f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -5> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_sources= new_sources= 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -4> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential sources added=[] removed=[] 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -3> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_dests= new_dests= 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -2> 2024-02-23T06:41:47.014+0000 7f8617030800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential dests added=[] removed=[] 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr: -1> 2024-02-23T06:41:47.017+0000 7f8617030800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8617030800 time 2024-02-23T06:41:47.017727+0000 2024-02-23T06:41:47.165 INFO:tasks.workunit.client.0.smithi142.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1668-g1fb7413e/rpm/el9/BUILD/ceph-19.0.0-1668-g1fb7413e/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8617b80e86] 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 5: main() 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 7: __libc_start_main() 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 8: _start() 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 0> 2024-02-23T06:41:47.018+0000 7f8617030800 -1 *** Caught signal (Aborted) ** 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: in thread 7f8617030800 thread_name:radosgw-admin 2024-02-23T06:41:47.166 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8616a54db0] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8616aa154c] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 3: raise() 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 4: abort() 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8617b80ee0] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f8617b81044] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb82fb0c61] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55bb82fbd544] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 9: main() 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8616a3feb0] 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 11: __libc_start_main() 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: 12: _start() 2024-02-23T06:41:47.167 INFO:tasks.workunit.client.0.smithi142.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr:--- logging levels --- 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 none 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 lockdep 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 context 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 crush 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_balancer 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_locker 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_log_expire 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mds_migrator 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 buffer 2024-02-23T06:41:47.168 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 timer 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 filer 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 striper 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 1 objecter 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rados 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_mirror 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_replay 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 rbd_pwl 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 journaler 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objectcacher 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 immutable_obj_cache 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 client 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 osd 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 optracker 2024-02-23T06:41:47.169 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 objclass 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 filestore 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 journal 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 ms 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mon 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 0/10 monc 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 paxos 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 tp 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 auth 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 crypto 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 finisher 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 reserver 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 heartbeatmap 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 perfcounter 2024-02-23T06:41:47.170 INFO:tasks.workunit.client.0.smithi142.stderr: 20/20 rgw 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_sync 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_datacache 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_access 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_dbstore 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_flight 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 rgw_lifecycle 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 javaclient 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 asok 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 1 throttle 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 0 refs 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 compressor 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluestore 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 bluefs 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 3 bdev 2024-02-23T06:41:47.171 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 kstore 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 4/ 5 rocksdb 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 fuse 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 2/ 5 mgr 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mgrc 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 dpdk 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 eventtrace 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 prioritycache 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 test 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephfs_mirror 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cephsqlite 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 crimson_interrupt 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_onode 2024-02-23T06:41:47.172 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_odata 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_omap 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_tm 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_t 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cleaner 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_epm 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_lba 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_fixedkv_tree 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_cache 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_journal 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_device 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 seastore_backref 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 alienstore 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 mclock 2024-02-23T06:41:47.173 INFO:tasks.workunit.client.0.smithi142.stderr: 0/ 5 cyanstore 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 ceph_exporter 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 memstore 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 1/ 5 trace 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: -2/-2 (syslog threshold) 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 99/99 (stderr threshold) 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr:--- pthread ID / name mapping for recent threads --- 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84417fa640 / http_manager 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84437fe640 / http_manager 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84c8fe1640 / rgw_dt_lg_renew 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84e3fff640 / ms_dispatch 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84f57fa640 / io_context_pool 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84f5ffb640 / io_context_pool 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84f7fff640 / ms_dispatch 2024-02-23T06:41:47.174 INFO:tasks.workunit.client.0.smithi142.stderr: 7f84fee05640 / ms_dispatch 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: 7f8500608640 / io_context_pool 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: 7f860984a640 / msgr-worker-2 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: 7f861204b640 / msgr-worker-1 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: 7f861284c640 / msgr-worker-0 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: 7f861304d640 / io_context_pool 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: 7f8617030800 / radosgw-admin 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: max_recent 500 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: max_new 1000 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr: log_file /var/lib/ceph/crash/2024-02-23T06:41:47.019097Z_2bd40c91-57bc-4ac8-89b7-8c0a4cba35ee/log 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr:--- end dump of recent events --- 2024-02-23T06:41:47.175 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.087+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 realm 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:41:47.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.089+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.090+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.090+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.090+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.090+0000 7fa745a12800 20 searching for the correct realm 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.093+0000 7fa7415a4640 0 -- 172.21.15.142:0/1438439875 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fa72802e950 msgr2=0x7fa72802d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:47.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.096+0000 7fa740da3640 0 -- 172.21.15.142:0/1438439875 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fa72801f7a0 msgr2=0x7fa72801c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:41:47.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.302+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 zone default found 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 4 Realm: () 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 zonegroup default 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.303+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.304+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.304+0000 7fa745a12800 20 started sync module instance, tier type = 2024-02-23T06:41:47.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.304+0000 7fa745a12800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:41:47.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=0 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=1 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=2 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=3 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=4 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=5 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.312+0000 7fa745a12800 20 add_watcher() i=6 2024-02-23T06:41:47.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.313+0000 7fa745a12800 20 add_watcher() i=7 2024-02-23T06:41:47.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.313+0000 7fa745a12800 2 all 8 watchers are set, enabling cache 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.314+0000 7fa5f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa745a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa745a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa745a12800 5 note: GC not initialized 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa5f5fe3640 20 reqs_thread_entry: start 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa745a12800 20 init_complete bucket index max shards: 11 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa745a12800 20 Filter name: none 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa5677fe640 20 reqs_thread_entry: start 2024-02-23T06:41:47.316 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.315+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.317 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=403 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.316+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.317+0000 7fa745a12800 20 rados_obj.operate() r=0 bl.length=403 2024-02-23T06:41:47.318 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.317+0000 7fa745a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:41:47.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.318+0000 7fa745a12800 20 rados->read ofs=0 len=0 2024-02-23T06:41:47.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.318+0000 7fa745a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:41:47.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.319+0000 7fa5f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:41:47.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.321+0000 7fa745a12800 20 remove_watcher() i=0 2024-02-23T06:41:47.321 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.321+0000 7fa745a12800 2 removed watcher, disabling cache 2024-02-23T06:41:47.322 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.322+0000 7fa745a12800 20 remove_watcher() i=1 2024-02-23T06:41:47.323 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.323+0000 7fa745a12800 20 remove_watcher() i=2 2024-02-23T06:41:47.324 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.324+0000 7fa745a12800 20 remove_watcher() i=3 2024-02-23T06:41:47.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.325+0000 7fa745a12800 20 remove_watcher() i=4 2024-02-23T06:41:47.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.326+0000 7fa745a12800 20 remove_watcher() i=5 2024-02-23T06:41:47.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.327+0000 7fa745a12800 20 remove_watcher() i=6 2024-02-23T06:41:47.328 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:41:47.328+0000 7fa745a12800 20 remove_watcher() i=7 2024-02-23T06:41:47.338 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:41:47.338 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:41:47.338 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-do-reshard id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-02-23T06:41:47.338 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:17.424 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-02-23T06:42:17.456 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:17.457 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:17.495 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.494+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.495+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.496 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.495+0000 7fe7a3610800 20 realm 2024-02-23T06:42:17.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.495+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.496+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.496+0000 7fe7a3610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:17.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.496+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.496+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.497 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.496+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.497+0000 7fe7a3610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:17.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.497+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.497+0000 7fe7a3610800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:17.498 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.497+0000 7fe7a3610800 20 searching for the correct realm 2024-02-23T06:42:17.500 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.500+0000 7fe79e24a640 0 -- 172.21.15.142:0/43874648 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fe790057810 msgr2=0x7fe790077080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:42:17.505 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.505+0000 7fe79ea4b640 0 -- 172.21.15.142:0/43874648 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fe78806e1f0 msgr2=0x7fe788052600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:17.712 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.711+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:17.713 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 zone default found 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 4 Realm: () 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 zonegroup default 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.712+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 started sync module instance, tier type = 2024-02-23T06:42:17.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.713+0000 7fe7a3610800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:17.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=0 2024-02-23T06:42:17.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=1 2024-02-23T06:42:17.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=2 2024-02-23T06:42:17.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=3 2024-02-23T06:42:17.724 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=4 2024-02-23T06:42:17.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=5 2024-02-23T06:42:17.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.724+0000 7fe7a3610800 20 add_watcher() i=6 2024-02-23T06:42:17.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.725+0000 7fe7a3610800 20 add_watcher() i=7 2024-02-23T06:42:17.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.725+0000 7fe7a3610800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:17.727 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.726+0000 7fe6557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 5 note: GC not initialized 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe5cffff640 20 reqs_thread_entry: start 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 20 Filter name: none 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe5cdffb640 20 reqs_thread_entry: start 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-02-23T06:42:17.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.727+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 : miss 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:42:17.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:42:17.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:42:17.730 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.728+0000 7fe7a3610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe7a3610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe7a3610800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe7a3610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe7a3610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28, ofs0, ns] 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe681ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693273 cookie 94772921369152 notifier 7017 bl.length()=873 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe681ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe681ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:42:17.735 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.734+0000 7fe681ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:42:17.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.735+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_sources= new_sources= 2024-02-23T06:42:17.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.735+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential sources added=[] removed=[] 2024-02-23T06:42:17.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.735+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_dests= new_dests= 2024-02-23T06:42:17.736 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.735+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential dests added=[] removed=[] 2024-02-23T06:42:17.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.0 2024-02-23T06:42:17.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.0 2024-02-23T06:42:17.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.1 2024-02-23T06:42:17.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.1 2024-02-23T06:42:17.738 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.2 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.2 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.3 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.3 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.4 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.4 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.5 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.5 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.6 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.6 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.7 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.7 2024-02-23T06:42:17.739 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.8 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.8 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.9 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.9 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.10 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.10 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.11 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1.11 2024-02-23T06:42:17.740 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.0 2024-02-23T06:42:17.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.738+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.1 2024-02-23T06:42:17.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.739+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.2 2024-02-23T06:42:17.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.740+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.3 2024-02-23T06:42:17.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.740+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.4 2024-02-23T06:42:17.743 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.741+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.5 2024-02-23T06:42:17.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.741+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.6 2024-02-23T06:42:17.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.742+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.7 2024-02-23T06:42:17.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.743+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.8 2024-02-23T06:42:17.744 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.743+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.9 2024-02-23T06:42:17.745 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.744+0000 7fe7a3610800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28.10 2024-02-23T06:42:17.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.747+0000 7fe7a3610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 : hit (requested=0x17, cached=0x17) 2024-02-23T06:42:17.747 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.747+0000 7fe7a3610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 2024-02-23T06:42:17.748 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.748+0000 7fe7a3610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:42:17.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.748+0000 7fe7a3610800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:42:17.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.748+0000 7fe7a3610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:42:17.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.748+0000 7fe7a3610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28, ofs0, ns] 2024-02-23T06:42:17.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.748+0000 7fe6827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693274 cookie 94772921369152 notifier 7017 bl.length()=841 2024-02-23T06:42:17.749 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe6827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 info.flags=0x17 2024-02-23T06:42:17.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe6827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 to cache LRU end 2024-02-23T06:42:17.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe6827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-02-23T06:42:17.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_sources= new_sources= 2024-02-23T06:42:17.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential sources added=[] removed=[] 2024-02-23T06:42:17.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): orig_dests= new_dests= 2024-02-23T06:42:17.750 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.749+0000 7fe7a3610800 20 handle_bi_update(): bucket=:abort-at-do-reshard[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28]): potential dests added=[] removed=[] 2024-02-23T06:42:17.752 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.752+0000 7fe7a3610800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-02-23T06:42:17.754 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.754+0000 7fe6557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:17.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.756+0000 7fe7a3610800 20 remove_watcher() i=0 2024-02-23T06:42:17.756 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.756+0000 7fe7a3610800 2 removed watcher, disabling cache 2024-02-23T06:42:17.757 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.757+0000 7fe7a3610800 20 remove_watcher() i=1 2024-02-23T06:42:17.759 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.758+0000 7fe7a3610800 20 remove_watcher() i=2 2024-02-23T06:42:17.760 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.760+0000 7fe7a3610800 20 remove_watcher() i=3 2024-02-23T06:42:17.761 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.761+0000 7fe7a3610800 20 remove_watcher() i=4 2024-02-23T06:42:17.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.762+0000 7fe7a3610800 20 remove_watcher() i=5 2024-02-23T06:42:17.763 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.763+0000 7fe7a3610800 20 remove_watcher() i=6 2024-02-23T06:42:17.764 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.763+0000 7fe7a3610800 20 remove_watcher() i=7 2024-02-23T06:42:17.775 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-02-23T06:42:17.803 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:17.803 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:17.836 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.836+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 realm 2024-02-23T06:42:17.838 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:17.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:17.839 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.838+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.839+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:17.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.839+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:17.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.839+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:17.840 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.839+0000 7f102e2c0800 20 searching for the correct realm 2024-02-23T06:42:17.842 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:17.842+0000 7f102b3a2640 0 -- 172.21.15.142:0/547055734 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f1024074070 msgr2=0x7f10240584b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.048 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.048+0000 7f102bba3640 0 -- 172.21.15.142:0/547055734 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f10140aa330 msgr2=0x7f10140d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.255 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.254+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.256 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 20 zone default found 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 4 Realm: () 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 20 zonegroup default 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.255+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 started sync module instance, tier type = 2024-02-23T06:42:18.258 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.256+0000 7f102e2c0800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=0 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=1 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=2 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=3 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=4 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=5 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.266+0000 7f102e2c0800 20 add_watcher() i=6 2024-02-23T06:42:18.267 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.267+0000 7f102e2c0800 20 add_watcher() i=7 2024-02-23T06:42:18.268 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.267+0000 7f102e2c0800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:18.269 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f0ee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f102e2c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:18.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f102e2c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:18.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f102e2c0800 5 note: GC not initialized 2024-02-23T06:42:18.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f0ee0fe1640 20 reqs_thread_entry: start 2024-02-23T06:42:18.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f102e2c0800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:18.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f102e2c0800 20 Filter name: none 2024-02-23T06:42:18.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.269+0000 7f0e5a7fc640 20 reqs_thread_entry: start 2024-02-23T06:42:18.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.270+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.270+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:42:18.271 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.270+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.270+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:42:18.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.270+0000 7f102e2c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:18.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.270+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.271+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=187 2024-02-23T06:42:18.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.271+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.271+0000 7f102e2c0800 20 rados_obj.operate() r=0 bl.length=371 2024-02-23T06:42:18.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.271+0000 7f102e2c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:18.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.272+0000 7f102e2c0800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.272+0000 7f102e2c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.273+0000 7f0ee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.275+0000 7f102e2c0800 20 remove_watcher() i=0 2024-02-23T06:42:18.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.275+0000 7f102e2c0800 2 removed watcher, disabling cache 2024-02-23T06:42:18.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.277+0000 7f102e2c0800 20 remove_watcher() i=1 2024-02-23T06:42:18.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.278+0000 7f102e2c0800 20 remove_watcher() i=2 2024-02-23T06:42:18.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.279+0000 7f102e2c0800 20 remove_watcher() i=3 2024-02-23T06:42:18.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.280+0000 7f102e2c0800 20 remove_watcher() i=4 2024-02-23T06:42:18.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.281+0000 7f102e2c0800 20 remove_watcher() i=5 2024-02-23T06:42:18.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.282+0000 7f102e2c0800 20 remove_watcher() i=6 2024-02-23T06:42:18.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.283+0000 7f102e2c0800 20 remove_watcher() i=7 2024-02-23T06:42:18.293 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:18.293 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:42:18.293 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: abort-at-do-reshard id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-02-23T06:42:18.293 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:18.390 INFO:tasks.workunit.client.0.smithi142.stderr: test: reshard versioned bucket 2024-02-23T06:42:18.391 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket myver 2024-02-23T06:42:18.418 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:18.419 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:18.452 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.451+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 realm 2024-02-23T06:42:18.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.453 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:18.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.453+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.454+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.454 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.454+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.454+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:18.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.454+0000 7f792582f800 20 searching for the correct realm 2024-02-23T06:42:18.457 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.457+0000 7f791804a640 0 -- 172.21.15.142:0/4211271848 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x55a7279259e0 msgr2=0x55a727927dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.460 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.460+0000 7f792084b640 0 -- 172.21.15.142:0/4211271848 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f79080860b0 msgr2=0x7f790805e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.464+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 zone default found 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 4 Realm: () 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 zonegroup default 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.465+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.466+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.466+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.466+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.466+0000 7f792582f800 20 started sync module instance, tier type = 2024-02-23T06:42:18.468 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.466+0000 7f792582f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:18.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=0 2024-02-23T06:42:18.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=1 2024-02-23T06:42:18.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=2 2024-02-23T06:42:18.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=3 2024-02-23T06:42:18.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=4 2024-02-23T06:42:18.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=5 2024-02-23T06:42:18.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=6 2024-02-23T06:42:18.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 20 add_watcher() i=7 2024-02-23T06:42:18.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.475+0000 7f792582f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:18.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.477+0000 7f77d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:18.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:18.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 5 note: GC not initialized 2024-02-23T06:42:18.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f77d5fe3640 20 reqs_thread_entry: start 2024-02-23T06:42:18.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:18.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 Filter name: none 2024-02-23T06:42:18.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f77477fe640 20 reqs_thread_entry: start 2024-02-23T06:42:18.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.478+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.479+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.479+0000 7f792582f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.479+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.479+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.479+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.480+0000 7f792582f800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.480+0000 7f792582f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:18.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.480+0000 7f792582f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.481+0000 7f792582f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.481+0000 7f77d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.483+0000 7f792582f800 20 remove_watcher() i=0 2024-02-23T06:42:18.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.483+0000 7f792582f800 2 removed watcher, disabling cache 2024-02-23T06:42:18.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.484+0000 7f792582f800 20 remove_watcher() i=1 2024-02-23T06:42:18.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.485+0000 7f792582f800 20 remove_watcher() i=2 2024-02-23T06:42:18.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.486+0000 7f792582f800 20 remove_watcher() i=3 2024-02-23T06:42:18.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.487+0000 7f792582f800 20 remove_watcher() i=4 2024-02-23T06:42:18.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.488+0000 7f792582f800 20 remove_watcher() i=5 2024-02-23T06:42:18.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.489+0000 7f792582f800 20 remove_watcher() i=6 2024-02-23T06:42:18.490 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.490+0000 7f792582f800 20 remove_watcher() i=7 2024-02-23T06:42:18.500 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:18.500 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:42:18.501 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: myver id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-02-23T06:42:18.501 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:18.501 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-02-23T06:42:18.531 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:18.531 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:18.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.563+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.564+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.564+0000 7f3dbfc24800 20 realm 2024-02-23T06:42:18.565 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.564+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.564+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.564+0000 7f3dbfc24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:18.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.564+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.565+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.565+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.565+0000 7f3dbfc24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.565+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.566+0000 7f3dbfc24800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:18.567 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.566+0000 7f3dbfc24800 20 searching for the correct realm 2024-02-23T06:42:18.569 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.568+0000 7f3dbcc4a640 0 -- 172.21.15.142:0/2483773540 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f3db002b430 msgr2=0x7f3db002b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.572 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.572+0000 7f3dbd44b640 0 -- 172.21.15.142:0/2483773540 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f3db805e040 msgr2=0x7f3db806c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:18.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:18.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:18.579 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 zone default found 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 4 Realm: () 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:18.580 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 zonegroup default 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.577+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 started sync module instance, tier type = 2024-02-23T06:42:18.581 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.578+0000 7f3dbfc24800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:18.587 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=0 2024-02-23T06:42:18.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=1 2024-02-23T06:42:18.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=2 2024-02-23T06:42:18.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=3 2024-02-23T06:42:18.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=4 2024-02-23T06:42:18.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=5 2024-02-23T06:42:18.588 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.587+0000 7f3dbfc24800 20 add_watcher() i=6 2024-02-23T06:42:18.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.588+0000 7f3dbfc24800 20 add_watcher() i=7 2024-02-23T06:42:18.589 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.588+0000 7f3dbfc24800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:18.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.589+0000 7f3c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:18.592 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 5 note: GC not initialized 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3c727e4640 20 reqs_thread_entry: start 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 20 Filter name: none 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3be3fff640 20 reqs_thread_entry: start 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-02-23T06:42:18.593 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.590+0000 7f3dbfc24800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : miss 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:18.594 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 adding default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:18.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:42:18.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:18.595 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.591+0000 7f3dbfc24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:18.597 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 10 moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18, ofs0, ns] 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3ca0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693218 cookie 94624047647824 notifier 6725 bl.length()=783 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3ca0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3ca0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3ca0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:18.598 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_sources= new_sources= 2024-02-23T06:42:18.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential sources added=[] removed=[] 2024-02-23T06:42:18.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_dests= new_dests= 2024-02-23T06:42:18.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.596+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential dests added=[] removed=[] 2024-02-23T06:42:18.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.0 2024-02-23T06:42:18.600 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.0 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.1 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.1 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.2 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.2 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.3 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.3 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.4 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.4 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.5 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.5 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.6 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.6 2024-02-23T06:42:18.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.7 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.7 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.8 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.8 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.9 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.9 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.10 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.10 2024-02-23T06:42:18.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.11 2024-02-23T06:42:18.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.11 2024-02-23T06:42:18.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.0 2024-02-23T06:42:18.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.599+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1 2024-02-23T06:42:18.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.600+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2 2024-02-23T06:42:18.603 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.600+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.600+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.4 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.601+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.5 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.601+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.6 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.602+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.7 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.602+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.8 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.602+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.9 2024-02-23T06:42:18.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.603+0000 7f3dbfc24800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.10 2024-02-23T06:42:18.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.603+0000 7f3dbfc24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : hit (requested=0x17, cached=0x17) 2024-02-23T06:42:18.605 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.603+0000 7f3dbfc24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.604+0000 7f3dbfc24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.604+0000 7f3dbfc24800 10 moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.604+0000 7f3dbfc24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.604+0000 7f3dbfc24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18, ofs0, ns] 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3c8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693219 cookie 94624047647824 notifier 6725 bl.length()=751 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3c8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3c8ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3c8ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_sources= new_sources= 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential sources added=[] removed=[] 2024-02-23T06:42:18.606 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_dests= new_dests= 2024-02-23T06:42:18.607 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.605+0000 7f3dbfc24800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential dests added=[] removed=[] 2024-02-23T06:42:18.608 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.607+0000 7f3dbfc24800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-02-23T06:42:18.609 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.609+0000 7f3c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.611 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.611+0000 7f3dbfc24800 20 remove_watcher() i=0 2024-02-23T06:42:18.612 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.611+0000 7f3dbfc24800 2 removed watcher, disabling cache 2024-02-23T06:42:18.613 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.613+0000 7f3dbfc24800 20 remove_watcher() i=1 2024-02-23T06:42:18.614 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.614+0000 7f3dbfc24800 20 remove_watcher() i=2 2024-02-23T06:42:18.615 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.615+0000 7f3dbfc24800 20 remove_watcher() i=3 2024-02-23T06:42:18.616 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.616+0000 7f3dbfc24800 20 remove_watcher() i=4 2024-02-23T06:42:18.617 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.616+0000 7f3dbfc24800 20 remove_watcher() i=5 2024-02-23T06:42:18.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.617+0000 7f3dbfc24800 20 remove_watcher() i=6 2024-02-23T06:42:18.618 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.618+0000 7f3dbfc24800 20 remove_watcher() i=7 2024-02-23T06:42:18.629 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket myver 2024-02-23T06:42:18.657 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:18.657 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:18.690 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.690+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 realm 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.691+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.692+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.692+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.692+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:18.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.692+0000 7f5519839800 20 searching for the correct realm 2024-02-23T06:42:18.696 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.696+0000 7f550ba4a640 0 -- 172.21.15.142:0/3571389290 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f5504051070 msgr2=0x7f5504088430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.699 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.699+0000 7f550ba4a640 0 -- 172.21.15.142:0/3571389290 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f53dc07a5e0 msgr2=0x7f53dc07ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.705 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.703+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 20 zone default found 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 4 Realm: () 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 20 zonegroup default 2024-02-23T06:42:18.706 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.704+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.705+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.705+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.707 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.705+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.705+0000 7f5519839800 20 started sync module instance, tier type = 2024-02-23T06:42:18.708 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.705+0000 7f5519839800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:18.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=0 2024-02-23T06:42:18.714 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=1 2024-02-23T06:42:18.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=2 2024-02-23T06:42:18.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=3 2024-02-23T06:42:18.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=4 2024-02-23T06:42:18.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=5 2024-02-23T06:42:18.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.714+0000 7f5519839800 20 add_watcher() i=6 2024-02-23T06:42:18.715 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.715+0000 7f5519839800 20 add_watcher() i=7 2024-02-23T06:42:18.716 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.715+0000 7f5519839800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.716+0000 7f53cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 5 note: GC not initialized 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f53c9fdb640 20 reqs_thread_entry: start 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 Filter name: none 2024-02-23T06:42:18.718 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f533b7fe640 20 reqs_thread_entry: start 2024-02-23T06:42:18.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:18.719 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.717+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.718+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.718+0000 7f5519839800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.718+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.718+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.718+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.719+0000 7f5519839800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:18.720 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.719+0000 7f5519839800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:18.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.720+0000 7f5519839800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.720+0000 7f5519839800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.721 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.720+0000 7f53cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:18.722 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.722+0000 7f5519839800 20 remove_watcher() i=0 2024-02-23T06:42:18.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.722+0000 7f5519839800 2 removed watcher, disabling cache 2024-02-23T06:42:18.723 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.723+0000 7f5519839800 20 remove_watcher() i=1 2024-02-23T06:42:18.725 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.724+0000 7f5519839800 20 remove_watcher() i=2 2024-02-23T06:42:18.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.725+0000 7f5519839800 20 remove_watcher() i=3 2024-02-23T06:42:18.726 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.726+0000 7f5519839800 20 remove_watcher() i=4 2024-02-23T06:42:18.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.727+0000 7f5519839800 20 remove_watcher() i=5 2024-02-23T06:42:18.728 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.728+0000 7f5519839800 20 remove_watcher() i=6 2024-02-23T06:42:18.729 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.729+0000 7f5519839800 20 remove_watcher() i=7 2024-02-23T06:42:18.739 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:18.739 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:42:18.739 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: myver id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-02-23T06:42:18.739 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:18.786 INFO:tasks.workunit.client.0.smithi142.stderr: test: reshard removes olh entries with empty name 2024-02-23T06:42:18.877 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-02-23T06:42:18.904 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:18.904 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:18.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.936+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 realm 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:18.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.938+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.939+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.939+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.939+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:18.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.939+0000 7fe5d4a12800 20 searching for the correct realm 2024-02-23T06:42:18.942 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.942+0000 7fe5d05a4640 0 -- 172.21.15.142:0/3468597492 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7fe5c4030040 msgr2=0x7fe5c401f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:18.946 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:18.945+0000 7fe5cfda3640 0 -- 172.21.15.142:0/3468597492 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fe5c401f040 msgr2=0x7fe5c403c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:19.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.151+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 zone default found 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 4 Realm: () 2024-02-23T06:42:19.153 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 zonegroup default 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 started sync module instance, tier type = 2024-02-23T06:42:19.155 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.152+0000 7fe5d4a12800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=0 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=1 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=2 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=3 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=4 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=5 2024-02-23T06:42:19.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.161+0000 7fe5d4a12800 20 add_watcher() i=6 2024-02-23T06:42:19.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.162+0000 7fe5d4a12800 20 add_watcher() i=7 2024-02-23T06:42:19.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.162+0000 7fe5d4a12800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:19.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.163+0000 7fe485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:19.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe5d4a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe5d4a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe5d4a12800 5 note: GC not initialized 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe484fe1640 20 reqs_thread_entry: start 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe5d4a12800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe5d4a12800 20 Filter name: none 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe3fe7fc640 20 reqs_thread_entry: start 2024-02-23T06:42:19.165 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.164+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.165+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:42:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.165+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.165+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:42:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.165+0000 7fe5d4a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.165+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.166 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.166+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:42:19.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.166+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.166+0000 7fe5d4a12800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:42:19.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.166+0000 7fe5d4a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:19.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.167+0000 7fe5d4a12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.167 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.167+0000 7fe5d4a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.168 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.168+0000 7fe485fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:19.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.170+0000 7fe5d4a12800 20 remove_watcher() i=0 2024-02-23T06:42:19.170 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.170+0000 7fe5d4a12800 2 removed watcher, disabling cache 2024-02-23T06:42:19.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.170+0000 7fe5d4a12800 20 remove_watcher() i=1 2024-02-23T06:42:19.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.171+0000 7fe5d4a12800 20 remove_watcher() i=2 2024-02-23T06:42:19.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.172+0000 7fe5d4a12800 20 remove_watcher() i=3 2024-02-23T06:42:19.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.174+0000 7fe5d4a12800 20 remove_watcher() i=4 2024-02-23T06:42:19.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.175+0000 7fe5d4a12800 20 remove_watcher() i=5 2024-02-23T06:42:19.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.176+0000 7fe5d4a12800 20 remove_watcher() i=6 2024-02-23T06:42:19.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.177+0000 7fe5d4a12800 20 remove_watcher() i=7 2024-02-23T06:42:19.186 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:19.186 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:42:19.186 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: a-bucket id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-02-23T06:42:19.187 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:19.188 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-02-23T06:42:19.215 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:19.215 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:19.248 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.247+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.249+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.249+0000 7f6944c88800 20 realm 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.249+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.249+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.249+0000 7f6944c88800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.249+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.250+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.250 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.250+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.250+0000 7f6944c88800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:19.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.250+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.251+0000 7f6944c88800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:19.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.251+0000 7f6944c88800 20 searching for the correct realm 2024-02-23T06:42:19.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.254+0000 7f6942d50640 0 -- 172.21.15.142:0/4195746491 >> [v2:172.21.15.142:6816/4008394756,v1:172.21.15.142:6817/4008394756] conn(0x55afa61144a0 msgr2=0x55afa61168f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:19.257 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.257+0000 7f693bfff640 0 -- 172.21.15.142:0/4195746491 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f6934092060 msgr2=0x7f69340533c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:19.261 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:19.262 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.261+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:19.263 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 zone default found 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 4 Realm: () 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 zonegroup default 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.262+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.263+0000 7f6944c88800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.263+0000 7f6944c88800 20 started sync module instance, tier type = 2024-02-23T06:42:19.264 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.263+0000 7f6944c88800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=0 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=1 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=2 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=3 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=4 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=5 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.271+0000 7f6944c88800 20 add_watcher() i=6 2024-02-23T06:42:19.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.272+0000 7f6944c88800 20 add_watcher() i=7 2024-02-23T06:42:19.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.272+0000 7f6944c88800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:19.274 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f67f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f6944c88800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f6944c88800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f6944c88800 5 note: GC not initialized 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f67737fe640 20 reqs_thread_entry: start 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f6944c88800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f6944c88800 20 Filter name: none 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.274+0000 7f67717fa640 20 reqs_thread_entry: start 2024-02-23T06:42:19.275 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.275+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.275+0000 7f6944c88800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:42:19.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.275+0000 7f6944c88800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.275+0000 7f6944c88800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:42:19.276 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.275+0000 7f6944c88800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:19.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.276+0000 7f67f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:19.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.278+0000 7f6944c88800 20 remove_watcher() i=0 2024-02-23T06:42:19.278 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.278+0000 7f6944c88800 2 removed watcher, disabling cache 2024-02-23T06:42:19.279 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.279+0000 7f6944c88800 20 remove_watcher() i=1 2024-02-23T06:42:19.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.280+0000 7f6944c88800 20 remove_watcher() i=2 2024-02-23T06:42:19.281 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.281+0000 7f6944c88800 20 remove_watcher() i=3 2024-02-23T06:42:19.282 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.282+0000 7f6944c88800 20 remove_watcher() i=4 2024-02-23T06:42:19.283 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.283+0000 7f6944c88800 20 remove_watcher() i=5 2024-02-23T06:42:19.284 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.284+0000 7f6944c88800 20 remove_watcher() i=6 2024-02-23T06:42:19.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.285+0000 7f6944c88800 20 remove_watcher() i=7 2024-02-23T06:42:19.296 INFO:tasks.workunit.client.0.smithi142.stderr:rados -p default.rgw.buckets.index setomapval .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-02-23T06:42:19.322 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:19.322 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:19.338 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket a-bucket 2024-02-23T06:42:19.365 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:19.366 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:19.599 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.599+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 realm 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:19.601 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.600+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.601+0000 7fd030a14800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:19.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.601+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:19.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.601+0000 7fd030a14800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:19.602 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.601+0000 7fd030a14800 20 searching for the correct realm 2024-02-23T06:42:19.604 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.604+0000 7fd0237a2640 0 -- 172.21.15.142:0/3836925702 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7fd01c041060 msgr2=0x7fd01c02bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:19.810 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:19.809+0000 7fd02bfa3640 0 -- 172.21.15.142:0/3836925702 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fd01406a040 msgr2=0x7fd014051930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:20.016 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.017 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.015+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.018 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 20 zone default found 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 4 Realm: () 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 20 zonegroup default 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.016+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.019 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 started sync module instance, tier type = 2024-02-23T06:42:20.020 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.017+0000 7fd030a14800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:20.026 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=0 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=1 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=2 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=3 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=4 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=5 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.026+0000 7fd030a14800 20 add_watcher() i=6 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.027+0000 7fd030a14800 20 add_watcher() i=7 2024-02-23T06:42:20.027 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.027+0000 7fd030a14800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:20.029 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.029+0000 7fcee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.029+0000 7fd030a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.029+0000 7fd030a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.029+0000 7fd030a14800 5 note: GC not initialized 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.029+0000 7fcee0fe1640 20 reqs_thread_entry: start 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.029+0000 7fd030a14800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.030+0000 7fd030a14800 20 Filter name: none 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.030+0000 7fce5a7fc640 20 reqs_thread_entry: start 2024-02-23T06:42:20.030 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.030+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.030+0000 7fd030a14800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:42:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.030+0000 7fd030a14800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:42:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-02-23T06:42:20.031 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 INFO: main: starting shard=0 2024-02-23T06:42:20.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 2024-02-23T06:42:20.032 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 2024-02-23T06:42:20.033 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 INFO: main: starting shard=1 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.1 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.031+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.1 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 20 INFO: main: starting shard=2 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.2 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.2 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.034 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 20 INFO: main: starting shard=3 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.3 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.032+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.3 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 20 INFO: main: starting shard=4 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.4 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.4 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 20 INFO: main: starting shard=5 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.5 2024-02-23T06:42:20.035 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.033+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.5 2024-02-23T06:42:20.036 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 20 INFO: main: starting shard=6 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.6 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.6 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 20 INFO: main: starting shard=7 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.7 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.034+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.7 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 20 INFO: main: starting shard=8 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.8 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.8 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.037 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 20 INFO: main: starting shard=9 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.9 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.035+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.9 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 20 INFO: main: starting shard=10 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.10 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.10 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 20 INFO: main: starting shard=11 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.11 2024-02-23T06:42:20.038 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.036+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.11 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.037+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.037+0000 7fd030a14800 20 INFO: main: starting shard=12 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.037+0000 7fd030a14800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.12 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.037+0000 7fd030a14800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.12 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.037+0000 7fd030a14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.037+0000 7fd030a14800 20 INFO: main: done 2024-02-23T06:42:20.039 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.038+0000 7fcee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.040 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.040+0000 7fd030a14800 20 remove_watcher() i=0 2024-02-23T06:42:20.040 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.040+0000 7fd030a14800 2 removed watcher, disabling cache 2024-02-23T06:42:20.041 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.041+0000 7fd030a14800 20 remove_watcher() i=1 2024-02-23T06:42:20.042 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.042+0000 7fd030a14800 20 remove_watcher() i=2 2024-02-23T06:42:20.043 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.043+0000 7fd030a14800 20 remove_watcher() i=3 2024-02-23T06:42:20.044 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.044+0000 7fd030a14800 20 remove_watcher() i=4 2024-02-23T06:42:20.045 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.045+0000 7fd030a14800 20 remove_watcher() i=5 2024-02-23T06:42:20.046 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.046+0000 7fd030a14800 20 remove_watcher() i=6 2024-02-23T06:42:20.047 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.046+0000 7fd030a14800 20 remove_watcher() i=7 2024-02-23T06:42:20.058 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-02-23T06:42:20.089 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:20.089 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:20.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.121+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 realm 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.123+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.124+0000 7f0a4d08c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.124+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.124+0000 7f0a4d08c800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:20.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.124+0000 7f0a4d08c800 20 searching for the correct realm 2024-02-23T06:42:20.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.128+0000 7f0a43fff640 0 -- 172.21.15.142:0/2252295553 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f0a3c02c070 msgr2=0x7f0a3c039930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.131+0000 7f0a4b150640 0 -- 172.21.15.142:0/2252295553 >> [v2:172.21.15.152:6800/1235701666,v1:172.21.15.152:6802/1235701666] conn(0x7f0a3405b040 msgr2=0x7f0a340a7290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:42:20.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:20.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.135+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 zone default found 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 4 Realm: () 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 zonegroup default 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 started sync module instance, tier type = 2024-02-23T06:42:20.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.136+0000 7f0a4d08c800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=0 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=1 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=2 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=3 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=4 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=5 2024-02-23T06:42:20.146 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.145+0000 7f0a4d08c800 20 add_watcher() i=6 2024-02-23T06:42:20.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.146+0000 7f0a4d08c800 20 add_watcher() i=7 2024-02-23T06:42:20.147 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.146+0000 7f0a4d08c800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f09017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0a4d08c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0a4d08c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0a4d08c800 5 note: GC not initialized 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f087bfff640 20 reqs_thread_entry: start 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0a4d08c800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:20.150 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0a4d08c800 20 Filter name: none 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0879ffb640 20 reqs_thread_entry: start 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.148+0000 7f0a4d08c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : miss 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:42:20.151 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:42:20.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.152 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.149+0000 7f0a4d08c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17, ofs0, ns] 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f092dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693261 cookie 94053688164752 notifier 7179 bl.length()=789 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f092dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f092dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f092dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_sources= new_sources= 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential sources added=[] removed=[] 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_dests= new_dests= 2024-02-23T06:42:20.154 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.153+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential dests added=[] removed=[] 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.3.0 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.3.0 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.0 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.1 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.156+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.1 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.157+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.2 2024-02-23T06:42:20.157 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.157+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.2 2024-02-23T06:42:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.157+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.3 2024-02-23T06:42:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.157+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.3 2024-02-23T06:42:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.157+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.4 2024-02-23T06:42:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.157+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.4 2024-02-23T06:42:20.158 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.158+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.5 2024-02-23T06:42:20.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.158+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.5 2024-02-23T06:42:20.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.158+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.6 2024-02-23T06:42:20.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.158+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.6 2024-02-23T06:42:20.159 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.159+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.7 2024-02-23T06:42:20.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.159+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.7 2024-02-23T06:42:20.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.159+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.8 2024-02-23T06:42:20.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.159+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.8 2024-02-23T06:42:20.160 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.160+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.9 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.160+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.9 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.160+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.10 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.160+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.10 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.161+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.11 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.161+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.11 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.161+0000 7f0a4d08c800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.12 2024-02-23T06:42:20.161 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.161+0000 7f0a4d08c800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.2.12 2024-02-23T06:42:20.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.161+0000 7f0a4d08c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 : hit (requested=0x17, cached=0x17) 2024-02-23T06:42:20.162 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.161+0000 7f0a4d08c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 2024-02-23T06:42:20.163 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17, ofs0, ns] 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f092dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693262 cookie 94053688164752 notifier 7179 bl.length()=757 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f092dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 info.flags=0x17 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f092dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17 to cache LRU end 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f092dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_sources= new_sources= 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential sources added=[] removed=[] 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): orig_dests= new_dests= 2024-02-23T06:42:20.164 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.163+0000 7f0a4d08c800 20 handle_bi_update(): bucket=:a-bucket[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17]): potential dests added=[] removed=[] 2024-02-23T06:42:20.168 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.167+0000 7f0a4d08c800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-02-23T06:42:20.169 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.169+0000 7f09017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.171 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.171+0000 7f0a4d08c800 20 remove_watcher() i=0 2024-02-23T06:42:20.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.171+0000 7f0a4d08c800 2 removed watcher, disabling cache 2024-02-23T06:42:20.172 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.172+0000 7f0a4d08c800 20 remove_watcher() i=1 2024-02-23T06:42:20.173 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.173+0000 7f0a4d08c800 20 remove_watcher() i=2 2024-02-23T06:42:20.174 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.174+0000 7f0a4d08c800 20 remove_watcher() i=3 2024-02-23T06:42:20.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.175+0000 7f0a4d08c800 20 remove_watcher() i=4 2024-02-23T06:42:20.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.176+0000 7f0a4d08c800 20 remove_watcher() i=5 2024-02-23T06:42:20.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.177+0000 7f0a4d08c800 20 remove_watcher() i=6 2024-02-23T06:42:20.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.178+0000 7f0a4d08c800 20 remove_watcher() i=7 2024-02-23T06:42:20.189 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket a-bucket 2024-02-23T06:42:20.216 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:20.216 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:20.249 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.249+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.250+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.251 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.250+0000 7f2d3134b800 20 realm 2024-02-23T06:42:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.250+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.250+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.250+0000 7f2d3134b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.250+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.251+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.252 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.251+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.251+0000 7f2d3134b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.251+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.252+0000 7f2d3134b800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:20.253 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.252+0000 7f2d3134b800 20 searching for the correct realm 2024-02-23T06:42:20.254 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.253+0000 7f2d2ec4b640 0 -- 172.21.15.142:0/3609962001 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f2d28035060 msgr2=0x7f2d2805b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.458 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.458+0000 7f2d2f44c640 0 -- 172.21.15.142:0/3609962001 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f2d18082060 msgr2=0x7f2d180a66f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.464 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.463+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 zone default found 2024-02-23T06:42:20.465 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 4 Realm: () 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 zonegroup default 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.466 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.464+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.465+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.465+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.465+0000 7f2d3134b800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.465+0000 7f2d3134b800 20 started sync module instance, tier type = 2024-02-23T06:42:20.467 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.465+0000 7f2d3134b800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:20.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=0 2024-02-23T06:42:20.474 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=1 2024-02-23T06:42:20.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=2 2024-02-23T06:42:20.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=3 2024-02-23T06:42:20.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=4 2024-02-23T06:42:20.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=5 2024-02-23T06:42:20.475 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.474+0000 7f2d3134b800 20 add_watcher() i=6 2024-02-23T06:42:20.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.475+0000 7f2d3134b800 20 add_watcher() i=7 2024-02-23T06:42:20.476 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.475+0000 7f2d3134b800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:20.477 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.476+0000 7f2be57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.478 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2d3134b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:20.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2d3134b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:20.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2d3134b800 5 note: GC not initialized 2024-02-23T06:42:20.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2b5ffff640 20 reqs_thread_entry: start 2024-02-23T06:42:20.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2d3134b800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:20.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2d3134b800 20 Filter name: none 2024-02-23T06:42:20.479 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2b5dffb640 20 reqs_thread_entry: start 2024-02-23T06:42:20.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.477+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.478+0000 7f2d3134b800 20 rados_obj.operate() r=0 bl.length=176 2024-02-23T06:42:20.480 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.478+0000 7f2d3134b800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 rados_obj.operate() r=0 bl.length=360 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 INFO: main: starting shard=0 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.3.0 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17.3.0 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.479+0000 7f2d3134b800 20 INFO: main: done 2024-02-23T06:42:20.481 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.480+0000 7f2be57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.482+0000 7f2d3134b800 20 remove_watcher() i=0 2024-02-23T06:42:20.482 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.482+0000 7f2d3134b800 2 removed watcher, disabling cache 2024-02-23T06:42:20.483 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.483+0000 7f2d3134b800 20 remove_watcher() i=1 2024-02-23T06:42:20.484 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.484+0000 7f2d3134b800 20 remove_watcher() i=2 2024-02-23T06:42:20.485 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.485+0000 7f2d3134b800 20 remove_watcher() i=3 2024-02-23T06:42:20.486 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.486+0000 7f2d3134b800 20 remove_watcher() i=4 2024-02-23T06:42:20.487 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.487+0000 7f2d3134b800 20 remove_watcher() i=5 2024-02-23T06:42:20.488 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.488+0000 7f2d3134b800 20 remove_watcher() i=6 2024-02-23T06:42:20.489 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.489+0000 7f2d3134b800 20 remove_watcher() i=7 2024-02-23T06:42:20.499 INFO:tasks.workunit.client.0.smithi142.stderr: test: PUT succeeds during reshard 2024-02-23T06:42:20.500 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket myver 2024-02-23T06:42:20.528 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:20.528 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:20.561 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.561+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 realm 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.563 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.562+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.563+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.563+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.563+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:20.564 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.563+0000 7f1cac89d800 20 searching for the correct realm 2024-02-23T06:42:20.566 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.566+0000 7f1ca994e640 0 -- 172.21.15.142:0/1770669990 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f1ca4092c20 msgr2=0x7f1ca405b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.570 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.570+0000 7f1caa14f640 0 -- 172.21.15.142:0/1770669990 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f1ca00608f0 msgr2=0x7f1ca0092410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:20.776 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:20.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.775+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.777 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 zone default found 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 4 Realm: () 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:20.778 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 zonegroup default 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.776+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.777+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.777+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.777+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.777+0000 7f1cac89d800 20 started sync module instance, tier type = 2024-02-23T06:42:20.779 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.777+0000 7f1cac89d800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:20.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=0 2024-02-23T06:42:20.786 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=1 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=2 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=3 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=4 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=5 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.786+0000 7f1cac89d800 20 add_watcher() i=6 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.787+0000 7f1cac89d800 20 add_watcher() i=7 2024-02-23T06:42:20.787 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.787+0000 7f1cac89d800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.788+0000 7f1b60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 5 note: GC not initialized 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1adb7fe640 20 reqs_thread_entry: start 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 Filter name: none 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1ad97fa640 20 reqs_thread_entry: start 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.789+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.791 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:20.792 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.790+0000 7f1cac89d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:20.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.791+0000 7f1cac89d800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.791+0000 7f1cac89d800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.793 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.792+0000 7f1b60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.794+0000 7f1cac89d800 20 remove_watcher() i=0 2024-02-23T06:42:20.794 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.794+0000 7f1cac89d800 2 removed watcher, disabling cache 2024-02-23T06:42:20.795 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.795+0000 7f1cac89d800 20 remove_watcher() i=1 2024-02-23T06:42:20.796 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.796+0000 7f1cac89d800 20 remove_watcher() i=2 2024-02-23T06:42:20.797 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.797+0000 7f1cac89d800 20 remove_watcher() i=3 2024-02-23T06:42:20.798 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.798+0000 7f1cac89d800 20 remove_watcher() i=4 2024-02-23T06:42:20.799 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.799+0000 7f1cac89d800 20 remove_watcher() i=5 2024-02-23T06:42:20.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.800+0000 7f1cac89d800 20 remove_watcher() i=6 2024-02-23T06:42:20.801 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.801+0000 7f1cac89d800 20 remove_watcher() i=7 2024-02-23T06:42:20.811 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:20.811 INFO:tasks.workunit.client.0.smithi142.stderr:BUCKET_STATS: 2024-02-23T06:42:20.811 INFO:tasks.workunit.client.0.smithi142.stderr:bucket: myver id: 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-02-23T06:42:20.811 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:20.812 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-02-23T06:42:20.843 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:20.843 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:20.876 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.876+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 realm 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.878 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.877+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.878+0000 7fc8d672f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.878+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.879 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.878+0000 7fc8d672f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:20.880 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.878+0000 7fc8d672f800 20 searching for the correct realm 2024-02-23T06:42:20.882 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.882+0000 7fc8d19a2640 0 -- 172.21.15.142:0/2997180858 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x56186904b260 msgr2=0x56186904d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.885 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.885+0000 7fc8d21a3640 0 -- 172.21.15.142:0/2997180858 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7fc8c8057c60 msgr2=0x7fc8c80d3250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:20.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.889+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 zone default found 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 4 Realm: () 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 zonegroup default 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:20.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 started sync module instance, tier type = 2024-02-23T06:42:20.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.890+0000 7fc8d672f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=0 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=1 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=2 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=3 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=4 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=5 2024-02-23T06:42:20.899 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.899+0000 7fc8d672f800 20 add_watcher() i=6 2024-02-23T06:42:20.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.900+0000 7fc8d672f800 20 add_watcher() i=7 2024-02-23T06:42:20.900 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.900+0000 7fc8d672f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:20.901 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.901+0000 7fc788fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:20.902 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.901+0000 7fc8d672f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.901+0000 7fc8d672f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.901+0000 7fc8d672f800 5 note: GC not initialized 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc7037fe640 20 reqs_thread_entry: start 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 20 Filter name: none 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc7017fa640 20 reqs_thread_entry: start 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-02-23T06:42:20.903 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : miss 2024-02-23T06:42:20.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.902+0000 7fc8d672f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:20.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.903+0000 7fc8d672f800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:20.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.903+0000 7fc8d672f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:20.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.903+0000 7fc8d672f800 10 adding default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:20.904 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.903+0000 7fc8d672f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:42:20.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.903+0000 7fc8d672f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.905 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.903+0000 7fc8d672f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:20.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:20.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 10 moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:20.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.908 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18, ofs0, ns] 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc7b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693220 cookie 94662841131488 notifier 6860 bl.length()=783 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc7b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc7b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc7b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_sources= new_sources= 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential sources added=[] removed=[] 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_dests= new_dests= 2024-02-23T06:42:20.909 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.908+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential dests added=[] removed=[] 2024-02-23T06:42:20.911 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:20.911+0000 7fc8d672f800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-02-23T06:42:25.912 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:25.913 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:25.914 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.0 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.0 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.1 2024-02-23T06:42:25.915 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.912+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.1 2024-02-23T06:42:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.913+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.2 2024-02-23T06:42:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.913+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.2 2024-02-23T06:42:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.914+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.3 2024-02-23T06:42:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.914+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.3 2024-02-23T06:42:25.916 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.914+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.4 2024-02-23T06:42:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.914+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.4 2024-02-23T06:42:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.915+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.5 2024-02-23T06:42:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.915+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.5 2024-02-23T06:42:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.916+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.6 2024-02-23T06:42:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.916+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.6 2024-02-23T06:42:25.917 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.916+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.7 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.916+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.7 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.917+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.8 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.917+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.8 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.917+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.9 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.917+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.9 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.918+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.10 2024-02-23T06:42:25.918 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.918+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.10 2024-02-23T06:42:25.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.919+0000 7fc8d672f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.11 2024-02-23T06:42:25.919 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.919+0000 7fc8d672f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.1.11 2024-02-23T06:42:25.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.920+0000 7fc8d672f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : hit (requested=0x17, cached=0x17) 2024-02-23T06:42:25.920 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.920+0000 7fc8d672f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:25.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.921+0000 7fc8d672f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:25.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.921+0000 7fc8d672f800 10 moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:25.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.921+0000 7fc8d672f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:25.922 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.921+0000 7fc8d672f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18, ofs0, ns] 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.922+0000 7fc7b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693221 cookie 94662841131488 notifier 6860 bl.length()=751 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.922+0000 7fc7b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.922+0000 7fc7b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.922+0000 7fc7b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.923+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_sources= new_sources= 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.923+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential sources added=[] removed=[] 2024-02-23T06:42:25.923 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.923+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_dests= new_dests= 2024-02-23T06:42:25.924 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.923+0000 7fc8d672f800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential dests added=[] removed=[] 2024-02-23T06:42:25.926 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.925+0000 7fc8d672f800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-02-23T06:42:25.929 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.929+0000 7fc788fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:25.931 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.931+0000 7fc8d672f800 20 remove_watcher() i=0 2024-02-23T06:42:25.932 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.931+0000 7fc8d672f800 2 removed watcher, disabling cache 2024-02-23T06:42:25.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.933+0000 7fc8d672f800 20 remove_watcher() i=1 2024-02-23T06:42:25.936 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.935+0000 7fc8d672f800 20 remove_watcher() i=2 2024-02-23T06:42:25.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.936+0000 7fc8d672f800 20 remove_watcher() i=3 2024-02-23T06:42:25.937 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.937+0000 7fc8d672f800 20 remove_watcher() i=4 2024-02-23T06:42:25.939 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.938+0000 7fc8d672f800 20 remove_watcher() i=5 2024-02-23T06:42:25.940 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.940+0000 7fc8d672f800 20 remove_watcher() i=6 2024-02-23T06:42:25.941 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:25.941+0000 7fc8d672f800 20 remove_watcher() i=7 2024-02-23T06:42:26.845 INFO:tasks.workunit.client.0.smithi142.stderr:put object successful 2024-02-23T06:42:26.845 INFO:tasks.workunit.client.0.smithi142.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-02-23T06:42:26.845 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-02-23T06:42:26.995 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-02-23T06:42:27.381 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-02-23T06:42:28.816 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:42:28.817 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket myver --object x 2024-02-23T06:42:28.852 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:28.853 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:28.890 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.889+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:28.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:28.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 realm 2024-02-23T06:42:28.891 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.891+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.892+0000 7f1b2c83a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:28.892 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.892+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:28.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.893+0000 7f1b2c83a800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:28.893 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.893+0000 7f1b2c83a800 20 searching for the correct realm 2024-02-23T06:42:28.895 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:28.894+0000 7f1b2784b640 0 -- 172.21.15.142:0/3050786228 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f1b20015030 msgr2=0x7f1b20025410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-02-23T06:42:29.100 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.099+0000 7f1b2804c640 0 -- 172.21.15.142:0/3050786228 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f1b1c053fd0 msgr2=0x7f1b1c057140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:29.106 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.105+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.106+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.107 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.106+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.106+0000 7f1b2c83a800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.106+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 zone default found 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 4 Realm: () 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 zonegroup default 2024-02-23T06:42:29.108 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.107+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.108+0000 7f1b2c83a800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.108+0000 7f1b2c83a800 20 started sync module instance, tier type = 2024-02-23T06:42:29.109 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.108+0000 7f1b2c83a800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:29.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=0 2024-02-23T06:42:29.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=1 2024-02-23T06:42:29.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=2 2024-02-23T06:42:29.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=3 2024-02-23T06:42:29.118 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=4 2024-02-23T06:42:29.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=5 2024-02-23T06:42:29.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.118+0000 7f1b2c83a800 20 add_watcher() i=6 2024-02-23T06:42:29.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.119+0000 7f1b2c83a800 20 add_watcher() i=7 2024-02-23T06:42:29.119 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.119+0000 7f1b2c83a800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:29.121 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f19ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:29.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f1b2c83a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:29.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f1b2c83a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:29.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f1b2c83a800 5 note: GC not initialized 2024-02-23T06:42:29.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f19dcfe1640 20 reqs_thread_entry: start 2024-02-23T06:42:29.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f1b2c83a800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:29.122 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f1b2c83a800 20 Filter name: none 2024-02-23T06:42:29.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.121+0000 7f19567fc640 20 reqs_thread_entry: start 2024-02-23T06:42:29.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.122+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.122+0000 7f1b2c83a800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:29.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.122+0000 7f1b2c83a800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.123 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.122+0000 7f1b2c83a800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 INFO: main: starting shard=0 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 INFO: main: starting shard=1 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:29.124 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.123+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 20 INFO: main: starting shard=2 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 20 INFO: main: starting shard=3 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:29.125 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.124+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:29.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 20 INFO: main: starting shard=4 2024-02-23T06:42:29.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:29.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:29.126 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 20 INFO: main: starting shard=5 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.125+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 20 INFO: main: starting shard=6 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 20 INFO: main: starting shard=7 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:29.127 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.126+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 20 INFO: main: starting shard=8 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 20 INFO: main: starting shard=9 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:29.128 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.127+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.128+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.128+0000 7f1b2c83a800 20 INFO: main: starting shard=10 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.128+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.128+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 20 INFO: main: starting shard=11 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:29.129 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:29.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 20 INFO: main: starting shard=12 2024-02-23T06:42:29.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:29.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.129+0000 7f1b2c83a800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:29.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.130+0000 7f1b2c83a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.130 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.130+0000 7f1b2c83a800 20 INFO: main: done 2024-02-23T06:42:29.131 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.130+0000 7f19ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:29.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.132+0000 7f1b2c83a800 20 remove_watcher() i=0 2024-02-23T06:42:29.133 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.132+0000 7f1b2c83a800 2 removed watcher, disabling cache 2024-02-23T06:42:29.134 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.134+0000 7f1b2c83a800 20 remove_watcher() i=1 2024-02-23T06:42:29.135 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.135+0000 7f1b2c83a800 20 remove_watcher() i=2 2024-02-23T06:42:29.136 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.136+0000 7f1b2c83a800 20 remove_watcher() i=3 2024-02-23T06:42:29.137 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.137+0000 7f1b2c83a800 20 remove_watcher() i=4 2024-02-23T06:42:29.138 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.138+0000 7f1b2c83a800 20 remove_watcher() i=5 2024-02-23T06:42:29.139 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.139+0000 7f1b2c83a800 20 remove_watcher() i=6 2024-02-23T06:42:29.140 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.140+0000 7f1b2c83a800 20 remove_watcher() i=7 2024-02-23T06:42:29.206 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:42:29.208 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket myver --object y 2024-02-23T06:42:29.237 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:29.237 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:29.270 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.270+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.271+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.271+0000 7f6cade12800 20 realm 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.271+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.272+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.272+0000 7f6cade12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.272+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.272+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.272 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.272+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.273+0000 7f6cade12800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:29.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.273+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.273+0000 7f6cade12800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:29.273 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.273+0000 7f6cade12800 20 searching for the correct realm 2024-02-23T06:42:29.277 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.277+0000 7f6ca09a2640 0 -- 172.21.15.142:0/4043510308 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f6c9c082060 msgr2=0x7f6c9c0b80c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:29.280 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.280+0000 7f6ca09a2640 0 -- 172.21.15.142:0/4043510308 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f6b7407a5e0 msgr2=0x7f6b7407ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.285 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 zone default found 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 4 Realm: () 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 zonegroup default 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.284+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.286 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 started sync module instance, tier type = 2024-02-23T06:42:29.287 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.285+0000 7f6cade12800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=0 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=1 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=2 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=3 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=4 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=5 2024-02-23T06:42:29.295 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.294+0000 7f6cade12800 20 add_watcher() i=6 2024-02-23T06:42:29.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.295+0000 7f6cade12800 20 add_watcher() i=7 2024-02-23T06:42:29.296 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.295+0000 7f6cade12800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.297+0000 7f6b5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.297+0000 7f6cade12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.297+0000 7f6cade12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.297+0000 7f6cade12800 5 note: GC not initialized 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.297+0000 7f6b5e7e4640 20 reqs_thread_entry: start 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.297+0000 7f6cade12800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:29.298 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 Filter name: none 2024-02-23T06:42:29.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6acffff640 20 reqs_thread_entry: start 2024-02-23T06:42:29.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:29.299 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 INFO: main: starting shard=0 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.298+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.299+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.299+0000 7f6cade12800 20 INFO: main: starting shard=1 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.299+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:29.300 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.299+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 20 INFO: main: starting shard=2 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 20 INFO: main: starting shard=3 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:29.301 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.300+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:29.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 INFO: main: starting shard=4 2024-02-23T06:42:29.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:29.302 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 INFO: main: starting shard=5 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 INFO: main: starting shard=6 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.301+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:29.303 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 20 INFO: main: starting shard=7 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 20 INFO: main: starting shard=8 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.302+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 20 INFO: main: starting shard=9 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:29.304 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:29.305 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 20 INFO: main: starting shard=10 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.303+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 20 INFO: main: starting shard=11 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 20 INFO: main: starting shard=12 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.304+0000 7f6cade12800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.305+0000 7f6cade12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.306 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.305+0000 7f6cade12800 20 INFO: main: done 2024-02-23T06:42:29.307 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.305+0000 7f6b5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:29.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.308+0000 7f6cade12800 20 remove_watcher() i=0 2024-02-23T06:42:29.308 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.308+0000 7f6cade12800 2 removed watcher, disabling cache 2024-02-23T06:42:29.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.309+0000 7f6cade12800 20 remove_watcher() i=1 2024-02-23T06:42:29.310 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.310+0000 7f6cade12800 20 remove_watcher() i=2 2024-02-23T06:42:29.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.310+0000 7f6cade12800 20 remove_watcher() i=3 2024-02-23T06:42:29.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.312+0000 7f6cade12800 20 remove_watcher() i=4 2024-02-23T06:42:29.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.312+0000 7f6cade12800 20 remove_watcher() i=5 2024-02-23T06:42:29.313 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.313+0000 7f6cade12800 20 remove_watcher() i=6 2024-02-23T06:42:29.314 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.314+0000 7f6cade12800 20 remove_watcher() i=7 2024-02-23T06:42:29.381 INFO:tasks.workunit.client.0.smithi142.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-02-23T06:42:29.382 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bi list --bucket myver --object z 2024-02-23T06:42:29.411 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:29.411 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:29.445 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.444+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.446 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 realm 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.446+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.447+0000 7f7f52c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:29.447 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.447+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.447+0000 7f7f52c0f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:29.448 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.447+0000 7f7f52c0f800 20 searching for the correct realm 2024-02-23T06:42:29.451 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.451+0000 7f7f4d94e640 0 -- 172.21.15.142:0/3089331096 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f7f40081060 msgr2=0x7f7f4009eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:29.455 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.454+0000 7f7f4e14f640 0 -- 172.21.15.142:0/3089331096 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f7f44081ba0 msgr2=0x7f7f440871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:29.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:29.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:29.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:29.661 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.660+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:29.662 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:29.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 zone default found 2024-02-23T06:42:29.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 4 Realm: () 2024-02-23T06:42:29.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:29.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:29.663 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 zonegroup default 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.661+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 started sync module instance, tier type = 2024-02-23T06:42:29.664 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.662+0000 7f7f52c0f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=0 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=1 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=2 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=3 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=4 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=5 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.672+0000 7f7f52c0f800 20 add_watcher() i=6 2024-02-23T06:42:29.673 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.673+0000 7f7f52c0f800 20 add_watcher() i=7 2024-02-23T06:42:29.674 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.673+0000 7f7f52c0f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:29.675 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.675+0000 7f7e04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:29.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.675+0000 7f7f52c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:29.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.675+0000 7f7f52c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:29.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.675+0000 7f7f52c0f800 5 note: GC not initialized 2024-02-23T06:42:29.676 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.675+0000 7f7d7f7fe640 20 reqs_thread_entry: start 2024-02-23T06:42:29.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.675+0000 7f7f52c0f800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:29.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 Filter name: none 2024-02-23T06:42:29.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7d7d7fa640 20 reqs_thread_entry: start 2024-02-23T06:42:29.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:29.677 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 rados->read ofs=0 len=0 2024-02-23T06:42:29.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:29.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:29.678 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 INFO: main: starting shard=0 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.676+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.677+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.677+0000 7f7f52c0f800 20 INFO: main: starting shard=1 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.677+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.677+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 20 INFO: main: starting shard=2 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:29.679 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:29.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 20 INFO: main: starting shard=3 2024-02-23T06:42:29.680 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.678+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 20 INFO: main: starting shard=4 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 20 INFO: main: starting shard=5 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.679+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 20 INFO: main: starting shard=6 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:29.681 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:29.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 20 INFO: main: starting shard=7 2024-02-23T06:42:29.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:29.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.680+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:29.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.681+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.682 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.681+0000 7f7f52c0f800 20 INFO: main: starting shard=8 2024-02-23T06:42:29.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.681+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:29.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.681+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:29.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 20 INFO: main: starting shard=9 2024-02-23T06:42:29.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:29.683 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 20 INFO: main: starting shard=10 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.682+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 20 INFO: main: starting shard=11 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 20 INFO: main: starting shard=12 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:29.684 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.683+0000 7f7f52c0f800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:29.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.684+0000 7f7f52c0f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-02-23T06:42:29.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.684+0000 7f7f52c0f800 20 INFO: main: done 2024-02-23T06:42:29.685 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.685+0000 7f7e04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:29.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.687+0000 7f7f52c0f800 20 remove_watcher() i=0 2024-02-23T06:42:29.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.687+0000 7f7f52c0f800 2 removed watcher, disabling cache 2024-02-23T06:42:29.688 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.688+0000 7f7f52c0f800 20 remove_watcher() i=1 2024-02-23T06:42:29.689 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.689+0000 7f7f52c0f800 20 remove_watcher() i=2 2024-02-23T06:42:29.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.690+0000 7f7f52c0f800 20 remove_watcher() i=3 2024-02-23T06:42:29.691 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.691+0000 7f7f52c0f800 20 remove_watcher() i=4 2024-02-23T06:42:29.692 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.692+0000 7f7f52c0f800 20 remove_watcher() i=5 2024-02-23T06:42:29.693 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.693+0000 7f7f52c0f800 20 remove_watcher() i=6 2024-02-23T06:42:29.694 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:29.694+0000 7f7f52c0f800 20 remove_watcher() i=7 2024-02-23T06:42:29.710 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-02-23T06:42:30.102 INFO:tasks.workunit.client.0.smithi142.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-02-23T06:42:30.492 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-02-23T06:42:30.522 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:30.522 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:30.555 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.555+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 realm 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:30.557 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.556+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:30.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.557+0000 7f54bed21800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:30.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.557+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:30.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.558+0000 7f54bed21800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:30.558 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.558+0000 7f54bed21800 20 searching for the correct realm 2024-02-23T06:42:30.762 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.762+0000 7f54b204a640 0 -- 172.21.15.142:0/1252493941 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f54ac01f060 msgr2=0x7f54ac0157d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:30.968 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:30.968+0000 7f54ba84b640 0 -- 172.21.15.142:0/1252493941 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f54a40a1900 msgr2=0x7f54a40923c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:31.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:31.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:31.175 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:31.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:31.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:31.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:31.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.176 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:31.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.175+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.177 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 20 zone default found 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 4 Realm: () 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 20 zonegroup default 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.176+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.177+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.177+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.177+0000 7f54bed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.177+0000 7f54bed21800 20 started sync module instance, tier type = 2024-02-23T06:42:31.178 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.177+0000 7f54bed21800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=0 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=1 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=2 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=3 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=4 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=5 2024-02-23T06:42:31.187 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.186+0000 7f54bed21800 20 add_watcher() i=6 2024-02-23T06:42:31.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.187+0000 7f54bed21800 20 add_watcher() i=7 2024-02-23T06:42:31.188 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.187+0000 7f54bed21800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:31.189 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.189+0000 7f53717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:31.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.189+0000 7f54bed21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:31.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.189+0000 7f54bed21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:31.190 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.189+0000 7f54bed21800 5 note: GC not initialized 2024-02-23T06:42:31.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f52ebfff640 20 reqs_thread_entry: start 2024-02-23T06:42:31.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:31.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 20 Filter name: none 2024-02-23T06:42:31.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f52e9ffb640 20 reqs_thread_entry: start 2024-02-23T06:42:31.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-02-23T06:42:31.191 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : miss 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.190+0000 7f54bed21800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.191+0000 7f54bed21800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.191+0000 7f54bed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.191+0000 7f54bed21800 10 adding default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.191+0000 7f54bed21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.191+0000 7f54bed21800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:31.192 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.191+0000 7f54bed21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:31.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f54bed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:31.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f54bed21800 10 moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:31.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f54bed21800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:31.197 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f54bed21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18, ofs0, ns] 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f539e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693222 cookie 94761216235776 notifier 6944 bl.length()=783 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f539e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f539e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.197+0000 7f539e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.198+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_sources= new_sources= 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.198+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential sources added=[] removed=[] 2024-02-23T06:42:31.198 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.198+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_dests= new_dests= 2024-02-23T06:42:31.199 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.198+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential dests added=[] removed=[] 2024-02-23T06:42:31.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.0 2024-02-23T06:42:31.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.0 2024-02-23T06:42:31.206 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.1 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.1 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.2 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.2 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.3 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.3 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.4 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.4 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.5 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.5 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.6 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.6 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.7 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.7 2024-02-23T06:42:31.207 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.8 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.8 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.10 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.10 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.11 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.11 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.12 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.12 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.13 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.13 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.14 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.14 2024-02-23T06:42:31.208 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.15 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.15 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.16 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.16 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.205+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.0 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.206+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:31.209 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.206+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.1 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.207+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.207+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.2 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.207+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.207+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.3 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.208+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.208+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.4 2024-02-23T06:42:31.210 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.208+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:31.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.208+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.5 2024-02-23T06:42:31.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.209+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:31.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.209+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.6 2024-02-23T06:42:31.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.209+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:31.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.209+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.7 2024-02-23T06:42:31.211 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.210+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.210+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.8 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.210+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.210+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.9 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.211+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.211+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.10 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.212+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:31.212 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.212+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.11 2024-02-23T06:42:31.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.212+0000 7f54bed21800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:31.213 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.212+0000 7f54bed21800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.2.12 2024-02-23T06:42:31.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.215+0000 7f54bed21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : hit (requested=0x17, cached=0x17) 2024-02-23T06:42:31.215 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.215+0000 7f54bed21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:31.216 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f54bed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f54bed21800 10 moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f54bed21800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f54bed21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18, ofs0, ns] 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f539dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693223 cookie 94761216235776 notifier 6944 bl.length()=751 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f539dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f539dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.216+0000 7f539dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:31.217 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.217+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_sources= new_sources= 2024-02-23T06:42:31.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.217+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential sources added=[] removed=[] 2024-02-23T06:42:31.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.217+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): orig_dests= new_dests= 2024-02-23T06:42:31.218 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.217+0000 7f54bed21800 20 handle_bi_update(): bucket=:myver[7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18]): potential dests added=[] removed=[] 2024-02-23T06:42:31.220 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.220+0000 7f54bed21800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-02-23T06:42:31.222 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.222+0000 7f53717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:31.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.224+0000 7f54bed21800 20 remove_watcher() i=0 2024-02-23T06:42:31.224 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.224+0000 7f54bed21800 2 removed watcher, disabling cache 2024-02-23T06:42:31.225 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.225+0000 7f54bed21800 20 remove_watcher() i=1 2024-02-23T06:42:31.226 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.226+0000 7f54bed21800 20 remove_watcher() i=2 2024-02-23T06:42:31.227 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.227+0000 7f54bed21800 20 remove_watcher() i=3 2024-02-23T06:42:31.228 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.228+0000 7f54bed21800 20 remove_watcher() i=4 2024-02-23T06:42:31.229 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.229+0000 7f54bed21800 20 remove_watcher() i=5 2024-02-23T06:42:31.230 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.230+0000 7f54bed21800 20 remove_watcher() i=6 2024-02-23T06:42:31.231 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.230+0000 7f54bed21800 20 remove_watcher() i=7 2024-02-23T06:42:31.242 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-02-23T06:42:31.275 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:31.275 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:31.309 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.309+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.310+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.310+0000 7f3f76333800 20 realm 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.310+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.310+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.310+0000 7f3f76333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.310+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.311+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.311 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.311+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.311+0000 7f3f76333800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:31.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.311+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.312+0000 7f3f76333800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:31.312 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.312+0000 7f3f76333800 20 searching for the correct realm 2024-02-23T06:42:31.315 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.315+0000 7f3f6964a640 0 -- 172.21.15.142:0/1010720519 >> [v2:172.21.15.142:6808/3663012454,v1:172.21.15.142:6809/3663012454] conn(0x556f45b02c00 msgr2=0x556f45b050c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:31.319 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.318+0000 7f3f71e4b640 0 -- 172.21.15.142:0/1010720519 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f3f5c068600 msgr2=0x7f3f5c0920b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.325 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.322+0000 7f3f76333800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 zone default found 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 4 Realm: () 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 zonegroup default 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.323+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.324+0000 7f3f76333800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.326 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.324+0000 7f3f76333800 20 started sync module instance, tier type = 2024-02-23T06:42:31.327 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.324+0000 7f3f76333800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=0 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=1 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=2 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=3 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=4 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=5 2024-02-23T06:42:31.333 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=6 2024-02-23T06:42:31.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 20 add_watcher() i=7 2024-02-23T06:42:31.334 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.333+0000 7f3f76333800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:31.335 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.335+0000 7f3e237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:31.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.335+0000 7f3f76333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:31.336 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.335+0000 7f3f76333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.335+0000 7f3f76333800 5 note: GC not initialized 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.335+0000 7f3e227fc640 20 reqs_thread_entry: start 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 20 Filter name: none 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3d93fff640 20 reqs_thread_entry: start 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 : miss 2024-02-23T06:42:31.337 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.336+0000 7f3f76333800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:31.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 info.flags=0x17 2024-02-23T06:42:31.338 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 adding default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 to cache LRU end 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.0 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.0 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 1 NOTICE: finished shard 0 (0 entries removed) 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.1 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.1 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 1 NOTICE: finished shard 1 (0 entries removed) 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.2 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.337+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.2 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.338+0000 7f3f76333800 1 NOTICE: finished shard 2 (0 entries removed) 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.338+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.3 2024-02-23T06:42:31.339 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.338+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.3 2024-02-23T06:42:31.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 1 NOTICE: finished shard 3 (0 entries removed) 2024-02-23T06:42:31.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.4 2024-02-23T06:42:31.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.4 2024-02-23T06:42:31.340 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 1 NOTICE: finished shard 4 (0 entries removed) 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.5 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.5 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 1 NOTICE: finished shard 5 (0 entries removed) 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.6 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.339+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.6 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.340+0000 7f3f76333800 1 NOTICE: finished shard 6 (0 entries removed) 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.340+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.7 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.340+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.7 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.340+0000 7f3f76333800 1 NOTICE: finished shard 7 (0 entries removed) 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.340+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.8 2024-02-23T06:42:31.341 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.340+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.8 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.341+0000 7f3f76333800 1 NOTICE: finished shard 8 (0 entries removed) 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.341+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.341+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.341+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.10 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.341+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.10 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 1 NOTICE: finished shard 10 (0 entries removed) 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.11 2024-02-23T06:42:31.342 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.11 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 1 NOTICE: finished shard 11 (0 entries removed) 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.12 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.12 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 1 NOTICE: finished shard 12 (0 entries removed) 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.13 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.342+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.13 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 1 NOTICE: finished shard 13 (0 entries removed) 2024-02-23T06:42:31.343 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.14 2024-02-23T06:42:31.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.14 2024-02-23T06:42:31.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 1 NOTICE: finished shard 14 (0 entries removed) 2024-02-23T06:42:31.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.15 2024-02-23T06:42:31.344 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.15 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 1 NOTICE: finished shard 15 (0 entries removed) 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 10 bucket_obj is .dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.16 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.343+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.16 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.344+0000 7f3f76333800 1 NOTICE: finished shard 16 (0 entries removed) 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.344+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.344+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:x state=0x556f45b6a128 s->prefetch_data=0 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.344+0000 7f3f76333800 20 get_obj_state: setting s->obj_tag to z1jhpl055ftg1w9g2ruy9841ihh5jt80 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.344+0000 7f3f76333800 20 get_obj_state_impl: setting s->olh_tag to k5ellkvounotruw2k00ilt8eo6s6hdf5 2024-02-23T06:42:31.345 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.344+0000 7f3f76333800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k5ellkvounotruw2k00ilt8eo6s6hdf5 2024-02-23T06:42:31.346 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.346+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.347 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.347+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.347+0000 7f3f76333800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-02-23T06:42:31.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.347+0000 7f3f76333800 20 olh_log_entry: epoch=2 op=3 key=x[sb6hvWWH6CQJTWo3pC9N7cRQU2AC.0k] 2024-02-23T06:42:31.348 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.348+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:_:sb6hvWWH6CQJTWo3pC9N7cRQU2AC.0k_x state=0x556f45b6ac88 s->prefetch_data=0 2024-02-23T06:42:31.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.348+0000 7f3f76333800 10 manifest: total_size = 9 2024-02-23T06:42:31.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.348+0000 7f3f76333800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13126123264354169167 2024-02-23T06:42:31.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.348+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:_:sb6hvWWH6CQJTWo3pC9N7cRQU2AC.0k_x state=0x556f45b6ac88 s->prefetch_data=0 2024-02-23T06:42:31.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.348+0000 7f3f76333800 20 prepare_atomic_modification: state is not atomic. state=0x556f45b6ac88 2024-02-23T06:42:31.349 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.348+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.351+0000 7f3f76333800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:42:31.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.351+0000 7f3f76333800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-02-23T06:42:31.351 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.351+0000 7f3f76333800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:42:31.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.351+0000 7f3f76333800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:sb6hvWWH6CQJTWo3pC9N7cRQU2AC.0k_.jLHKNZfs8Yd4ZkSc-01iSeIVcnxnw1J_0 2024-02-23T06:42:31.352 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.352+0000 7f3f76333800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:42:31.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.352+0000 7f3e557fa640 20 handle_completion(): completion ok for obj=x[sb6hvWWH6CQJTWo3pC9N7cRQU2AC.0k] 2024-02-23T06:42:31.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.353+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:x state=0x556f45b6a128 s->prefetch_data=0 2024-02-23T06:42:31.353 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.353+0000 7f3f76333800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k5ellkvounotruw2k00ilt8eo6s6hdf5 2024-02-23T06:42:31.356 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.355+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.357+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.357+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.357 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.357+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:y state=0x556f45b74708 s->prefetch_data=0 2024-02-23T06:42:31.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.358+0000 7f3f76333800 20 get_obj_state: setting s->obj_tag to swzj8g368p3khsz8ltvv9ca3gaq1vjev 2024-02-23T06:42:31.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.358+0000 7f3f76333800 20 get_obj_state_impl: setting s->olh_tag to s5z03s37dfgszq9nap0i3favbugvxopn 2024-02-23T06:42:31.358 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.358+0000 7f3f76333800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s5z03s37dfgszq9nap0i3favbugvxopn 2024-02-23T06:42:31.359 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.359+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.360 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.360+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.360+0000 7f3f76333800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-02-23T06:42:31.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.360+0000 7f3f76333800 20 olh_log_entry: epoch=2 op=3 key=y[os7tBbgmTZH3zCIbaYz-0ZyfJs2zCf0] 2024-02-23T06:42:31.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.360+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:_:os7tBbgmTZH3zCIbaYz-0ZyfJs2zCf0_y state=0x556f45b77b18 s->prefetch_data=0 2024-02-23T06:42:31.361 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.361+0000 7f3f76333800 10 manifest: total_size = 9 2024-02-23T06:42:31.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.361+0000 7f3f76333800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4829088213915234568 2024-02-23T06:42:31.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.361+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:_:os7tBbgmTZH3zCIbaYz-0ZyfJs2zCf0_y state=0x556f45b77b18 s->prefetch_data=0 2024-02-23T06:42:31.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.361+0000 7f3f76333800 20 prepare_atomic_modification: state is not atomic. state=0x556f45b77b18 2024-02-23T06:42:31.362 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.361+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.363+0000 7f3f76333800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:42:31.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.363+0000 7f3f76333800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-02-23T06:42:31.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.363+0000 7f3f76333800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:42:31.364 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.363+0000 7f3f76333800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:os7tBbgmTZH3zCIbaYz-0ZyfJs2zCf0_.2A5HONNm-70lwA04xRLfjmbJRtCT8Lt_0 2024-02-23T06:42:31.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.365+0000 7f3e54ff9640 20 handle_completion(): completion ok for obj=y[os7tBbgmTZH3zCIbaYz-0ZyfJs2zCf0] 2024-02-23T06:42:31.365 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.365+0000 7f3f76333800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:42:31.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.366+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:y state=0x556f45b74708 s->prefetch_data=0 2024-02-23T06:42:31.366 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.366+0000 7f3f76333800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s5z03s37dfgszq9nap0i3favbugvxopn 2024-02-23T06:42:31.369 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.369+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.370 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.370+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.370+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.371+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:z state=0x556f45b69c28 s->prefetch_data=0 2024-02-23T06:42:31.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.371+0000 7f3f76333800 20 get_obj_state: setting s->obj_tag to f7zm6kinwji9ym7w76e8cmm80stofvom 2024-02-23T06:42:31.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.371+0000 7f3f76333800 20 get_obj_state_impl: setting s->olh_tag to 2g5j1wvptgure3h5pa6o058gkrld9jt5 2024-02-23T06:42:31.371 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.371+0000 7f3f76333800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2g5j1wvptgure3h5pa6o058gkrld9jt5 2024-02-23T06:42:31.372 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.372+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.373+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-02-23T06:42:31.374 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 olh_log_entry: epoch=2 op=3 key=z[2171xv7wK9zVzpdBrDcvH9-T2ct6L8Q] 2024-02-23T06:42:31.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:_:2171xv7wK9zVzpdBrDcvH9-T2ct6L8Q_z state=0x556f45b77b18 s->prefetch_data=0 2024-02-23T06:42:31.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 10 manifest: total_size = 22 2024-02-23T06:42:31.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 get_obj_state: setting s->obj_tag to 7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3719016004357855808 2024-02-23T06:42:31.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:_:2171xv7wK9zVzpdBrDcvH9-T2ct6L8Q_z state=0x556f45b77b18 s->prefetch_data=0 2024-02-23T06:42:31.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 prepare_atomic_modification: state is not atomic. state=0x556f45b77b18 2024-02-23T06:42:31.375 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.374+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.377+0000 7f3f76333800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-02-23T06:42:31.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.377+0000 7f3f76333800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-02-23T06:42:31.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.377+0000 7f3f76333800 0 deleting objects inline since gc isn't initialized 2024-02-23T06:42:31.377 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.377+0000 7f3f76333800 5 delete_objs_inline: removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:2171xv7wK9zVzpdBrDcvH9-T2ct6L8Q_.MFy2EcryUvXRKf67pNbIJrPbCFauPHv_0 2024-02-23T06:42:31.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.378+0000 7f3f76333800 5 delete_objs_inline: refcount put returned error -2 2024-02-23T06:42:31.378 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.378+0000 7f3e557fa640 20 handle_completion(): completion ok for obj=z[2171xv7wK9zVzpdBrDcvH9-T2ct6L8Q] 2024-02-23T06:42:31.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.379+0000 7f3f76333800 20 get_obj_state: octx=0x556f4586d400 obj=myver:z state=0x556f45b69c28 s->prefetch_data=0 2024-02-23T06:42:31.379 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.379+0000 7f3f76333800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2g5j1wvptgure3h5pa6o058gkrld9jt5 2024-02-23T06:42:31.382 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.381+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.383+0000 7f3f76333800 20 bucket index object: :.dir.7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18.3.9 2024-02-23T06:42:31.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.383+0000 7f3f76333800 1 NOTICE: finished shard 9 (3 entries removed) 2024-02-23T06:42:31.383 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.383+0000 7f3f76333800 1 NOTICE: finished all shards (3 entries removed) 2024-02-23T06:42:31.384 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.383+0000 7f3e237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:31.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.386+0000 7f3f76333800 20 remove_watcher() i=0 2024-02-23T06:42:31.386 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.386+0000 7f3f76333800 2 removed watcher, disabling cache 2024-02-23T06:42:31.387 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.387+0000 7f3f76333800 20 remove_watcher() i=1 2024-02-23T06:42:31.388 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.388+0000 7f3f76333800 20 remove_watcher() i=2 2024-02-23T06:42:31.389 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.389+0000 7f3f76333800 20 remove_watcher() i=3 2024-02-23T06:42:31.390 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.390+0000 7f3f76333800 20 remove_watcher() i=4 2024-02-23T06:42:31.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.390+0000 7f3f76333800 20 remove_watcher() i=5 2024-02-23T06:42:31.391 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.391+0000 7f3f76333800 20 remove_watcher() i=6 2024-02-23T06:42:31.392 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.392+0000 7f3f76333800 20 remove_watcher() i=7 2024-02-23T06:42:31.452 INFO:tasks.workunit.client.0.smithi142.stderr:radosgw-admin bucket stats --bucket myver 2024-02-23T06:42:31.479 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:31.479 INFO:tasks.workunit.client.0.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:31.512 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.512+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.513+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.513+0000 7f4891230800 20 realm 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.513+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.513+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.513+0000 7f4891230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.513+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.514+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.514 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.514+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.514+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:31.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.514+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.515+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:31.515 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.515+0000 7f4891230800 20 searching for the correct realm 2024-02-23T06:42:31.518 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.518+0000 7f488ca4c640 0 -- 172.21.15.142:0/815975215 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f487402f040 msgr2=0x7f4874020940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:31.521 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.521+0000 7f488c24b640 0 -- 172.21.15.142:0/815975215 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f487402f420 msgr2=0x7f487402f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:31.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:31.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:31.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:31.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:31.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:31.526 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:31.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.525+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:31.527 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:31.528 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 zone default found 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 4 Realm: () 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 zonegroup default 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.526+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.527+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.527+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.527+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.527+0000 7f4891230800 20 started sync module instance, tier type = 2024-02-23T06:42:31.529 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.527+0000 7f4891230800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=0 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=1 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=2 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=3 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=4 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=5 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.535+0000 7f4891230800 20 add_watcher() i=6 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.536+0000 7f4891230800 20 add_watcher() i=7 2024-02-23T06:42:31.536 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.536+0000 7f4891230800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:31.538 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.537+0000 7f4742fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:31.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4891230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:31.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4891230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:31.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4891230800 5 note: GC not initialized 2024-02-23T06:42:31.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4741fdb640 20 reqs_thread_entry: start 2024-02-23T06:42:31.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4891230800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:31.540 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4891230800 20 Filter name: none 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f46b37fe640 20 reqs_thread_entry: start 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.538+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=173 2024-02-23T06:42:31.541 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.539+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.540+0000 7f4891230800 20 rados_obj.operate() r=0 bl.length=357 2024-02-23T06:42:31.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.540+0000 7f4891230800 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-23T06:42:31.542 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.541+0000 7f4891230800 20 rados->read ofs=0 len=0 2024-02-23T06:42:31.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.541+0000 7f4891230800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:31.543 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.542+0000 7f4742fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:31.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.544+0000 7f4891230800 20 remove_watcher() i=0 2024-02-23T06:42:31.544 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.544+0000 7f4891230800 2 removed watcher, disabling cache 2024-02-23T06:42:31.545 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.545+0000 7f4891230800 20 remove_watcher() i=1 2024-02-23T06:42:31.546 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.546+0000 7f4891230800 20 remove_watcher() i=2 2024-02-23T06:42:31.547 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.547+0000 7f4891230800 20 remove_watcher() i=3 2024-02-23T06:42:31.548 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.548+0000 7f4891230800 20 remove_watcher() i=4 2024-02-23T06:42:31.549 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.549+0000 7f4891230800 20 remove_watcher() i=5 2024-02-23T06:42:31.550 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.550+0000 7f4891230800 20 remove_watcher() i=6 2024-02-23T06:42:31.551 INFO:tasks.workunit.client.0.smithi142.stderr:2024-02-23T06:42:31.551+0000 7f4891230800 20 remove_watcher() i=7 2024-02-23T06:42:31.561 INFO:tasks.workunit.client.0.smithi142.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-02-23T06:42:31.561 INFO:tasks.workunit.client.0.smithi142.stderr:Deleting bucket a-bucket 2024-02-23T06:42:31.578 INFO:tasks.workunit.client.0.smithi142.stderr:Deleting bucket myver 2024-02-23T06:42:31.658 INFO:tasks.workunit.client.0.smithi142.stderr:Completed resharding tests 2024-02-23T06:42:31.658 INFO:tasks.workunit.client.0.smithi142.stdout:connected to http://localhost:80 2024-02-23T06:42:31.723 INFO:tasks.workunit.client.0.smithi142.stderr:+ deactivate 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ export PATH 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ unset _OLD_VIRTUAL_PATH 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n '' ']' 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ hash -r 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' -n '' ']' 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ unset VIRTUAL_ENV 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ '[' '!' '' = nondestructive ']' 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ unset -f deactivate 2024-02-23T06:42:31.724 INFO:tasks.workunit.client.0.smithi142.stderr:+ echo OK. 2024-02-23T06:42:31.725 INFO:tasks.workunit.client.0.smithi142.stdout:OK. 2024-02-23T06:42:31.726 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-23T06:42:31.726 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-23T06:42:31.806 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-02-23T06:42:31.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-23T06:42:32.190 DEBUG:teuthology.parallel:result is None 2024-02-23T06:42:32.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:42:32.230 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:42:32.231 DEBUG:teuthology.orchestra.run.smithi142:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-23T06:42:32.297 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-23T06:42:32.297 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-02-23T06:42:32.316 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-02-23T06:42:32.317 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-02-23T06:42:32.317 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-02-23T06:42:32.317 DEBUG:teuthology.orchestra.run.smithi142:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-02-23T06:42:32.364 INFO:teuthology.orchestra.run.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-02-23T06:42:36.686 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-02-23T06:42:36.686 DEBUG:teuthology.orchestra.run.smithi142:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-02-23T06:42:39.790 INFO:teuthology.orchestra.run.smithi142.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-02-23T06:42:40.410 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:18:05 ago on Fri 23 Feb 2024 06:24:35 AM UTC. 2024-02-23T06:42:40.718 INFO:teuthology.orchestra.run.smithi142.stderr:Modular dependency problems: 2024-02-23T06:42:40.718 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:42:40.718 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 1: conflicting requests 2024-02-23T06:42:40.718 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 2: conflicting requests 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 3: conflicting requests 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 4: conflicting requests 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 5: conflicting requests 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 6: conflicting requests 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 7: conflicting requests 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.719 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 8: conflicting requests 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 9: conflicting requests 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 10: conflicting requests 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 11: conflicting requests 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 12: conflicting requests 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 13: conflicting requests 2024-02-23T06:42:40.720 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 14: conflicting requests 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 15: conflicting requests 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 16: conflicting requests 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 17: conflicting requests 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.721 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 18: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 19: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 20: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 21: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 22: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 23: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 24: conflicting requests 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.722 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 25: conflicting requests 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 26: conflicting requests 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 27: conflicting requests 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 28: conflicting requests 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 29: conflicting requests 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 30: conflicting requests 2024-02-23T06:42:40.723 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 31: conflicting requests 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 32: conflicting requests 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 33: conflicting requests 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 34: conflicting requests 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 35: conflicting requests 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 36: conflicting requests 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.724 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 37: cannot install the best candidate for the job 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 38: conflicting requests 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 39: cannot install the best candidate for the job 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.725 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 40: cannot install the best candidate for the job 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 41: cannot install the best candidate for the job 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 42: cannot install the best candidate for the job 2024-02-23T06:42:40.726 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 43: cannot install the best candidate for the job 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: Problem 44: cannot install the best candidate for the job 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.727 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.728 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.728 INFO:teuthology.orchestra.run.smithi142.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-23T06:42:40.792 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-23T06:42:40.792 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-23T06:42:40.792 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout:Install 5 Packages 2024-02-23T06:42:40.793 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:40.794 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 46 M 2024-02-23T06:42:40.794 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 166 M 2024-02-23T06:42:40.794 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-23T06:42:41.012 INFO:teuthology.orchestra.run.smithi142.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.4 MB/s | 426 kB 00:00 2024-02-23T06:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 6.9 MB/s | 3.5 MB 00:00 2024-02-23T06:42:41.388 INFO:teuthology.orchestra.run.smithi142.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 623 kB/s | 26 kB 00:00 2024-02-23T06:42:42.130 INFO:teuthology.orchestra.run.smithi142.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 7.2 MB/s | 9.3 MB 00:01 2024-02-23T06:42:48.679 INFO:teuthology.orchestra.run.smithi142.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 4.2 MB/s | 32 MB 00:07 2024-02-23T06:42:48.680 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-23T06:42:48.680 INFO:teuthology.orchestra.run.smithi142.stdout:Total 5.8 MB/s | 46 MB 00:07 2024-02-23T06:42:49.105 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-23T06:42:49.126 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-23T06:42:49.126 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-23T06:42:49.605 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-23T06:42:49.606 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-23T06:42:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-02-23T06:42:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-23T06:42:50.462 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-02-23T06:42:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-02-23T06:42:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-02-23T06:42:51.352 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-02-23T06:42:51.390 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-02-23T06:42:51.622 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-02-23T06:42:51.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-02-23T06:42:51.668 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-02-23T06:42:51.677 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-02-23T06:42:51.713 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-02-23T06:42:54.629 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-02-23T06:42:54.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-02-23T06:42:54.629 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-02-23T06:42:54.630 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-02-23T06:42:54.630 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-02-23T06:42:55.089 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: gtk2-2.24.33-8.el9.x86_64 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:55.090 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-23T06:42:55.540 INFO:teuthology.orchestra.run.smithi142.stdout: Gradle will be installed under /opt/gradle 2024-02-23T06:42:55.647 INFO:teuthology.orchestra.run.smithi142.stderr:--2024-02-23 06:42:55-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-02-23T06:42:55.935 INFO:teuthology.orchestra.run.smithi142.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8125, ... 2024-02-23T06:42:55.945 INFO:teuthology.orchestra.run.smithi142.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2024-02-23T06:42:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-02-23T06:42:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-02-23T06:42:55.995 INFO:teuthology.orchestra.run.smithi142.stderr:--2024-02-23 06:42:55-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-02-23T06:42:55.996 INFO:teuthology.orchestra.run.smithi142.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-02-23T06:42:56.006 INFO:teuthology.orchestra.run.smithi142.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-02-23T06:42:56.166 INFO:teuthology.orchestra.run.smithi142.stderr:HTTP request sent, awaiting response... 302 Found 2024-02-23T06:42:56.167 INFO:teuthology.orchestra.run.smithi142.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240223%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240223T064256Z&X-Amz-Expires=300&X-Amz-Signature=beb14fccd6d35897ef09d7a7d8092fccbbbda76d2b7e26e7ebf08f72facbc4e7&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-02-23T06:42:56.167 INFO:teuthology.orchestra.run.smithi142.stderr:--2024-02-23 06:42:56-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240223%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240223T064256Z&X-Amz-Expires=300&X-Amz-Signature=beb14fccd6d35897ef09d7a7d8092fccbbbda76d2b7e26e7ebf08f72facbc4e7&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-02-23T06:42:56.167 INFO:teuthology.orchestra.run.smithi142.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.110.133, ... 2024-02-23T06:42:56.182 INFO:teuthology.orchestra.run.smithi142.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-02-23T06:42:56.265 INFO:teuthology.orchestra.run.smithi142.stderr:HTTP request sent, awaiting response... 200 OK 2024-02-23T06:42:56.265 INFO:teuthology.orchestra.run.smithi142.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-02-23T06:42:56.265 INFO:teuthology.orchestra.run.smithi142.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-02-23T06:42:56.265 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:42:56.282 INFO:teuthology.orchestra.run.smithi142.stderr: 0K .......... .......... .......... .......... .......... 0% 2.65M 34s 2024-02-23T06:42:56.297 INFO:teuthology.orchestra.run.smithi142.stderr: 50K .......... .......... .......... .......... .......... 0% 3.14M 32s 2024-02-23T06:42:56.308 INFO:teuthology.orchestra.run.smithi142.stderr: 100K .......... .......... .......... .......... .......... 0% 4.64M 27s 2024-02-23T06:42:56.311 INFO:teuthology.orchestra.run.smithi142.stderr: 150K .......... .......... .......... .......... .......... 0% 16.7M 22s 2024-02-23T06:42:56.313 INFO:teuthology.orchestra.run.smithi142.stderr: 200K .......... .......... .......... .......... .......... 0% 19.7M 18s 2024-02-23T06:42:56.316 INFO:teuthology.orchestra.run.smithi142.stderr: 250K .......... .......... .......... .......... .......... 0% 20.6M 16s 2024-02-23T06:42:56.323 INFO:teuthology.orchestra.run.smithi142.stderr: 300K .......... .......... .......... .......... .......... 0% 6.92M 16s 2024-02-23T06:42:56.325 INFO:teuthology.orchestra.run.smithi142.stderr: 350K .......... .......... .......... .......... .......... 0% 25.0M 14s 2024-02-23T06:42:56.326 INFO:teuthology.orchestra.run.smithi142.stderr: 400K .......... .......... .......... .......... .......... 0% 44.3M 13s 2024-02-23T06:42:56.328 INFO:teuthology.orchestra.run.smithi142.stderr: 450K .......... .......... .......... .......... .......... 0% 26.4M 12s 2024-02-23T06:42:56.329 INFO:teuthology.orchestra.run.smithi142.stderr: 500K .......... .......... .......... .......... .......... 0% 58.1M 11s 2024-02-23T06:42:56.330 INFO:teuthology.orchestra.run.smithi142.stderr: 550K .......... .......... .......... .......... .......... 0% 34.4M 10s 2024-02-23T06:42:56.331 INFO:teuthology.orchestra.run.smithi142.stderr: 600K .......... .......... .......... .......... .......... 0% 40.7M 10s 2024-02-23T06:42:56.338 INFO:teuthology.orchestra.run.smithi142.stderr: 650K .......... .......... .......... .......... .......... 0% 8.01M 10s 2024-02-23T06:42:56.338 INFO:teuthology.orchestra.run.smithi142.stderr: 700K .......... .......... .......... .......... .......... 0% 91.5M 9s 2024-02-23T06:42:56.347 INFO:teuthology.orchestra.run.smithi142.stderr: 750K .......... .......... .......... .......... .......... 0% 27.9M 9s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 800K .......... .......... .......... .......... .......... 0% 106M 8s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 850K .......... .......... .......... .......... .......... 0% 83.2M 8s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 900K .......... .......... .......... .......... .......... 1% 104M 8s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 950K .......... .......... .......... .......... .......... 1% 50.8M 7s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1000K .......... .......... .......... .......... .......... 1% 76.5M 7s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1050K .......... .......... .......... .......... .......... 1% 69.3M 7s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1100K .......... .......... .......... .......... .......... 1% 96.7M 6s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1150K .......... .......... .......... .......... .......... 1% 84.0M 6s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1200K .......... .......... .......... .......... .......... 1% 61.5M 6s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1250K .......... .......... .......... .......... .......... 1% 80.6M 6s 2024-02-23T06:42:56.348 INFO:teuthology.orchestra.run.smithi142.stderr: 1300K .......... .......... .......... .......... .......... 1% 122M 6s 2024-02-23T06:42:56.356 INFO:teuthology.orchestra.run.smithi142.stderr: 1350K .......... .......... .......... .......... .......... 1% 8.71M 6s 2024-02-23T06:42:56.357 INFO:teuthology.orchestra.run.smithi142.stderr: 1400K .......... .......... .......... .......... .......... 1% 104M 6s 2024-02-23T06:42:56.357 INFO:teuthology.orchestra.run.smithi142.stderr: 1450K .......... .......... .......... .......... .......... 1% 90.9M 5s 2024-02-23T06:42:56.357 INFO:teuthology.orchestra.run.smithi142.stderr: 1500K .......... .......... .......... .......... .......... 1% 97.2M 5s 2024-02-23T06:42:56.357 INFO:teuthology.orchestra.run.smithi142.stderr: 1550K .......... .......... .......... .......... .......... 1% 104M 5s 2024-02-23T06:42:56.357 INFO:teuthology.orchestra.run.smithi142.stderr: 1600K .......... .......... .......... .......... .......... 1% 50.8M 5s 2024-02-23T06:42:56.357 INFO:teuthology.orchestra.run.smithi142.stderr: 1650K .......... .......... .......... .......... .......... 1% 134M 5s 2024-02-23T06:42:57.806 INFO:teuthology.orchestra.run.smithi142.stderr: 1700K .......... .......... .......... .......... .......... 1% 51.1M 5s 2024-02-23T06:42:57.806 INFO:teuthology.orchestra.run.smithi142.stderr: 1750K .......... .......... .......... .......... .......... 1% 57.5M 5s 2024-02-23T06:42:57.806 INFO:teuthology.orchestra.run.smithi142.stderr: 1800K .......... .......... .......... .......... .......... 1% 125M 5s 2024-02-23T06:42:57.806 INFO:teuthology.orchestra.run.smithi142.stderr: 1850K .......... .......... .......... .......... .......... 2% 106M 5s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 1900K .......... .......... .......... .......... .......... 2% 82.2M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 1950K .......... .......... .......... .......... .......... 2% 140M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2000K .......... .......... .......... .......... .......... 2% 98.0M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2050K .......... .......... .......... .......... .......... 2% 94.6M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2100K .......... .......... .......... .......... .......... 2% 84.8M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2150K .......... .......... .......... .......... .......... 2% 88.4M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2200K .......... .......... .......... .......... .......... 2% 76.2M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2250K .......... .......... .......... .......... .......... 2% 125M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2300K .......... .......... .......... .......... .......... 2% 74.2M 4s 2024-02-23T06:42:57.807 INFO:teuthology.orchestra.run.smithi142.stderr: 2350K .......... .......... .......... .......... .......... 2% 157M 4s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2400K .......... .......... .......... .......... .......... 2% 93.9M 4s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2450K .......... .......... .......... .......... .......... 2% 113M 4s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2500K .......... .......... .......... .......... .......... 2% 117M 4s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2550K .......... .......... .......... .......... .......... 2% 76.0M 4s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2600K .......... .......... .......... .......... .......... 2% 100M 3s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2650K .......... .......... .......... .......... .......... 2% 93.9M 3s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2700K .......... .......... .......... .......... .......... 2% 116M 3s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2750K .......... .......... .......... .......... .......... 3% 32.7M 3s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2800K .......... .......... .......... .......... .......... 3% 112M 3s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2850K .......... .......... .......... .......... .......... 3% 83.7M 3s 2024-02-23T06:42:57.808 INFO:teuthology.orchestra.run.smithi142.stderr: 2900K .......... .......... .......... .......... .......... 3% 123M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 2950K .......... .......... .......... .......... .......... 3% 116M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3000K .......... .......... .......... .......... .......... 3% 114M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3050K .......... .......... .......... .......... .......... 3% 82.4M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3100K .......... .......... .......... .......... .......... 3% 96.3M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3150K .......... .......... .......... .......... .......... 3% 163M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3200K .......... .......... .......... .......... .......... 3% 97.4M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3250K .......... .......... .......... .......... .......... 3% 93.0M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3300K .......... .......... .......... .......... .......... 3% 109M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3350K .......... .......... .......... .......... .......... 3% 95.6M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3400K .......... .......... .......... .......... .......... 3% 107M 3s 2024-02-23T06:42:57.809 INFO:teuthology.orchestra.run.smithi142.stderr: 3450K .......... .......... .......... .......... .......... 3% 102M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3500K .......... .......... .......... .......... .......... 3% 63.8M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3550K .......... .......... .......... .......... .......... 3% 157M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3600K .......... .......... .......... .......... .......... 3% 156M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3650K .......... .......... .......... .......... .......... 3% 55.3M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3700K .......... .......... .......... .......... .......... 4% 77.9M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3750K .......... .......... .......... .......... .......... 4% 93.4M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3800K .......... .......... .......... .......... .......... 4% 60.4M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3850K .......... .......... .......... .......... .......... 4% 79.5M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3900K .......... .......... .......... .......... .......... 4% 154M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 3950K .......... .......... .......... .......... .......... 4% 119M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 4000K .......... .......... .......... .......... .......... 4% 89.7M 3s 2024-02-23T06:42:57.810 INFO:teuthology.orchestra.run.smithi142.stderr: 4050K .......... .......... .......... .......... .......... 4% 101M 3s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4100K .......... .......... .......... .......... .......... 4% 119M 3s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4150K .......... .......... .......... .......... .......... 4% 122M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4200K .......... .......... .......... .......... .......... 4% 105M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4250K .......... .......... .......... .......... .......... 4% 57.9M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4300K .......... .......... .......... .......... .......... 4% 163M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4350K .......... .......... .......... .......... .......... 4% 119M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4400K .......... .......... .......... .......... .......... 4% 86.2M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4450K .......... .......... .......... .......... .......... 4% 93.2M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4500K .......... .......... .......... .......... .......... 4% 117M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4550K .......... .......... .......... .......... .......... 4% 89.9M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4600K .......... .......... .......... .......... .......... 5% 77.1M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4650K .......... .......... .......... .......... .......... 5% 260M 2s 2024-02-23T06:42:57.811 INFO:teuthology.orchestra.run.smithi142.stderr: 4700K .......... .......... .......... .......... .......... 5% 117M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 4750K .......... .......... .......... .......... .......... 5% 75.7M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 4800K .......... .......... .......... .......... .......... 5% 121M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 4850K .......... .......... .......... .......... .......... 5% 96.4M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 4900K .......... .......... .......... .......... .......... 5% 112M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 4950K .......... .......... .......... .......... .......... 5% 90.0M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5000K .......... .......... .......... .......... .......... 5% 87.4M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5050K .......... .......... .......... .......... .......... 5% 135M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5100K .......... .......... .......... .......... .......... 5% 109M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5150K .......... .......... .......... .......... .......... 5% 83.1M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5200K .......... .......... .......... .......... .......... 5% 110M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5250K .......... .......... .......... .......... .......... 5% 122M 2s 2024-02-23T06:42:57.812 INFO:teuthology.orchestra.run.smithi142.stderr: 5300K .......... .......... .......... .......... .......... 5% 75.6M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5350K .......... .......... .......... .......... .......... 5% 161M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5400K .......... .......... .......... .......... .......... 5% 101M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5450K .......... .......... .......... .......... .......... 5% 109M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5500K .......... .......... .......... .......... .......... 5% 75.3M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5550K .......... .......... .......... .......... .......... 6% 114M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5600K .......... .......... .......... .......... .......... 6% 69.7M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5650K .......... .......... .......... .......... .......... 6% 210M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5700K .......... .......... .......... .......... .......... 6% 89.0M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5750K .......... .......... .......... .......... .......... 6% 116M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5800K .......... .......... .......... .......... .......... 6% 80.0M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5850K .......... .......... .......... .......... .......... 6% 115M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5900K .......... .......... .......... .......... .......... 6% 74.5M 2s 2024-02-23T06:42:57.813 INFO:teuthology.orchestra.run.smithi142.stderr: 5950K .......... .......... .......... .......... .......... 6% 106M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6000K .......... .......... .......... .......... .......... 6% 112M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6050K .......... .......... .......... .......... .......... 6% 89.3M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6100K .......... .......... .......... .......... .......... 6% 114M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6150K .......... .......... .......... .......... .......... 6% 119M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6200K .......... .......... .......... .......... .......... 6% 112M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6250K .......... .......... .......... .......... .......... 6% 107M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6300K .......... .......... .......... .......... .......... 6% 63.7M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6350K .......... .......... .......... .......... .......... 6% 118M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6400K .......... .......... .......... .......... .......... 6% 106M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6450K .......... .......... .......... .......... .......... 6% 98.2M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6500K .......... .......... .......... .......... .......... 7% 106M 2s 2024-02-23T06:42:57.814 INFO:teuthology.orchestra.run.smithi142.stderr: 6550K .......... .......... .......... .......... .......... 7% 84.3M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6600K .......... .......... .......... .......... .......... 7% 114M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6650K .......... .......... .......... .......... .......... 7% 112M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6700K .......... .......... .......... .......... .......... 7% 65.9M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6750K .......... .......... .......... .......... .......... 7% 161M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6800K .......... .......... .......... .......... .......... 7% 93.9M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6850K .......... .......... .......... .......... .......... 7% 107M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6900K .......... .......... .......... .......... .......... 7% 134M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 6950K .......... .......... .......... .......... .......... 7% 87.4M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 7000K .......... .......... .......... .......... .......... 7% 92.9M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 7050K .......... .......... .......... .......... .......... 7% 102M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 7100K .......... .......... .......... .......... .......... 7% 85.3M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 7150K .......... .......... .......... .......... .......... 7% 76.5M 2s 2024-02-23T06:42:57.815 INFO:teuthology.orchestra.run.smithi142.stderr: 7200K .......... .......... .......... .......... .......... 7% 171M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7250K .......... .......... .......... .......... .......... 7% 116M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7300K .......... .......... .......... .......... .......... 7% 70.8M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7350K .......... .......... .......... .......... .......... 7% 116M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7400K .......... .......... .......... .......... .......... 8% 117M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7450K .......... .......... .......... .......... .......... 8% 54.0M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7500K .......... .......... .......... .......... .......... 8% 272M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7550K .......... .......... .......... .......... .......... 8% 105M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7600K .......... .......... .......... .......... .......... 8% 135M 2s 2024-02-23T06:42:57.816 INFO:teuthology.orchestra.run.smithi142.stderr: 7650K .......... .......... .......... .......... .......... 8% 73.4M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 7700K .......... .......... .......... .......... .......... 8% 82.1M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 7750K .......... .......... .......... .......... .......... 8% 95.6M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 7800K .......... .......... .......... .......... .......... 8% 92.8M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 7850K .......... .......... .......... .......... .......... 8% 108M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 7900K .......... .......... .......... .......... .......... 8% 119M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 7950K .......... .......... .......... .......... .......... 8% 67.6M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 8000K .......... .......... .......... .......... .......... 8% 87.0M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 8050K .......... .......... .......... .......... .......... 8% 88.0M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 8100K .......... .......... .......... .......... .......... 8% 122M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 8150K .......... .......... .......... .......... .......... 8% 82.5M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 8200K .......... .......... .......... .......... .......... 8% 99.7M 2s 2024-02-23T06:42:57.817 INFO:teuthology.orchestra.run.smithi142.stderr: 8250K .......... .......... .......... .......... .......... 8% 98.6M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8300K .......... .......... .......... .......... .......... 8% 133M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8350K .......... .......... .......... .......... .......... 9% 69.2M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8400K .......... .......... .......... .......... .......... 9% 130M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8450K .......... .......... .......... .......... .......... 9% 81.0M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8500K .......... .......... .......... .......... .......... 9% 86.7M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8550K .......... .......... .......... .......... .......... 9% 122M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8600K .......... .......... .......... .......... .......... 9% 75.7M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8650K .......... .......... .......... .......... .......... 9% 108M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8700K .......... .......... .......... .......... .......... 9% 90.8M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8750K .......... .......... .......... .......... .......... 9% 101M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8800K .......... .......... .......... .......... .......... 9% 78.5M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8850K .......... .......... .......... .......... .......... 9% 90.5M 2s 2024-02-23T06:42:57.818 INFO:teuthology.orchestra.run.smithi142.stderr: 8900K .......... .......... .......... .......... .......... 9% 92.1M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 8950K .......... .......... .......... .......... .......... 9% 115M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9000K .......... .......... .......... .......... .......... 9% 113M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9050K .......... .......... .......... .......... .......... 9% 92.3M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9100K .......... .......... .......... .......... .......... 9% 56.8M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9150K .......... .......... .......... .......... .......... 9% 140M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9200K .......... .......... .......... .......... .......... 9% 122M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9250K .......... .......... .......... .......... .......... 10% 74.4M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9300K .......... .......... .......... .......... .......... 10% 119M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9350K .......... .......... .......... .......... .......... 10% 54.2M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9400K .......... .......... .......... .......... .......... 10% 136M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9450K .......... .......... .......... .......... .......... 10% 105M 2s 2024-02-23T06:42:57.819 INFO:teuthology.orchestra.run.smithi142.stderr: 9500K .......... .......... .......... .......... .......... 10% 91.6M 2s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9550K .......... .......... .......... .......... .......... 10% 58.0M 2s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9600K .......... .......... .......... .......... .......... 10% 117M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9650K .......... .......... .......... .......... .......... 10% 117M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9700K .......... .......... .......... .......... .......... 10% 110M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9750K .......... .......... .......... .......... .......... 10% 76.5M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9800K .......... .......... .......... .......... .......... 10% 117M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9850K .......... .......... .......... .......... .......... 10% 87.1M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9900K .......... .......... .......... .......... .......... 10% 110M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 9950K .......... .......... .......... .......... .......... 10% 70.7M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 10000K .......... .......... .......... .......... .......... 10% 55.0M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 10050K .......... .......... .......... .......... .......... 10% 209M 1s 2024-02-23T06:42:57.820 INFO:teuthology.orchestra.run.smithi142.stderr: 10100K .......... .......... .......... .......... .......... 10% 76.0M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10150K .......... .......... .......... .......... .......... 10% 128M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10200K .......... .......... .......... .......... .......... 11% 120M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10250K .......... .......... .......... .......... .......... 11% 86.1M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10300K .......... .......... .......... .......... .......... 11% 64.4M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10350K .......... .......... .......... .......... .......... 11% 103M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10400K .......... .......... .......... .......... .......... 11% 85.0M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10450K .......... .......... .......... .......... .......... 11% 117M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10500K .......... .......... .......... .......... .......... 11% 75.8M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10550K .......... .......... .......... .......... .......... 11% 62.1M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10600K .......... .......... .......... .......... .......... 11% 133M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10650K .......... .......... .......... .......... .......... 11% 115M 1s 2024-02-23T06:42:57.821 INFO:teuthology.orchestra.run.smithi142.stderr: 10700K .......... .......... .......... .......... .......... 11% 69.5M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 10750K .......... .......... .......... .......... .......... 11% 52.3M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 10800K .......... .......... .......... .......... .......... 11% 67.4M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 10850K .......... .......... .......... .......... .......... 11% 101M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 10900K .......... .......... .......... .......... .......... 11% 185M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 10950K .......... .......... .......... .......... .......... 11% 82.3M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11000K .......... .......... .......... .......... .......... 11% 87.2M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11050K .......... .......... .......... .......... .......... 11% 95.0M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11100K .......... .......... .......... .......... .......... 12% 109M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11150K .......... .......... .......... .......... .......... 12% 88.5M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11200K .......... .......... .......... .......... .......... 12% 88.3M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11250K .......... .......... .......... .......... .......... 12% 82.2M 1s 2024-02-23T06:42:57.822 INFO:teuthology.orchestra.run.smithi142.stderr: 11300K .......... .......... .......... .......... .......... 12% 71.8M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11350K .......... .......... .......... .......... .......... 12% 126M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11400K .......... .......... .......... .......... .......... 12% 75.2M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11450K .......... .......... .......... .......... .......... 12% 114M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11500K .......... .......... .......... .......... .......... 12% 66.8M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11550K .......... .......... .......... .......... .......... 12% 198M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11600K .......... .......... .......... .......... .......... 12% 78.9M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11650K .......... .......... .......... .......... .......... 12% 118M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11700K .......... .......... .......... .......... .......... 12% 69.8M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11750K .......... .......... .......... .......... .......... 12% 94.8M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11800K .......... .......... .......... .......... .......... 12% 124M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11850K .......... .......... .......... .......... .......... 12% 80.0M 1s 2024-02-23T06:42:57.823 INFO:teuthology.orchestra.run.smithi142.stderr: 11900K .......... .......... .......... .......... .......... 12% 89.8M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 11950K .......... .......... .......... .......... .......... 12% 68.4M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12000K .......... .......... .......... .......... .......... 12% 190M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12050K .......... .......... .......... .......... .......... 13% 96.3M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12100K .......... .......... .......... .......... .......... 13% 73.7M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12150K .......... .......... .......... .......... .......... 13% 79.9M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12200K .......... .......... .......... .......... .......... 13% 112M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12250K .......... .......... .......... .......... .......... 13% 78.1M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12300K .......... .......... .......... .......... .......... 13% 104M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12350K .......... .......... .......... .......... .......... 13% 116M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12400K .......... .......... .......... .......... .......... 13% 73.8M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12450K .......... .......... .......... .......... .......... 13% 97.7M 1s 2024-02-23T06:42:57.824 INFO:teuthology.orchestra.run.smithi142.stderr: 12500K .......... .......... .......... .......... .......... 13% 109M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12550K .......... .......... .......... .......... .......... 13% 93.1M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12600K .......... .......... .......... .......... .......... 13% 113M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12650K .......... .......... .......... .......... .......... 13% 81.7M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12700K .......... .......... .......... .......... .......... 13% 118M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12750K .......... .......... .......... .......... .......... 13% 64.1M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12800K .......... .......... .......... .......... .......... 13% 63.9M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12850K .......... .......... .......... .......... .......... 13% 129M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12900K .......... .......... .......... .......... .......... 13% 80.1M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 12950K .......... .......... .......... .......... .......... 13% 122M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 13000K .......... .......... .......... .......... .......... 14% 75.6M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 13050K .......... .......... .......... .......... .......... 14% 77.7M 1s 2024-02-23T06:42:57.825 INFO:teuthology.orchestra.run.smithi142.stderr: 13100K .......... .......... .......... .......... .......... 14% 124M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13150K .......... .......... .......... .......... .......... 14% 72.4M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13200K .......... .......... .......... .......... .......... 14% 81.4M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13250K .......... .......... .......... .......... .......... 14% 173M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13300K .......... .......... .......... .......... .......... 14% 91.7M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13350K .......... .......... .......... .......... .......... 14% 96.6M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13400K .......... .......... .......... .......... .......... 14% 115M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13450K .......... .......... .......... .......... .......... 14% 77.5M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13500K .......... .......... .......... .......... .......... 14% 78.5M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13550K .......... .......... .......... .......... .......... 14% 92.7M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13600K .......... .......... .......... .......... .......... 14% 123M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13650K .......... .......... .......... .......... .......... 14% 82.1M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13700K .......... .......... .......... .......... .......... 14% 120M 1s 2024-02-23T06:42:57.826 INFO:teuthology.orchestra.run.smithi142.stderr: 13750K .......... .......... .......... .......... .......... 14% 76.3M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 13800K .......... .......... .......... .......... .......... 14% 78.2M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 13850K .......... .......... .......... .......... .......... 14% 63.0M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 13900K .......... .......... .......... .......... .......... 15% 215M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 13950K .......... .......... .......... .......... .......... 15% 89.3M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14000K .......... .......... .......... .......... .......... 15% 97.8M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14050K .......... .......... .......... .......... .......... 15% 83.6M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14100K .......... .......... .......... .......... .......... 15% 93.3M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14150K .......... .......... .......... .......... .......... 15% 97.7M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14200K .......... .......... .......... .......... .......... 15% 92.0M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14250K .......... .......... .......... .......... .......... 15% 105M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14300K .......... .......... .......... .......... .......... 15% 117M 1s 2024-02-23T06:42:57.827 INFO:teuthology.orchestra.run.smithi142.stderr: 14350K .......... .......... .......... .......... .......... 15% 119M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14400K .......... .......... .......... .......... .......... 15% 75.1M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14450K .......... .......... .......... .......... .......... 15% 63.2M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14500K .......... .......... .......... .......... .......... 15% 143M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14550K .......... .......... .......... .......... .......... 15% 99.7M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14600K .......... .......... .......... .......... .......... 15% 108M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14650K .......... .......... .......... .......... .......... 15% 83.2M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14700K .......... .......... .......... .......... .......... 15% 51.8M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14750K .......... .......... .......... .......... .......... 15% 97.5M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14800K .......... .......... .......... .......... .......... 15% 105M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14850K .......... .......... .......... .......... .......... 16% 114M 1s 2024-02-23T06:42:57.828 INFO:teuthology.orchestra.run.smithi142.stderr: 14900K .......... .......... .......... .......... .......... 16% 96.4M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 14950K .......... .......... .......... .......... .......... 16% 76.6M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15000K .......... .......... .......... .......... .......... 16% 91.9M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15050K .......... .......... .......... .......... .......... 16% 158M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15100K .......... .......... .......... .......... .......... 16% 96.9M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15150K .......... .......... .......... .......... .......... 16% 73.2M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15200K .......... .......... .......... .......... .......... 16% 124M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15250K .......... .......... .......... .......... .......... 16% 89.3M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15300K .......... .......... .......... .......... .......... 16% 116M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15350K .......... .......... .......... .......... .......... 16% 80.3M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15400K .......... .......... .......... .......... .......... 16% 70.2M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15450K .......... .......... .......... .......... .......... 16% 101M 1s 2024-02-23T06:42:57.829 INFO:teuthology.orchestra.run.smithi142.stderr: 15500K .......... .......... .......... .......... .......... 16% 82.3M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15550K .......... .......... .......... .......... .......... 16% 117M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15600K .......... .......... .......... .......... .......... 16% 95.2M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15650K .......... .......... .......... .......... .......... 16% 90.1M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15700K .......... .......... .......... .......... .......... 16% 97.5M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15750K .......... .......... .......... .......... .......... 17% 117M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15800K .......... .......... .......... .......... .......... 17% 86.8M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15850K .......... .......... .......... .......... .......... 17% 86.8M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15900K .......... .......... .......... .......... .......... 17% 59.1M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 15950K .......... .......... .......... .......... .......... 17% 134M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 16000K .......... .......... .......... .......... .......... 17% 125M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 16050K .......... .......... .......... .......... .......... 17% 84.9M 1s 2024-02-23T06:42:57.830 INFO:teuthology.orchestra.run.smithi142.stderr: 16100K .......... .......... .......... .......... .......... 17% 117M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16150K .......... .......... .......... .......... .......... 17% 79.4M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16200K .......... .......... .......... .......... .......... 17% 116M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16250K .......... .......... .......... .......... .......... 17% 43.5M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16300K .......... .......... .......... .......... .......... 17% 78.2M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16350K .......... .......... .......... .......... .......... 17% 126M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16400K .......... .......... .......... .......... .......... 17% 102M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16450K .......... .......... .......... .......... .......... 17% 89.7M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16500K .......... .......... .......... .......... .......... 17% 100M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16550K .......... .......... .......... .......... .......... 17% 79.6M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16600K .......... .......... .......... .......... .......... 17% 81.6M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16650K .......... .......... .......... .......... .......... 17% 60.3M 1s 2024-02-23T06:42:57.831 INFO:teuthology.orchestra.run.smithi142.stderr: 16700K .......... .......... .......... .......... .......... 18% 109M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 16750K .......... .......... .......... .......... .......... 18% 114M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 16800K .......... .......... .......... .......... .......... 18% 114M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 16850K .......... .......... .......... .......... .......... 18% 92.7M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 16900K .......... .......... .......... .......... .......... 18% 98.8M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 16950K .......... .......... .......... .......... .......... 18% 117M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 17000K .......... .......... .......... .......... .......... 18% 85.9M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 17050K .......... .......... .......... .......... .......... 18% 50.7M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 17100K .......... .......... .......... .......... .......... 18% 100M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 17150K .......... .......... .......... .......... .......... 18% 113M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 17200K .......... .......... .......... .......... .......... 18% 122M 1s 2024-02-23T06:42:57.832 INFO:teuthology.orchestra.run.smithi142.stderr: 17250K .......... .......... .......... .......... .......... 18% 80.4M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17300K .......... .......... .......... .......... .......... 18% 102M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17350K .......... .......... .......... .......... .......... 18% 98.1M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17400K .......... .......... .......... .......... .......... 18% 59.6M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17450K .......... .......... .......... .......... .......... 18% 102M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17500K .......... .......... .......... .......... .......... 18% 99.6M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17550K .......... .......... .......... .......... .......... 18% 121M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17600K .......... .......... .......... .......... .......... 18% 87.9M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17650K .......... .......... .......... .......... .......... 19% 125M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17700K .......... .......... .......... .......... .......... 19% 80.2M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17750K .......... .......... .......... .......... .......... 19% 125M 1s 2024-02-23T06:42:57.833 INFO:teuthology.orchestra.run.smithi142.stderr: 17800K .......... .......... .......... .......... .......... 19% 77.8M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 17850K .......... .......... .......... .......... .......... 19% 95.1M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 17900K .......... .......... .......... .......... .......... 19% 121M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 17950K .......... .......... .......... .......... .......... 19% 68.5M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18000K .......... .......... .......... .......... .......... 19% 104M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18050K .......... .......... .......... .......... .......... 19% 99.1M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18100K .......... .......... .......... .......... .......... 19% 114M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18150K .......... .......... .......... .......... .......... 19% 80.5M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18200K .......... .......... .......... .......... .......... 19% 89.3M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18250K .......... .......... .......... .......... .......... 19% 90.4M 1s 2024-02-23T06:42:57.834 INFO:teuthology.orchestra.run.smithi142.stderr: 18300K .......... .......... .......... .......... .......... 19% 92.8M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18350K .......... .......... .......... .......... .......... 19% 97.8M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18400K .......... .......... .......... .......... .......... 19% 81.9M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18450K .......... .......... .......... .......... .......... 19% 121M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18500K .......... .......... .......... .......... .......... 19% 93.7M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18550K .......... .......... .......... .......... .......... 20% 73.7M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18600K .......... .......... .......... .......... .......... 20% 110M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18650K .......... .......... .......... .......... .......... 20% 92.1M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18700K .......... .......... .......... .......... .......... 20% 102M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18750K .......... .......... .......... .......... .......... 20% 71.3M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18800K .......... .......... .......... .......... .......... 20% 110M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18850K .......... .......... .......... .......... .......... 20% 126M 1s 2024-02-23T06:42:57.835 INFO:teuthology.orchestra.run.smithi142.stderr: 18900K .......... .......... .......... .......... .......... 20% 78.0M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 18950K .......... .......... .......... .......... .......... 20% 91.0M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19000K .......... .......... .......... .......... .......... 20% 93.9M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19050K .......... .......... .......... .......... .......... 20% 102M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19100K .......... .......... .......... .......... .......... 20% 87.3M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19150K .......... .......... .......... .......... .......... 20% 77.0M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19200K .......... .......... .......... .......... .......... 20% 83.7M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19250K .......... .......... .......... .......... .......... 20% 144M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19300K .......... .......... .......... .......... .......... 20% 106M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19350K .......... .......... .......... .......... .......... 20% 70.8M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19400K .......... .......... .......... .......... .......... 20% 99.8M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19450K .......... .......... .......... .......... .......... 20% 85.5M 1s 2024-02-23T06:42:57.836 INFO:teuthology.orchestra.run.smithi142.stderr: 19500K .......... .......... .......... .......... .......... 21% 121M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19550K .......... .......... .......... .......... .......... 21% 92.6M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19600K .......... .......... .......... .......... .......... 21% 94.4M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19650K .......... .......... .......... .......... .......... 21% 74.3M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19700K .......... .......... .......... .......... .......... 21% 113M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19750K .......... .......... .......... .......... .......... 21% 95.1M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19800K .......... .......... .......... .......... .......... 21% 109M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19850K .......... .......... .......... .......... .......... 21% 70.8M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19900K .......... .......... .......... .......... .......... 21% 95.5M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 19950K .......... .......... .......... .......... .......... 21% 112M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 20000K .......... .......... .......... .......... .......... 21% 65.2M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 20050K .......... .......... .......... .......... .......... 21% 122M 1s 2024-02-23T06:42:57.837 INFO:teuthology.orchestra.run.smithi142.stderr: 20100K .......... .......... .......... .......... .......... 21% 99.6M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20150K .......... .......... .......... .......... .......... 21% 70.6M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20200K .......... .......... .......... .......... .......... 21% 78.0M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20250K .......... .......... .......... .......... .......... 21% 111M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20300K .......... .......... .......... .......... .......... 21% 106M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20350K .......... .......... .......... .......... .......... 21% 94.5M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20400K .......... .......... .......... .......... .......... 22% 86.0M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20450K .......... .......... .......... .......... .......... 22% 73.2M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20500K .......... .......... .......... .......... .......... 22% 169M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20550K .......... .......... .......... .......... .......... 22% 75.0M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20600K .......... .......... .......... .......... .......... 22% 86.2M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20650K .......... .......... .......... .......... .......... 22% 86.7M 1s 2024-02-23T06:42:57.838 INFO:teuthology.orchestra.run.smithi142.stderr: 20700K .......... .......... .......... .......... .......... 22% 115M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 20750K .......... .......... .......... .......... .......... 22% 99.1M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 20800K .......... .......... .......... .......... .......... 22% 85.0M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 20850K .......... .......... .......... .......... .......... 22% 70.2M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 20900K .......... .......... .......... .......... .......... 22% 227M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 20950K .......... .......... .......... .......... .......... 22% 45.4M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21000K .......... .......... .......... .......... .......... 22% 97.1M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21050K .......... .......... .......... .......... .......... 22% 100M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21100K .......... .......... .......... .......... .......... 22% 83.6M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21150K .......... .......... .......... .......... .......... 22% 109M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21200K .......... .......... .......... .......... .......... 22% 98.9M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21250K .......... .......... .......... .......... .......... 22% 54.5M 1s 2024-02-23T06:42:57.839 INFO:teuthology.orchestra.run.smithi142.stderr: 21300K .......... .......... .......... .......... .......... 22% 290M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21350K .......... .......... .......... .......... .......... 23% 63.2M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21400K .......... .......... .......... .......... .......... 23% 109M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21450K .......... .......... .......... .......... .......... 23% 90.6M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21500K .......... .......... .......... .......... .......... 23% 86.3M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21550K .......... .......... .......... .......... .......... 23% 103M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21600K .......... .......... .......... .......... .......... 23% 108M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21650K .......... .......... .......... .......... .......... 23% 53.8M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21700K .......... .......... .......... .......... .......... 23% 165M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21750K .......... .......... .......... .......... .......... 23% 106M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21800K .......... .......... .......... .......... .......... 23% 79.8M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21850K .......... .......... .......... .......... .......... 23% 108M 1s 2024-02-23T06:42:57.840 INFO:teuthology.orchestra.run.smithi142.stderr: 21900K .......... .......... .......... .......... .......... 23% 97.4M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 21950K .......... .......... .......... .......... .......... 23% 87.2M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22000K .......... .......... .......... .......... .......... 23% 116M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22050K .......... .......... .......... .......... .......... 23% 103M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22100K .......... .......... .......... .......... .......... 23% 95.6M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22150K .......... .......... .......... .......... .......... 23% 46.2M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22200K .......... .......... .......... .......... .......... 23% 91.6M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22250K .......... .......... .......... .......... .......... 24% 130M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22300K .......... .......... .......... .......... .......... 24% 114M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22350K .......... .......... .......... .......... .......... 24% 109M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22400K .......... .......... .......... .......... .......... 24% 92.6M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22450K .......... .......... .......... .......... .......... 24% 96.3M 1s 2024-02-23T06:42:57.841 INFO:teuthology.orchestra.run.smithi142.stderr: 22500K .......... .......... .......... .......... .......... 24% 116M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22550K .......... .......... .......... .......... .......... 24% 79.6M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22600K .......... .......... .......... .......... .......... 24% 71.2M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22650K .......... .......... .......... .......... .......... 24% 113M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22700K .......... .......... .......... .......... .......... 24% 81.6M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22750K .......... .......... .......... .......... .......... 24% 110M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22800K .......... .......... .......... .......... .......... 24% 116M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22850K .......... .......... .......... .......... .......... 24% 92.4M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22900K .......... .......... .......... .......... .......... 24% 94.8M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 22950K .......... .......... .......... .......... .......... 24% 67.2M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 23000K .......... .......... .......... .......... .......... 24% 104M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 23050K .......... .......... .......... .......... .......... 24% 81.4M 1s 2024-02-23T06:42:57.842 INFO:teuthology.orchestra.run.smithi142.stderr: 23100K .......... .......... .......... .......... .......... 24% 109M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23150K .......... .......... .......... .......... .......... 24% 97.9M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23200K .......... .......... .......... .......... .......... 25% 80.7M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23250K .......... .......... .......... .......... .......... 25% 116M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23300K .......... .......... .......... .......... .......... 25% 85.3M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23350K .......... .......... .......... .......... .......... 25% 114M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23400K .......... .......... .......... .......... .......... 25% 82.1M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23450K .......... .......... .......... .......... .......... 25% 96.4M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23500K .......... .......... .......... .......... .......... 25% 111M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23550K .......... .......... .......... .......... .......... 25% 65.4M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23600K .......... .......... .......... .......... .......... 25% 95.5M 1s 2024-02-23T06:42:57.843 INFO:teuthology.orchestra.run.smithi142.stderr: 23650K .......... .......... .......... .......... .......... 25% 110M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 23700K .......... .......... .......... .......... .......... 25% 101M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 23750K .......... .......... .......... .......... .......... 25% 95.8M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 23800K .......... .......... .......... .......... .......... 25% 110M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 23850K .......... .......... .......... .......... .......... 25% 59.3M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 23900K .......... .......... .......... .......... .......... 25% 153M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 23950K .......... .......... .......... .......... .......... 25% 123M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 24000K .......... .......... .......... .......... .......... 25% 77.2M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 24050K .......... .......... .......... .......... .......... 25% 94.7M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 24100K .......... .......... .......... .......... .......... 25% 85.8M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 24150K .......... .......... .......... .......... .......... 26% 85.7M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 24200K .......... .......... .......... .......... .......... 26% 103M 1s 2024-02-23T06:42:57.844 INFO:teuthology.orchestra.run.smithi142.stderr: 24250K .......... .......... .......... .......... .......... 26% 97.8M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24300K .......... .......... .......... .......... .......... 26% 88.2M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24350K .......... .......... .......... .......... .......... 26% 94.1M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24400K .......... .......... .......... .......... .......... 26% 81.0M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24450K .......... .......... .......... .......... .......... 26% 116M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24500K .......... .......... .......... .......... .......... 26% 96.2M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24550K .......... .......... .......... .......... .......... 26% 88.0M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24600K .......... .......... .......... .......... .......... 26% 91.0M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24650K .......... .......... .......... .......... .......... 26% 120M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24700K .......... .......... .......... .......... .......... 26% 66.2M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24750K .......... .......... .......... .......... .......... 26% 165M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24800K .......... .......... .......... .......... .......... 26% 78.6M 1s 2024-02-23T06:42:57.845 INFO:teuthology.orchestra.run.smithi142.stderr: 24850K .......... .......... .......... .......... .......... 26% 67.9M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 24900K .......... .......... .......... .......... .......... 26% 126M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 24950K .......... .......... .......... .......... .......... 26% 76.1M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25000K .......... .......... .......... .......... .......... 26% 117M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25050K .......... .......... .......... .......... .......... 27% 110M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25100K .......... .......... .......... .......... .......... 27% 71.6M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25150K .......... .......... .......... .......... .......... 27% 98.9M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25200K .......... .......... .......... .......... .......... 27% 67.0M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25250K .......... .......... .......... .......... .......... 27% 85.3M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25300K .......... .......... .......... .......... .......... 27% 99.2M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25350K .......... .......... .......... .......... .......... 27% 76.1M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25400K .......... .......... .......... .......... .......... 27% 191M 1s 2024-02-23T06:42:57.846 INFO:teuthology.orchestra.run.smithi142.stderr: 25450K .......... .......... .......... .......... .......... 27% 89.0M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25500K .......... .......... .......... .......... .......... 27% 73.1M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25550K .......... .......... .......... .......... .......... 27% 83.0M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25600K .......... .......... .......... .......... .......... 27% 114M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25650K .......... .......... .......... .......... .......... 27% 57.7M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25700K .......... .......... .......... .......... .......... 27% 74.2M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25750K .......... .......... .......... .......... .......... 27% 131M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25800K .......... .......... .......... .......... .......... 27% 109M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25850K .......... .......... .......... .......... .......... 27% 102M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25900K .......... .......... .......... .......... .......... 27% 76.0M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 25950K .......... .......... .......... .......... .......... 27% 93.2M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 26000K .......... .......... .......... .......... .......... 28% 74.5M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 26050K .......... .......... .......... .......... .......... 28% 113M 1s 2024-02-23T06:42:57.847 INFO:teuthology.orchestra.run.smithi142.stderr: 26100K .......... .......... .......... .......... .......... 28% 86.0M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26150K .......... .......... .......... .......... .......... 28% 89.9M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26200K .......... .......... .......... .......... .......... 28% 92.8M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26250K .......... .......... .......... .......... .......... 28% 89.0M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26300K .......... .......... .......... .......... .......... 28% 93.6M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26350K .......... .......... .......... .......... .......... 28% 78.8M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26400K .......... .......... .......... .......... .......... 28% 99.8M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26450K .......... .......... .......... .......... .......... 28% 94.0M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26500K .......... .......... .......... .......... .......... 28% 112M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26550K .......... .......... .......... .......... .......... 28% 84.4M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26600K .......... .......... .......... .......... .......... 28% 121M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26650K .......... .......... .......... .......... .......... 28% 52.6M 1s 2024-02-23T06:42:57.848 INFO:teuthology.orchestra.run.smithi142.stderr: 26700K .......... .......... .......... .......... .......... 28% 80.9M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 26750K .......... .......... .......... .......... .......... 28% 243M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 26800K .......... .......... .......... .......... .......... 28% 91.3M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 26850K .......... .......... .......... .......... .......... 28% 90.0M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 26900K .......... .......... .......... .......... .......... 29% 72.8M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 26950K .......... .......... .......... .......... .......... 29% 136M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27000K .......... .......... .......... .......... .......... 29% 94.6M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27050K .......... .......... .......... .......... .......... 29% 99.8M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27100K .......... .......... .......... .......... .......... 29% 66.1M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27150K .......... .......... .......... .......... .......... 29% 83.4M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27200K .......... .......... .......... .......... .......... 29% 179M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27250K .......... .......... .......... .......... .......... 29% 65.0M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27300K .......... .......... .......... .......... .......... 29% 144M 1s 2024-02-23T06:42:57.849 INFO:teuthology.orchestra.run.smithi142.stderr: 27350K .......... .......... .......... .......... .......... 29% 79.3M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27400K .......... .......... .......... .......... .......... 29% 78.8M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27450K .......... .......... .......... .......... .......... 29% 107M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27500K .......... .......... .......... .......... .......... 29% 73.8M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27550K .......... .......... .......... .......... .......... 29% 109M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27600K .......... .......... .......... .......... .......... 29% 101M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27650K .......... .......... .......... .......... .......... 29% 122M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27700K .......... .......... .......... .......... .......... 29% 63.9M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27750K .......... .......... .......... .......... .......... 29% 114M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27800K .......... .......... .......... .......... .......... 29% 54.9M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27850K .......... .......... .......... .......... .......... 30% 74.4M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27900K .......... .......... .......... .......... .......... 30% 137M 1s 2024-02-23T06:42:57.850 INFO:teuthology.orchestra.run.smithi142.stderr: 27950K .......... .......... .......... .......... .......... 30% 66.0M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28000K .......... .......... .......... .......... .......... 30% 130M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28050K .......... .......... .......... .......... .......... 30% 73.9M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28100K .......... .......... .......... .......... .......... 30% 87.7M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28150K .......... .......... .......... .......... .......... 30% 125M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28200K .......... .......... .......... .......... .......... 30% 111M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28250K .......... .......... .......... .......... .......... 30% 83.5M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28300K .......... .......... .......... .......... .......... 30% 101M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28350K .......... .......... .......... .......... .......... 30% 80.6M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28400K .......... .......... .......... .......... .......... 30% 113M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28450K .......... .......... .......... .......... .......... 30% 87.5M 1s 2024-02-23T06:42:57.851 INFO:teuthology.orchestra.run.smithi142.stderr: 28500K .......... .......... .......... .......... .......... 30% 96.4M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28550K .......... .......... .......... .......... .......... 30% 73.9M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28600K .......... .......... .......... .......... .......... 30% 83.6M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28650K .......... .......... .......... .......... .......... 30% 142M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28700K .......... .......... .......... .......... .......... 30% 94.3M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28750K .......... .......... .......... .......... .......... 31% 86.3M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28800K .......... .......... .......... .......... .......... 31% 83.6M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28850K .......... .......... .......... .......... .......... 31% 122M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28900K .......... .......... .......... .......... .......... 31% 107M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 28950K .......... .......... .......... .......... .......... 31% 80.6M 1s 2024-02-23T06:42:57.852 INFO:teuthology.orchestra.run.smithi142.stderr: 29000K .......... .......... .......... .......... .......... 31% 71.9M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29050K .......... .......... .......... .......... .......... 31% 181M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29100K .......... .......... .......... .......... .......... 31% 72.6M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29150K .......... .......... .......... .......... .......... 31% 87.4M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29200K .......... .......... .......... .......... .......... 31% 98.5M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29250K .......... .......... .......... .......... .......... 31% 78.6M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29300K .......... .......... .......... .......... .......... 31% 103M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29350K .......... .......... .......... .......... .......... 31% 113M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29400K .......... .......... .......... .......... .......... 31% 89.1M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29450K .......... .......... .......... .......... .......... 31% 79.9M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29500K .......... .......... .......... .......... .......... 31% 73.2M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29550K .......... .......... .......... .......... .......... 31% 82.6M 1s 2024-02-23T06:42:57.853 INFO:teuthology.orchestra.run.smithi142.stderr: 29600K .......... .......... .......... .......... .......... 31% 117M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29650K .......... .......... .......... .......... .......... 31% 122M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29700K .......... .......... .......... .......... .......... 32% 81.7M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29750K .......... .......... .......... .......... .......... 32% 108M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29800K .......... .......... .......... .......... .......... 32% 110M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29850K .......... .......... .......... .......... .......... 32% 98.0M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29900K .......... .......... .......... .......... .......... 32% 96.4M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 29950K .......... .......... .......... .......... .......... 32% 54.4M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 30000K .......... .......... .......... .......... .......... 32% 152M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 30050K .......... .......... .......... .......... .......... 32% 97.0M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 30100K .......... .......... .......... .......... .......... 32% 87.2M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 30150K .......... .......... .......... .......... .......... 32% 89.8M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 30200K .......... .......... .......... .......... .......... 32% 87.2M 1s 2024-02-23T06:42:57.854 INFO:teuthology.orchestra.run.smithi142.stderr: 30250K .......... .......... .......... .......... .......... 32% 115M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30300K .......... .......... .......... .......... .......... 32% 80.0M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30350K .......... .......... .......... .......... .......... 32% 45.7M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30400K .......... .......... .......... .......... .......... 32% 102M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30450K .......... .......... .......... .......... .......... 32% 69.8M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30500K .......... .......... .......... .......... .......... 32% 117M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30550K .......... .......... .......... .......... .......... 32% 116M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30600K .......... .......... .......... .......... .......... 32% 82.7M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30650K .......... .......... .......... .......... .......... 33% 113M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30700K .......... .......... .......... .......... .......... 33% 55.1M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30750K .......... .......... .......... .......... .......... 33% 164M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30800K .......... .......... .......... .......... .......... 33% 92.2M 1s 2024-02-23T06:42:57.855 INFO:teuthology.orchestra.run.smithi142.stderr: 30850K .......... .......... .......... .......... .......... 33% 104M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 30900K .......... .......... .......... .......... .......... 33% 69.9M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 30950K .......... .......... .......... .......... .......... 33% 126M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31000K .......... .......... .......... .......... .......... 33% 91.7M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31050K .......... .......... .......... .......... .......... 33% 94.8M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31100K .......... .......... .......... .......... .......... 33% 69.5M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31150K .......... .......... .......... .......... .......... 33% 78.3M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31200K .......... .......... .......... .......... .......... 33% 152M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31250K .......... .......... .......... .......... .......... 33% 80.5M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31300K .......... .......... .......... .......... .......... 33% 99.6M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31350K .......... .......... .......... .......... .......... 33% 101M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31400K .......... .......... .......... .......... .......... 33% 113M 1s 2024-02-23T06:42:57.856 INFO:teuthology.orchestra.run.smithi142.stderr: 31450K .......... .......... .......... .......... .......... 33% 76.2M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31500K .......... .......... .......... .......... .......... 33% 69.2M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31550K .......... .......... .......... .......... .......... 34% 117M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31600K .......... .......... .......... .......... .......... 34% 85.5M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31650K .......... .......... .......... .......... .......... 34% 87.4M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31700K .......... .......... .......... .......... .......... 34% 135M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31750K .......... .......... .......... .......... .......... 34% 71.1M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31800K .......... .......... .......... .......... .......... 34% 85.1M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31850K .......... .......... .......... .......... .......... 34% 77.2M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31900K .......... .......... .......... .......... .......... 34% 117M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 31950K .......... .......... .......... .......... .......... 34% 107M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 32000K .......... .......... .......... .......... .......... 34% 87.0M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 32050K .......... .......... .......... .......... .......... 34% 68.2M 1s 2024-02-23T06:42:57.857 INFO:teuthology.orchestra.run.smithi142.stderr: 32100K .......... .......... .......... .......... .......... 34% 91.6M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32150K .......... .......... .......... .......... .......... 34% 144M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32200K .......... .......... .......... .......... .......... 34% 81.4M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32250K .......... .......... .......... .......... .......... 34% 82.5M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32300K .......... .......... .......... .......... .......... 34% 94.9M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32350K .......... .......... .......... .......... .......... 34% 116M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32400K .......... .......... .......... .......... .......... 34% 110M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32450K .......... .......... .......... .......... .......... 34% 90.2M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32500K .......... .......... .......... .......... .......... 35% 81.6M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32550K .......... .......... .......... .......... .......... 35% 99.7M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32600K .......... .......... .......... .......... .......... 35% 87.6M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32650K .......... .......... .......... .......... .......... 35% 93.1M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32700K .......... .......... .......... .......... .......... 35% 96.5M 1s 2024-02-23T06:42:57.858 INFO:teuthology.orchestra.run.smithi142.stderr: 32750K .......... .......... .......... .......... .......... 35% 83.0M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 32800K .......... .......... .......... .......... .......... 35% 112M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 32850K .......... .......... .......... .......... .......... 35% 84.1M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 32900K .......... .......... .......... .......... .......... 35% 114M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 32950K .......... .......... .......... .......... .......... 35% 114M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33000K .......... .......... .......... .......... .......... 35% 50.9M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33050K .......... .......... .......... .......... .......... 35% 283M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33100K .......... .......... .......... .......... .......... 35% 107M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33150K .......... .......... .......... .......... .......... 35% 31.9M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33200K .......... .......... .......... .......... .......... 35% 38.8M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33250K .......... .......... .......... .......... .......... 35% 236M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33300K .......... .......... .......... .......... .......... 35% 115M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33350K .......... .......... .......... .......... .......... 35% 162M 1s 2024-02-23T06:42:57.859 INFO:teuthology.orchestra.run.smithi142.stderr: 33400K .......... .......... .......... .......... .......... 36% 102M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33450K .......... .......... .......... .......... .......... 36% 138M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33500K .......... .......... .......... .......... .......... 36% 62.7M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33550K .......... .......... .......... .......... .......... 36% 228M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33600K .......... .......... .......... .......... .......... 36% 174M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33650K .......... .......... .......... .......... .......... 36% 82.4M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33700K .......... .......... .......... .......... .......... 36% 204M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33750K .......... .......... .......... .......... .......... 36% 114M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33800K .......... .......... .......... .......... .......... 36% 114M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33850K .......... .......... .......... .......... .......... 36% 120M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33900K .......... .......... .......... .......... .......... 36% 84.4M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 33950K .......... .......... .......... .......... .......... 36% 70.6M 1s 2024-02-23T06:42:57.860 INFO:teuthology.orchestra.run.smithi142.stderr: 34000K .......... .......... .......... .......... .......... 36% 87.9M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34050K .......... .......... .......... .......... .......... 36% 103M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34100K .......... .......... .......... .......... .......... 36% 110M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34150K .......... .......... .......... .......... .......... 36% 63.7M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34200K .......... .......... .......... .......... .......... 36% 110M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34250K .......... .......... .......... .......... .......... 36% 118M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34300K .......... .......... .......... .......... .......... 36% 73.3M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34350K .......... .......... .......... .......... .......... 37% 83.9M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34400K .......... .......... .......... .......... .......... 37% 59.8M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34450K .......... .......... .......... .......... .......... 37% 301M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34500K .......... .......... .......... .......... .......... 37% 95.8M 1s 2024-02-23T06:42:57.861 INFO:teuthology.orchestra.run.smithi142.stderr: 34550K .......... .......... .......... .......... .......... 37% 67.3M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34600K .......... .......... .......... .......... .......... 37% 115M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34650K .......... .......... .......... .......... .......... 37% 91.0M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34700K .......... .......... .......... .......... .......... 37% 117M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34750K .......... .......... .......... .......... .......... 37% 92.6M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34800K .......... .......... .......... .......... .......... 37% 94.6M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34850K .......... .......... .......... .......... .......... 37% 80.3M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34900K .......... .......... .......... .......... .......... 37% 142M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 34950K .......... .......... .......... .......... .......... 37% 65.9M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 35000K .......... .......... .......... .......... .......... 37% 80.4M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 35050K .......... .......... .......... .......... .......... 37% 92.5M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 35100K .......... .......... .......... .......... .......... 37% 96.2M 1s 2024-02-23T06:42:57.862 INFO:teuthology.orchestra.run.smithi142.stderr: 35150K .......... .......... .......... .......... .......... 37% 111M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35200K .......... .......... .......... .......... .......... 37% 83.7M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35250K .......... .......... .......... .......... .......... 37% 66.7M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35300K .......... .......... .......... .......... .......... 38% 148M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35350K .......... .......... .......... .......... .......... 38% 89.7M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35400K .......... .......... .......... .......... .......... 38% 112M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35450K .......... .......... .......... .......... .......... 38% 68.4M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35500K .......... .......... .......... .......... .......... 38% 99.4M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35550K .......... .......... .......... .......... .......... 38% 75.3M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35600K .......... .......... .......... .......... .......... 38% 123M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35650K .......... .......... .......... .......... .......... 38% 105M 1s 2024-02-23T06:42:57.863 INFO:teuthology.orchestra.run.smithi142.stderr: 35700K .......... .......... .......... .......... .......... 38% 83.8M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 35750K .......... .......... .......... .......... .......... 38% 48.8M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 35800K .......... .......... .......... .......... .......... 38% 115M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 35850K .......... .......... .......... .......... .......... 38% 115M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 35900K .......... .......... .......... .......... .......... 38% 122M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 35950K .......... .......... .......... .......... .......... 38% 90.6M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 36000K .......... .......... .......... .......... .......... 38% 80.1M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 36050K .......... .......... .......... .......... .......... 38% 119M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 36100K .......... .......... .......... .......... .......... 38% 89.6M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 36150K .......... .......... .......... .......... .......... 38% 81.0M 1s 2024-02-23T06:42:57.864 INFO:teuthology.orchestra.run.smithi142.stderr: 36200K .......... .......... .......... .......... .......... 39% 110M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36250K .......... .......... .......... .......... .......... 39% 96.2M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36300K .......... .......... .......... .......... .......... 39% 115M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36350K .......... .......... .......... .......... .......... 39% 95.5M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36400K .......... .......... .......... .......... .......... 39% 82.0M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36450K .......... .......... .......... .......... .......... 39% 116M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36500K .......... .......... .......... .......... .......... 39% 80.1M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36550K .......... .......... .......... .......... .......... 39% 85.1M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36600K .......... .......... .......... .......... .......... 39% 93.1M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36650K .......... .......... .......... .......... .......... 39% 51.7M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36700K .......... .......... .......... .......... .......... 39% 88.0M 1s 2024-02-23T06:42:57.865 INFO:teuthology.orchestra.run.smithi142.stderr: 36750K .......... .......... .......... .......... .......... 39% 69.2M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 36800K .......... .......... .......... .......... .......... 39% 64.1M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 36850K .......... .......... .......... .......... .......... 39% 202M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 36900K .......... .......... .......... .......... .......... 39% 137M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 36950K .......... .......... .......... .......... .......... 39% 76.2M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 37000K .......... .......... .......... .......... .......... 39% 97.6M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 37050K .......... .......... .......... .......... .......... 39% 119M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 37100K .......... .......... .......... .......... .......... 39% 66.5M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 37150K .......... .......... .......... .......... .......... 40% 64.8M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 37200K .......... .......... .......... .......... .......... 40% 72.7M 1s 2024-02-23T06:42:57.866 INFO:teuthology.orchestra.run.smithi142.stderr: 37250K .......... .......... .......... .......... .......... 40% 119M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37300K .......... .......... .......... .......... .......... 40% 116M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37350K .......... .......... .......... .......... .......... 40% 82.1M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37400K .......... .......... .......... .......... .......... 40% 99.4M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37450K .......... .......... .......... .......... .......... 40% 89.0M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37500K .......... .......... .......... .......... .......... 40% 119M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37550K .......... .......... .......... .......... .......... 40% 94.9M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37600K .......... .......... .......... .......... .......... 40% 92.9M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37650K .......... .......... .......... .......... .......... 40% 83.0M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37700K .......... .......... .......... .......... .......... 40% 79.2M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37750K .......... .......... .......... .......... .......... 40% 97.8M 1s 2024-02-23T06:42:57.867 INFO:teuthology.orchestra.run.smithi142.stderr: 37800K .......... .......... .......... .......... .......... 40% 113M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 37850K .......... .......... .......... .......... .......... 40% 120M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 37900K .......... .......... .......... .......... .......... 40% 94.9M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 37950K .......... .......... .......... .......... .......... 40% 99.9M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38000K .......... .......... .......... .......... .......... 40% 76.7M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38050K .......... .......... .......... .......... .......... 41% 99.5M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38100K .......... .......... .......... .......... .......... 41% 68.2M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38150K .......... .......... .......... .......... .......... 41% 176M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38200K .......... .......... .......... .......... .......... 41% 115M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38250K .......... .......... .......... .......... .......... 41% 62.5M 1s 2024-02-23T06:42:57.868 INFO:teuthology.orchestra.run.smithi142.stderr: 38300K .......... .......... .......... .......... .......... 41% 169M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38350K .......... .......... .......... .......... .......... 41% 76.6M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38400K .......... .......... .......... .......... .......... 41% 73.2M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38450K .......... .......... .......... .......... .......... 41% 115M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38500K .......... .......... .......... .......... .......... 41% 54.7M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38550K .......... .......... .......... .......... .......... 41% 153M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38600K .......... .......... .......... .......... .......... 41% 93.5M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38650K .......... .......... .......... .......... .......... 41% 117M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38700K .......... .......... .......... .......... .......... 41% 97.8M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38750K .......... .......... .......... .......... .......... 41% 116M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38800K .......... .......... .......... .......... .......... 41% 55.8M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38850K .......... .......... .......... .......... .......... 41% 114M 1s 2024-02-23T06:42:57.869 INFO:teuthology.orchestra.run.smithi142.stderr: 38900K .......... .......... .......... .......... .......... 41% 101M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 38950K .......... .......... .......... .......... .......... 41% 67.0M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39000K .......... .......... .......... .......... .......... 42% 92.1M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39050K .......... .......... .......... .......... .......... 42% 87.4M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39100K .......... .......... .......... .......... .......... 42% 117M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39150K .......... .......... .......... .......... .......... 42% 64.0M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39200K .......... .......... .......... .......... .......... 42% 108M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39250K .......... .......... .......... .......... .......... 42% 58.3M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39300K .......... .......... .......... .......... .......... 42% 169M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39350K .......... .......... .......... .......... .......... 42% 112M 1s 2024-02-23T06:42:57.870 INFO:teuthology.orchestra.run.smithi142.stderr: 39400K .......... .......... .......... .......... .......... 42% 89.9M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39450K .......... .......... .......... .......... .......... 42% 115M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39500K .......... .......... .......... .......... .......... 42% 77.6M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39550K .......... .......... .......... .......... .......... 42% 87.3M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39600K .......... .......... .......... .......... .......... 42% 97.1M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39650K .......... .......... .......... .......... .......... 42% 93.7M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39700K .......... .......... .......... .......... .......... 42% 87.2M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39750K .......... .......... .......... .......... .......... 42% 75.4M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39800K .......... .......... .......... .......... .......... 42% 113M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39850K .......... .......... .......... .......... .......... 42% 97.0M 1s 2024-02-23T06:42:57.871 INFO:teuthology.orchestra.run.smithi142.stderr: 39900K .......... .......... .......... .......... .......... 43% 68.4M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 39950K .......... .......... .......... .......... .......... 43% 98.1M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40000K .......... .......... .......... .......... .......... 43% 90.2M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40050K .......... .......... .......... .......... .......... 43% 92.3M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40100K .......... .......... .......... .......... .......... 43% 89.1M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40150K .......... .......... .......... .......... .......... 43% 121M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40200K .......... .......... .......... .......... .......... 43% 95.0M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40250K .......... .......... .......... .......... .......... 43% 112M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40300K .......... .......... .......... .......... .......... 43% 66.3M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40350K .......... .......... .......... .......... .......... 43% 68.1M 1s 2024-02-23T06:42:57.872 INFO:teuthology.orchestra.run.smithi142.stderr: 40400K .......... .......... .......... .......... .......... 43% 96.1M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40450K .......... .......... .......... .......... .......... 43% 60.8M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40500K .......... .......... .......... .......... .......... 43% 173M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40550K .......... .......... .......... .......... .......... 43% 114M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40600K .......... .......... .......... .......... .......... 43% 51.9M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40650K .......... .......... .......... .......... .......... 43% 77.8M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40700K .......... .......... .......... .......... .......... 43% 78.2M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40750K .......... .......... .......... .......... .......... 43% 48.7M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40800K .......... .......... .......... .......... .......... 43% 80.1M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40850K .......... .......... .......... .......... .......... 44% 122M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40900K .......... .......... .......... .......... .......... 44% 84.5M 1s 2024-02-23T06:42:57.873 INFO:teuthology.orchestra.run.smithi142.stderr: 40950K .......... .......... .......... .......... .......... 44% 84.7M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41000K .......... .......... .......... .......... .......... 44% 98.1M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41050K .......... .......... .......... .......... .......... 44% 100M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41100K .......... .......... .......... .......... .......... 44% 80.1M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41150K .......... .......... .......... .......... .......... 44% 60.5M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41200K .......... .......... .......... .......... .......... 44% 63.1M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41250K .......... .......... .......... .......... .......... 44% 118M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41300K .......... .......... .......... .......... .......... 44% 94.5M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41350K .......... .......... .......... .......... .......... 44% 80.1M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41400K .......... .......... .......... .......... .......... 44% 77.3M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41450K .......... .......... .......... .......... .......... 44% 84.2M 1s 2024-02-23T06:42:57.874 INFO:teuthology.orchestra.run.smithi142.stderr: 41500K .......... .......... .......... .......... .......... 44% 118M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41550K .......... .......... .......... .......... .......... 44% 74.6M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41600K .......... .......... .......... .......... .......... 44% 165M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41650K .......... .......... .......... .......... .......... 44% 95.9M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41700K .......... .......... .......... .......... .......... 44% 119M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41750K .......... .......... .......... .......... .......... 44% 69.5M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41800K .......... .......... .......... .......... .......... 45% 89.0M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41850K .......... .......... .......... .......... .......... 45% 93.2M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41900K .......... .......... .......... .......... .......... 45% 94.5M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 41950K .......... .......... .......... .......... .......... 45% 115M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 42000K .......... .......... .......... .......... .......... 45% 81.4M 1s 2024-02-23T06:42:57.875 INFO:teuthology.orchestra.run.smithi142.stderr: 42050K .......... .......... .......... .......... .......... 45% 73.6M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42100K .......... .......... .......... .......... .......... 45% 97.2M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42150K .......... .......... .......... .......... .......... 45% 114M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42200K .......... .......... .......... .......... .......... 45% 75.1M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42250K .......... .......... .......... .......... .......... 45% 94.9M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42300K .......... .......... .......... .......... .......... 45% 102M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42350K .......... .......... .......... .......... .......... 45% 100M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42400K .......... .......... .......... .......... .......... 45% 103M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42450K .......... .......... .......... .......... .......... 45% 63.1M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42500K .......... .......... .......... .......... .......... 45% 99.5M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42550K .......... .......... .......... .......... .......... 45% 89.5M 1s 2024-02-23T06:42:57.876 INFO:teuthology.orchestra.run.smithi142.stderr: 42600K .......... .......... .......... .......... .......... 45% 56.7M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42650K .......... .......... .......... .......... .......... 45% 93.5M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42700K .......... .......... .......... .......... .......... 46% 149M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42750K .......... .......... .......... .......... .......... 46% 84.0M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42800K .......... .......... .......... .......... .......... 46% 86.7M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42850K .......... .......... .......... .......... .......... 46% 114M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42900K .......... .......... .......... .......... .......... 46% 66.5M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 42950K .......... .......... .......... .......... .......... 46% 114M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 43000K .......... .......... .......... .......... .......... 46% 77.0M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 43050K .......... .......... .......... .......... .......... 46% 76.2M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 43100K .......... .......... .......... .......... .......... 46% 124M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 43150K .......... .......... .......... .......... .......... 46% 90.5M 1s 2024-02-23T06:42:57.877 INFO:teuthology.orchestra.run.smithi142.stderr: 43200K .......... .......... .......... .......... .......... 46% 87.7M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43250K .......... .......... .......... .......... .......... 46% 80.3M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43300K .......... .......... .......... .......... .......... 46% 91.9M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43350K .......... .......... .......... .......... .......... 46% 106M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43400K .......... .......... .......... .......... .......... 46% 84.8M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43450K .......... .......... .......... .......... .......... 46% 115M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43500K .......... .......... .......... .......... .......... 46% 74.2M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43550K .......... .......... .......... .......... .......... 46% 125M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43600K .......... .......... .......... .......... .......... 46% 88.8M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43650K .......... .......... .......... .......... .......... 47% 99.6M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43700K .......... .......... .......... .......... .......... 47% 66.0M 1s 2024-02-23T06:42:57.878 INFO:teuthology.orchestra.run.smithi142.stderr: 43750K .......... .......... .......... .......... .......... 47% 73.7M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 43800K .......... .......... .......... .......... .......... 47% 131M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 43850K .......... .......... .......... .......... .......... 47% 113M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 43900K .......... .......... .......... .......... .......... 47% 53.3M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 43950K .......... .......... .......... .......... .......... 47% 171M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44000K .......... .......... .......... .......... .......... 47% 117M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44050K .......... .......... .......... .......... .......... 47% 56.5M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44100K .......... .......... .......... .......... .......... 47% 117M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44150K .......... .......... .......... .......... .......... 47% 97.3M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44200K .......... .......... .......... .......... .......... 47% 75.5M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44250K .......... .......... .......... .......... .......... 47% 122M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44300K .......... .......... .......... .......... .......... 47% 63.1M 1s 2024-02-23T06:42:57.879 INFO:teuthology.orchestra.run.smithi142.stderr: 44350K .......... .......... .......... .......... .......... 47% 101M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44400K .......... .......... .......... .......... .......... 47% 84.0M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44450K .......... .......... .......... .......... .......... 47% 76.5M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44500K .......... .......... .......... .......... .......... 47% 94.1M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44550K .......... .......... .......... .......... .......... 48% 116M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44600K .......... .......... .......... .......... .......... 48% 83.7M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44650K .......... .......... .......... .......... .......... 48% 82.1M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44700K .......... .......... .......... .......... .......... 48% 70.0M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44750K .......... .......... .......... .......... .......... 48% 127M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44800K .......... .......... .......... .......... .......... 48% 68.7M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44850K .......... .......... .......... .......... .......... 48% 64.7M 1s 2024-02-23T06:42:57.880 INFO:teuthology.orchestra.run.smithi142.stderr: 44900K .......... .......... .......... .......... .......... 48% 93.8M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 44950K .......... .......... .......... .......... .......... 48% 70.6M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45000K .......... .......... .......... .......... .......... 48% 118M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45050K .......... .......... .......... .......... .......... 48% 93.6M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45100K .......... .......... .......... .......... .......... 48% 66.5M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45150K .......... .......... .......... .......... .......... 48% 80.2M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45200K .......... .......... .......... .......... .......... 48% 117M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45250K .......... .......... .......... .......... .......... 48% 79.9M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45300K .......... .......... .......... .......... .......... 48% 51.5M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45350K .......... .......... .......... .......... .......... 48% 89.0M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45400K .......... .......... .......... .......... .......... 48% 87.5M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45450K .......... .......... .......... .......... .......... 48% 116M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45500K .......... .......... .......... .......... .......... 49% 74.9M 1s 2024-02-23T06:42:57.881 INFO:teuthology.orchestra.run.smithi142.stderr: 45550K .......... .......... .......... .......... .......... 49% 94.8M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45600K .......... .......... .......... .......... .......... 49% 64.7M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45650K .......... .......... .......... .......... .......... 49% 107M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45700K .......... .......... .......... .......... .......... 49% 116M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45750K .......... .......... .......... .......... .......... 49% 110M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45800K .......... .......... .......... .......... .......... 49% 93.7M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45850K .......... .......... .......... .......... .......... 49% 67.3M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45900K .......... .......... .......... .......... .......... 49% 115M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 45950K .......... .......... .......... .......... .......... 49% 94.0M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 46000K .......... .......... .......... .......... .......... 49% 55.3M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 46050K .......... .......... .......... .......... .......... 49% 123M 1s 2024-02-23T06:42:57.882 INFO:teuthology.orchestra.run.smithi142.stderr: 46100K .......... .......... .......... .......... .......... 49% 97.3M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46150K .......... .......... .......... .......... .......... 49% 109M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46200K .......... .......... .......... .......... .......... 49% 109M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46250K .......... .......... .......... .......... .......... 49% 99.6M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46300K .......... .......... .......... .......... .......... 49% 72.3M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46350K .......... .......... .......... .......... .......... 49% 85.2M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46400K .......... .......... .......... .......... .......... 49% 121M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46450K .......... .......... .......... .......... .......... 50% 73.2M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46500K .......... .......... .......... .......... .......... 50% 122M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46550K .......... .......... .......... .......... .......... 50% 69.2M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46600K .......... .......... .......... .......... .......... 50% 93.0M 1s 2024-02-23T06:42:57.883 INFO:teuthology.orchestra.run.smithi142.stderr: 46650K .......... .......... .......... .......... .......... 50% 120M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 46700K .......... .......... .......... .......... .......... 50% 53.4M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 46750K .......... .......... .......... .......... .......... 50% 65.1M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 46800K .......... .......... .......... .......... .......... 50% 109M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 46850K .......... .......... .......... .......... .......... 50% 92.6M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 46900K .......... .......... .......... .......... .......... 50% 125M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 46950K .......... .......... .......... .......... .......... 50% 73.1M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 47000K .......... .......... .......... .......... .......... 50% 67.8M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 47050K .......... .......... .......... .......... .......... 50% 101M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 47100K .......... .......... .......... .......... .......... 50% 59.5M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 47150K .......... .......... .......... .......... .......... 50% 119M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 47200K .......... .......... .......... .......... .......... 50% 78.7M 1s 2024-02-23T06:42:57.884 INFO:teuthology.orchestra.run.smithi142.stderr: 47250K .......... .......... .......... .......... .......... 50% 118M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47300K .......... .......... .......... .......... .......... 50% 113M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47350K .......... .......... .......... .......... .......... 51% 119M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47400K .......... .......... .......... .......... .......... 51% 79.2M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47450K .......... .......... .......... .......... .......... 51% 114M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47500K .......... .......... .......... .......... .......... 51% 74.0M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47550K .......... .......... .......... .......... .......... 51% 125M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47600K .......... .......... .......... .......... .......... 51% 65.4M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47650K .......... .......... .......... .......... .......... 51% 137M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47700K .......... .......... .......... .......... .......... 51% 65.7M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47750K .......... .......... .......... .......... .......... 51% 103M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47800K .......... .......... .......... .......... .......... 51% 94.0M 1s 2024-02-23T06:42:57.885 INFO:teuthology.orchestra.run.smithi142.stderr: 47850K .......... .......... .......... .......... .......... 51% 70.3M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 47900K .......... .......... .......... .......... .......... 51% 98.9M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 47950K .......... .......... .......... .......... .......... 51% 90.3M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48000K .......... .......... .......... .......... .......... 51% 120M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48050K .......... .......... .......... .......... .......... 51% 64.3M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48100K .......... .......... .......... .......... .......... 51% 167M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48150K .......... .......... .......... .......... .......... 51% 92.2M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48200K .......... .......... .......... .......... .......... 51% 69.7M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48250K .......... .......... .......... .......... .......... 51% 97.7M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48300K .......... .......... .......... .......... .......... 52% 113M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48350K .......... .......... .......... .......... .......... 52% 95.5M 1s 2024-02-23T06:42:57.886 INFO:teuthology.orchestra.run.smithi142.stderr: 48400K .......... .......... .......... .......... .......... 52% 67.1M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48450K .......... .......... .......... .......... .......... 52% 212M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48500K .......... .......... .......... .......... .......... 52% 113M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48550K .......... .......... .......... .......... .......... 52% 59.8M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48600K .......... .......... .......... .......... .......... 52% 84.6M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48650K .......... .......... .......... .......... .......... 52% 75.9M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48700K .......... .......... .......... .......... .......... 52% 126M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48750K .......... .......... .......... .......... .......... 52% 74.2M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48800K .......... .......... .......... .......... .......... 52% 92.2M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48850K .......... .......... .......... .......... .......... 52% 57.9M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48900K .......... .......... .......... .......... .......... 52% 272M 1s 2024-02-23T06:42:57.887 INFO:teuthology.orchestra.run.smithi142.stderr: 48950K .......... .......... .......... .......... .......... 52% 69.6M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49000K .......... .......... .......... .......... .......... 52% 101M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49050K .......... .......... .......... .......... .......... 52% 81.1M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49100K .......... .......... .......... .......... .......... 52% 73.6M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49150K .......... .......... .......... .......... .......... 52% 107M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49200K .......... .......... .......... .......... .......... 53% 56.6M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49250K .......... .......... .......... .......... .......... 53% 104M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49300K .......... .......... .......... .......... .......... 53% 61.1M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49350K .......... .......... .......... .......... .......... 53% 95.7M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49400K .......... .......... .......... .......... .......... 53% 116M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49450K .......... .......... .......... .......... .......... 53% 95.5M 1s 2024-02-23T06:42:57.888 INFO:teuthology.orchestra.run.smithi142.stderr: 49500K .......... .......... .......... .......... .......... 53% 109M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49550K .......... .......... .......... .......... .......... 53% 53.0M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49600K .......... .......... .......... .......... .......... 53% 241M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49650K .......... .......... .......... .......... .......... 53% 74.6M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49700K .......... .......... .......... .......... .......... 53% 74.4M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49750K .......... .......... .......... .......... .......... 53% 99.0M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49800K .......... .......... .......... .......... .......... 53% 96.0M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49850K .......... .......... .......... .......... .......... 53% 94.5M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49900K .......... .......... .......... .......... .......... 53% 74.5M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 49950K .......... .......... .......... .......... .......... 53% 125M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 50000K .......... .......... .......... .......... .......... 53% 93.1M 1s 2024-02-23T06:42:57.889 INFO:teuthology.orchestra.run.smithi142.stderr: 50050K .......... .......... .......... .......... .......... 53% 118M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50100K .......... .......... .......... .......... .......... 53% 65.6M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50150K .......... .......... .......... .......... .......... 54% 118M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50200K .......... .......... .......... .......... .......... 54% 92.7M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50250K .......... .......... .......... .......... .......... 54% 66.9M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50300K .......... .......... .......... .......... .......... 54% 111M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50350K .......... .......... .......... .......... .......... 54% 123M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50400K .......... .......... .......... .......... .......... 54% 95.3M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50450K .......... .......... .......... .......... .......... 54% 90.3M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50500K .......... .......... .......... .......... .......... 54% 78.3M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50550K .......... .......... .......... .......... .......... 54% 90.7M 1s 2024-02-23T06:42:57.890 INFO:teuthology.orchestra.run.smithi142.stderr: 50600K .......... .......... .......... .......... .......... 54% 120M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50650K .......... .......... .......... .......... .......... 54% 95.9M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50700K .......... .......... .......... .......... .......... 54% 62.3M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50750K .......... .......... .......... .......... .......... 54% 35.6M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50800K .......... .......... .......... .......... .......... 54% 79.4M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50850K .......... .......... .......... .......... .......... 54% 147M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50900K .......... .......... .......... .......... .......... 54% 75.5M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 50950K .......... .......... .......... .......... .......... 54% 99.4M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 51000K .......... .......... .......... .......... .......... 54% 89.3M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 51050K .......... .......... .......... .......... .......... 55% 116M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 51100K .......... .......... .......... .......... .......... 55% 42.4M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 51150K .......... .......... .......... .......... .......... 55% 53.4M 1s 2024-02-23T06:42:57.891 INFO:teuthology.orchestra.run.smithi142.stderr: 51200K .......... .......... .......... .......... .......... 55% 97.6M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51250K .......... .......... .......... .......... .......... 55% 80.8M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51300K .......... .......... .......... .......... .......... 55% 114M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51350K .......... .......... .......... .......... .......... 55% 111M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51400K .......... .......... .......... .......... .......... 55% 74.9M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51450K .......... .......... .......... .......... .......... 55% 119M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51500K .......... .......... .......... .......... .......... 55% 121M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51550K .......... .......... .......... .......... .......... 55% 93.2M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51600K .......... .......... .......... .......... .......... 55% 76.1M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51650K .......... .......... .......... .......... .......... 55% 82.4M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51700K .......... .......... .......... .......... .......... 55% 77.1M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51750K .......... .......... .......... .......... .......... 55% 118M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51800K .......... .......... .......... .......... .......... 55% 69.3M 1s 2024-02-23T06:42:57.892 INFO:teuthology.orchestra.run.smithi142.stderr: 51850K .......... .......... .......... .......... .......... 55% 114M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 51900K .......... .......... .......... .......... .......... 55% 111M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 51950K .......... .......... .......... .......... .......... 55% 117M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52000K .......... .......... .......... .......... .......... 56% 76.6M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52050K .......... .......... .......... .......... .......... 56% 78.3M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52100K .......... .......... .......... .......... .......... 56% 99.5M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52150K .......... .......... .......... .......... .......... 56% 107M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52200K .......... .......... .......... .......... .......... 56% 84.3M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52250K .......... .......... .......... .......... .......... 56% 89.5M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52300K .......... .......... .......... .......... .......... 56% 120M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52350K .......... .......... .......... .......... .......... 56% 74.7M 0s 2024-02-23T06:42:57.893 INFO:teuthology.orchestra.run.smithi142.stderr: 52400K .......... .......... .......... .......... .......... 56% 115M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52450K .......... .......... .......... .......... .......... 56% 115M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52500K .......... .......... .......... .......... .......... 56% 88.0M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52550K .......... .......... .......... .......... .......... 56% 80.4M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52600K .......... .......... .......... .......... .......... 56% 79.9M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52650K .......... .......... .......... .......... .......... 56% 75.2M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52700K .......... .......... .......... .......... .......... 56% 80.3M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52750K .......... .......... .......... .......... .......... 56% 129M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52800K .......... .......... .......... .......... .......... 56% 65.4M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52850K .......... .......... .......... .......... .......... 56% 117M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52900K .......... .......... .......... .......... .......... 56% 111M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 52950K .......... .......... .......... .......... .......... 57% 69.5M 0s 2024-02-23T06:42:57.894 INFO:teuthology.orchestra.run.smithi142.stderr: 53000K .......... .......... .......... .......... .......... 57% 86.3M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53050K .......... .......... .......... .......... .......... 57% 143M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53100K .......... .......... .......... .......... .......... 57% 76.3M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53150K .......... .......... .......... .......... .......... 57% 116M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53200K .......... .......... .......... .......... .......... 57% 92.6M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53250K .......... .......... .......... .......... .......... 57% 71.7M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53300K .......... .......... .......... .......... .......... 57% 57.8M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53350K .......... .......... .......... .......... .......... 57% 215M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53400K .......... .......... .......... .......... .......... 57% 55.7M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53450K .......... .......... .......... .......... .......... 57% 71.0M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53500K .......... .......... .......... .......... .......... 57% 58.0M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53550K .......... .......... .......... .......... .......... 57% 83.6M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53600K .......... .......... .......... .......... .......... 57% 74.6M 0s 2024-02-23T06:42:57.895 INFO:teuthology.orchestra.run.smithi142.stderr: 53650K .......... .......... .......... .......... .......... 57% 144M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 53700K .......... .......... .......... .......... .......... 57% 101M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 53750K .......... .......... .......... .......... .......... 57% 70.0M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 53800K .......... .......... .......... .......... .......... 57% 91.9M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 53850K .......... .......... .......... .......... .......... 58% 114M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 53900K .......... .......... .......... .......... .......... 58% 119M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 53950K .......... .......... .......... .......... .......... 58% 77.7M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 54000K .......... .......... .......... .......... .......... 58% 83.0M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 54050K .......... .......... .......... .......... .......... 58% 87.0M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 54100K .......... .......... .......... .......... .......... 58% 116M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 54150K .......... .......... .......... .......... .......... 58% 76.8M 0s 2024-02-23T06:42:57.896 INFO:teuthology.orchestra.run.smithi142.stderr: 54200K .......... .......... .......... .......... .......... 58% 96.4M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54250K .......... .......... .......... .......... .......... 58% 96.8M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54300K .......... .......... .......... .......... .......... 58% 97.2M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54350K .......... .......... .......... .......... .......... 58% 75.2M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54400K .......... .......... .......... .......... .......... 58% 70.7M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54450K .......... .......... .......... .......... .......... 58% 127M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54500K .......... .......... .......... .......... .......... 58% 75.3M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54550K .......... .......... .......... .......... .......... 58% 95.8M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54600K .......... .......... .......... .......... .......... 58% 118M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54650K .......... .......... .......... .......... .......... 58% 96.6M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54700K .......... .......... .......... .......... .......... 58% 21.2M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54750K .......... .......... .......... .......... .......... 58% 65.0M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54800K .......... .......... .......... .......... .......... 59% 113M 0s 2024-02-23T06:42:57.897 INFO:teuthology.orchestra.run.smithi142.stderr: 54850K .......... .......... .......... .......... .......... 59% 93.9M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 54900K .......... .......... .......... .......... .......... 59% 68.3M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 54950K .......... .......... .......... .......... .......... 59% 76.7M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55000K .......... .......... .......... .......... .......... 59% 92.8M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55050K .......... .......... .......... .......... .......... 59% 115M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55100K .......... .......... .......... .......... .......... 59% 70.1M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55150K .......... .......... .......... .......... .......... 59% 68.9M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55200K .......... .......... .......... .......... .......... 59% 44.6M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55250K .......... .......... .......... .......... .......... 59% 104M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55300K .......... .......... .......... .......... .......... 59% 71.2M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55350K .......... .......... .......... .......... .......... 59% 78.9M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55400K .......... .......... .......... .......... .......... 59% 115M 0s 2024-02-23T06:42:57.898 INFO:teuthology.orchestra.run.smithi142.stderr: 55450K .......... .......... .......... .......... .......... 59% 95.9M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55500K .......... .......... .......... .......... .......... 59% 95.3M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55550K .......... .......... .......... .......... .......... 59% 112M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55600K .......... .......... .......... .......... .......... 59% 82.8M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55650K .......... .......... .......... .......... .......... 59% 100M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55700K .......... .......... .......... .......... .......... 60% 119M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55750K .......... .......... .......... .......... .......... 60% 68.5M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55800K .......... .......... .......... .......... .......... 60% 77.4M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55850K .......... .......... .......... .......... .......... 60% 104M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55900K .......... .......... .......... .......... .......... 60% 76.0M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 55950K .......... .......... .......... .......... .......... 60% 210M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 56000K .......... .......... .......... .......... .......... 60% 76.4M 0s 2024-02-23T06:42:57.899 INFO:teuthology.orchestra.run.smithi142.stderr: 56050K .......... .......... .......... .......... .......... 60% 94.8M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56100K .......... .......... .......... .......... .......... 60% 92.6M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56150K .......... .......... .......... .......... .......... 60% 79.9M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56200K .......... .......... .......... .......... .......... 60% 115M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56250K .......... .......... .......... .......... .......... 60% 96.6M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56300K .......... .......... .......... .......... .......... 60% 70.3M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56350K .......... .......... .......... .......... .......... 60% 84.8M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56400K .......... .......... .......... .......... .......... 60% 83.1M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56450K .......... .......... .......... .......... .......... 60% 84.2M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56500K .......... .......... .......... .......... .......... 60% 85.9M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56550K .......... .......... .......... .......... .......... 60% 77.4M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56600K .......... .......... .......... .......... .......... 60% 82.5M 0s 2024-02-23T06:42:57.900 INFO:teuthology.orchestra.run.smithi142.stderr: 56650K .......... .......... .......... .......... .......... 61% 121M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 56700K .......... .......... .......... .......... .......... 61% 70.1M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 56750K .......... .......... .......... .......... .......... 61% 93.4M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 56800K .......... .......... .......... .......... .......... 61% 113M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 56850K .......... .......... .......... .......... .......... 61% 116M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 56900K .......... .......... .......... .......... .......... 61% 75.2M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 56950K .......... .......... .......... .......... .......... 61% 83.1M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 57000K .......... .......... .......... .......... .......... 61% 124M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 57050K .......... .......... .......... .......... .......... 61% 77.0M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 57100K .......... .......... .......... .......... .......... 61% 114M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 57150K .......... .......... .......... .......... .......... 61% 74.5M 0s 2024-02-23T06:42:57.901 INFO:teuthology.orchestra.run.smithi142.stderr: 57200K .......... .......... .......... .......... .......... 61% 136M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57250K .......... .......... .......... .......... .......... 61% 95.1M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57300K .......... .......... .......... .......... .......... 61% 50.1M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57350K .......... .......... .......... .......... .......... 61% 268M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57400K .......... .......... .......... .......... .......... 61% 80.2M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57450K .......... .......... .......... .......... .......... 61% 82.4M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57500K .......... .......... .......... .......... .......... 61% 87.5M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57550K .......... .......... .......... .......... .......... 62% 77.8M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57600K .......... .......... .......... .......... .......... 62% 157M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57650K .......... .......... .......... .......... .......... 62% 84.4M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57700K .......... .......... .......... .......... .......... 62% 64.3M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57750K .......... .......... .......... .......... .......... 62% 101M 0s 2024-02-23T06:42:57.902 INFO:teuthology.orchestra.run.smithi142.stderr: 57800K .......... .......... .......... .......... .......... 62% 111M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 57850K .......... .......... .......... .......... .......... 62% 110M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 57900K .......... .......... .......... .......... .......... 62% 95.4M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 57950K .......... .......... .......... .......... .......... 62% 71.9M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58000K .......... .......... .......... .......... .......... 62% 107M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58050K .......... .......... .......... .......... .......... 62% 129M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58100K .......... .......... .......... .......... .......... 62% 71.0M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58150K .......... .......... .......... .......... .......... 62% 81.2M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58200K .......... .......... .......... .......... .......... 62% 79.0M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58250K .......... .......... .......... .......... .......... 62% 83.8M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58300K .......... .......... .......... .......... .......... 62% 82.4M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58350K .......... .......... .......... .......... .......... 62% 110M 0s 2024-02-23T06:42:57.903 INFO:teuthology.orchestra.run.smithi142.stderr: 58400K .......... .......... .......... .......... .......... 62% 108M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58450K .......... .......... .......... .......... .......... 62% 66.4M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58500K .......... .......... .......... .......... .......... 63% 70.9M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58550K .......... .......... .......... .......... .......... 63% 151M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58600K .......... .......... .......... .......... .......... 63% 91.7M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58650K .......... .......... .......... .......... .......... 63% 73.3M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58700K .......... .......... .......... .......... .......... 63% 21.9M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58750K .......... .......... .......... .......... .......... 63% 114M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58800K .......... .......... .......... .......... .......... 63% 29.5M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58850K .......... .......... .......... .......... .......... 63% 50.5M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58900K .......... .......... .......... .......... .......... 63% 52.4M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 58950K .......... .......... .......... .......... .......... 63% 86.9M 0s 2024-02-23T06:42:57.904 INFO:teuthology.orchestra.run.smithi142.stderr: 59000K .......... .......... .......... .......... .......... 63% 112M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59050K .......... .......... .......... .......... .......... 63% 49.9M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59100K .......... .......... .......... .......... .......... 63% 71.6M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59150K .......... .......... .......... .......... .......... 63% 81.5M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59200K .......... .......... .......... .......... .......... 63% 115M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59250K .......... .......... .......... .......... .......... 63% 67.0M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59300K .......... .......... .......... .......... .......... 63% 115M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59350K .......... .......... .......... .......... .......... 63% 80.3M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59400K .......... .......... .......... .......... .......... 63% 96.5M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59450K .......... .......... .......... .......... .......... 64% 112M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59500K .......... .......... .......... .......... .......... 64% 94.9M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59550K .......... .......... .......... .......... .......... 64% 89.7M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59600K .......... .......... .......... .......... .......... 64% 76.3M 0s 2024-02-23T06:42:57.905 INFO:teuthology.orchestra.run.smithi142.stderr: 59650K .......... .......... .......... .......... .......... 64% 83.8M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 59700K .......... .......... .......... .......... .......... 64% 116M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 59750K .......... .......... .......... .......... .......... 64% 95.6M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 59800K .......... .......... .......... .......... .......... 64% 113M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 59850K .......... .......... .......... .......... .......... 64% 95.5M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 59900K .......... .......... .......... .......... .......... 64% 116M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 59950K .......... .......... .......... .......... .......... 64% 76.0M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60000K .......... .......... .......... .......... .......... 64% 90.8M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60050K .......... .......... .......... .......... .......... 64% 69.5M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60100K .......... .......... .......... .......... .......... 64% 121M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60150K .......... .......... .......... .......... .......... 64% 114M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60200K .......... .......... .......... .......... .......... 64% 93.5M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60250K .......... .......... .......... .......... .......... 64% 33.9M 0s 2024-02-23T06:42:57.906 INFO:teuthology.orchestra.run.smithi142.stderr: 60300K .......... .......... .......... .......... .......... 64% 88.3M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60350K .......... .......... .......... .......... .......... 65% 97.0M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60400K .......... .......... .......... .......... .......... 65% 72.1M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60450K .......... .......... .......... .......... .......... 65% 96.4M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60500K .......... .......... .......... .......... .......... 65% 114M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60550K .......... .......... .......... .......... .......... 65% 71.5M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60600K .......... .......... .......... .......... .......... 65% 127M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60650K .......... .......... .......... .......... .......... 65% 89.4M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60700K .......... .......... .......... .......... .......... 65% 45.7M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60750K .......... .......... .......... .......... .......... 65% 91.2M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60800K .......... .......... .......... .......... .......... 65% 108M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60850K .......... .......... .......... .......... .......... 65% 120M 0s 2024-02-23T06:42:57.907 INFO:teuthology.orchestra.run.smithi142.stderr: 60900K .......... .......... .......... .......... .......... 65% 77.3M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 60950K .......... .......... .......... .......... .......... 65% 89.0M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61000K .......... .......... .......... .......... .......... 65% 56.3M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61050K .......... .......... .......... .......... .......... 65% 280M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61100K .......... .......... .......... .......... .......... 65% 94.2M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61150K .......... .......... .......... .......... .......... 65% 89.3M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61200K .......... .......... .......... .......... .......... 65% 83.8M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61250K .......... .......... .......... .......... .......... 65% 108M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61300K .......... .......... .......... .......... .......... 66% 85.6M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61350K .......... .......... .......... .......... .......... 66% 131M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61400K .......... .......... .......... .......... .......... 66% 85.7M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61450K .......... .......... .......... .......... .......... 66% 73.5M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61500K .......... .......... .......... .......... .......... 66% 77.6M 0s 2024-02-23T06:42:57.908 INFO:teuthology.orchestra.run.smithi142.stderr: 61550K .......... .......... .......... .......... .......... 66% 113M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61600K .......... .......... .......... .......... .......... 66% 79.1M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61650K .......... .......... .......... .......... .......... 66% 48.1M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61700K .......... .......... .......... .......... .......... 66% 86.4M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61750K .......... .......... .......... .......... .......... 66% 127M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61800K .......... .......... .......... .......... .......... 66% 90.8M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61850K .......... .......... .......... .......... .......... 66% 77.1M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61900K .......... .......... .......... .......... .......... 66% 92.8M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 61950K .......... .......... .......... .......... .......... 66% 64.6M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 62000K .......... .......... .......... .......... .......... 66% 277M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 62050K .......... .......... .......... .......... .......... 66% 111M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 62100K .......... .......... .......... .......... .......... 66% 78.5M 0s 2024-02-23T06:42:57.909 INFO:teuthology.orchestra.run.smithi142.stderr: 62150K .......... .......... .......... .......... .......... 66% 119M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62200K .......... .......... .......... .......... .......... 67% 70.1M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62250K .......... .......... .......... .......... .......... 67% 117M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62300K .......... .......... .......... .......... .......... 67% 70.6M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62350K .......... .......... .......... .......... .......... 67% 117M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62400K .......... .......... .......... .......... .......... 67% 122M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62450K .......... .......... .......... .......... .......... 67% 117M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62500K .......... .......... .......... .......... .......... 67% 78.6M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62550K .......... .......... .......... .......... .......... 67% 96.2M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62600K .......... .......... .......... .......... .......... 67% 55.9M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62650K .......... .......... .......... .......... .......... 67% 84.1M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62700K .......... .......... .......... .......... .......... 67% 12.6M 0s 2024-02-23T06:42:57.910 INFO:teuthology.orchestra.run.smithi142.stderr: 62750K .......... .......... .......... .......... .......... 67% 141M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 62800K .......... .......... .......... .......... .......... 67% 30.1M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 62850K .......... .......... .......... .......... .......... 67% 26.8M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 62900K .......... .......... .......... .......... .......... 67% 117M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 62950K .......... .......... .......... .......... .......... 67% 41.9M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63000K .......... .......... .......... .......... .......... 67% 32.4M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63050K .......... .......... .......... .......... .......... 67% 63.9M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63100K .......... .......... .......... .......... .......... 67% 41.8M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63150K .......... .......... .......... .......... .......... 68% 45.6M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63200K .......... .......... .......... .......... .......... 68% 123M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63250K .......... .......... .......... .......... .......... 68% 93.1M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63300K .......... .......... .......... .......... .......... 68% 53.2M 0s 2024-02-23T06:42:57.911 INFO:teuthology.orchestra.run.smithi142.stderr: 63350K .......... .......... .......... .......... .......... 68% 69.7M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63400K .......... .......... .......... .......... .......... 68% 204M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63450K .......... .......... .......... .......... .......... 68% 114M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63500K .......... .......... .......... .......... .......... 68% 84.5M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63550K .......... .......... .......... .......... .......... 68% 105M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63600K .......... .......... .......... .......... .......... 68% 86.2M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63650K .......... .......... .......... .......... .......... 68% 60.8M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63700K .......... .......... .......... .......... .......... 68% 122M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63750K .......... .......... .......... .......... .......... 68% 92.9M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63800K .......... .......... .......... .......... .......... 68% 108M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63850K .......... .......... .......... .......... .......... 68% 87.0M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63900K .......... .......... .......... .......... .......... 68% 124M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 63950K .......... .......... .......... .......... .......... 68% 74.8M 0s 2024-02-23T06:42:57.912 INFO:teuthology.orchestra.run.smithi142.stderr: 64000K .......... .......... .......... .......... .......... 68% 96.9M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64050K .......... .......... .......... .......... .......... 68% 66.1M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64100K .......... .......... .......... .......... .......... 69% 106M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64150K .......... .......... .......... .......... .......... 69% 103M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64200K .......... .......... .......... .......... .......... 69% 70.9M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64250K .......... .......... .......... .......... .......... 69% 38.6M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64300K .......... .......... .......... .......... .......... 69% 24.8M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64350K .......... .......... .......... .......... .......... 69% 87.8M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64400K .......... .......... .......... .......... .......... 69% 64.1M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64450K .......... .......... .......... .......... .......... 69% 91.6M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64500K .......... .......... .......... .......... .......... 69% 101M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64550K .......... .......... .......... .......... .......... 69% 57.0M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64600K .......... .......... .......... .......... .......... 69% 68.9M 0s 2024-02-23T06:42:57.913 INFO:teuthology.orchestra.run.smithi142.stderr: 64650K .......... .......... .......... .......... .......... 69% 182M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 64700K .......... .......... .......... .......... .......... 69% 86.1M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 64750K .......... .......... .......... .......... .......... 69% 122M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 64800K .......... .......... .......... .......... .......... 69% 69.7M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 64850K .......... .......... .......... .......... .......... 69% 119M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 64900K .......... .......... .......... .......... .......... 69% 71.6M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 64950K .......... .......... .......... .......... .......... 69% 74.3M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65000K .......... .......... .......... .......... .......... 70% 97.7M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65050K .......... .......... .......... .......... .......... 70% 108M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65100K .......... .......... .......... .......... .......... 70% 82.1M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65150K .......... .......... .......... .......... .......... 70% 101M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65200K .......... .......... .......... .......... .......... 70% 69.7M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65250K .......... .......... .......... .......... .......... 70% 94.7M 0s 2024-02-23T06:42:57.914 INFO:teuthology.orchestra.run.smithi142.stderr: 65300K .......... .......... .......... .......... .......... 70% 111M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65350K .......... .......... .......... .......... .......... 70% 97.1M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65400K .......... .......... .......... .......... .......... 70% 88.9M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65450K .......... .......... .......... .......... .......... 70% 101M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65500K .......... .......... .......... .......... .......... 70% 117M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65550K .......... .......... .......... .......... .......... 70% 78.8M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65600K .......... .......... .......... .......... .......... 70% 56.7M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65650K .......... .......... .......... .......... .......... 70% 58.4M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65700K .......... .......... .......... .......... .......... 70% 65.6M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65750K .......... .......... .......... .......... .......... 70% 117M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65800K .......... .......... .......... .......... .......... 70% 73.1M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65850K .......... .......... .......... .......... .......... 70% 96.9M 0s 2024-02-23T06:42:57.915 INFO:teuthology.orchestra.run.smithi142.stderr: 65900K .......... .......... .......... .......... .......... 70% 70.8M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 65950K .......... .......... .......... .......... .......... 71% 96.9M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66000K .......... .......... .......... .......... .......... 71% 80.8M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66050K .......... .......... .......... .......... .......... 71% 94.3M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66100K .......... .......... .......... .......... .......... 71% 75.7M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66150K .......... .......... .......... .......... .......... 71% 141M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66200K .......... .......... .......... .......... .......... 71% 103M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66250K .......... .......... .......... .......... .......... 71% 90.4M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66300K .......... .......... .......... .......... .......... 71% 86.6M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66350K .......... .......... .......... .......... .......... 71% 97.6M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66400K .......... .......... .......... .......... .......... 71% 91.9M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66450K .......... .......... .......... .......... .......... 71% 116M 0s 2024-02-23T06:42:57.916 INFO:teuthology.orchestra.run.smithi142.stderr: 66500K .......... .......... .......... .......... .......... 71% 81.7M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66550K .......... .......... .......... .......... .......... 71% 67.6M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66600K .......... .......... .......... .......... .......... 71% 130M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66650K .......... .......... .......... .......... .......... 71% 118M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66700K .......... .......... .......... .......... .......... 71% 11.1M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66750K .......... .......... .......... .......... .......... 71% 750K 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66800K .......... .......... .......... .......... .......... 71% 256M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66850K .......... .......... .......... .......... .......... 72% 24.9M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66900K .......... .......... .......... .......... .......... 72% 165M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 66950K .......... .......... .......... .......... .......... 72% 325M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 67000K .......... .......... .......... .......... .......... 72% 333M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 67050K .......... .......... .......... .......... .......... 72% 355M 0s 2024-02-23T06:42:57.917 INFO:teuthology.orchestra.run.smithi142.stderr: 67100K .......... .......... .......... .......... .......... 72% 345M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67150K .......... .......... .......... .......... .......... 72% 347M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67200K .......... .......... .......... .......... .......... 72% 421M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67250K .......... .......... .......... .......... .......... 72% 434M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67300K .......... .......... .......... .......... .......... 72% 375M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67350K .......... .......... .......... .......... .......... 72% 348M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67400K .......... .......... .......... .......... .......... 72% 316M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67450K .......... .......... .......... .......... .......... 72% 402M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67500K .......... .......... .......... .......... .......... 72% 389M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67550K .......... .......... .......... .......... .......... 72% 307M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67600K .......... .......... .......... .......... .......... 72% 261M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67650K .......... .......... .......... .......... .......... 72% 323M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67700K .......... .......... .......... .......... .......... 72% 367M 0s 2024-02-23T06:42:57.918 INFO:teuthology.orchestra.run.smithi142.stderr: 67750K .......... .......... .......... .......... .......... 72% 329M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 67800K .......... .......... .......... .......... .......... 73% 387M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 67850K .......... .......... .......... .......... .......... 73% 380M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 67900K .......... .......... .......... .......... .......... 73% 347M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 67950K .......... .......... .......... .......... .......... 73% 323M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68000K .......... .......... .......... .......... .......... 73% 358M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68050K .......... .......... .......... .......... .......... 73% 363M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68100K .......... .......... .......... .......... .......... 73% 379M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68150K .......... .......... .......... .......... .......... 73% 252M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68200K .......... .......... .......... .......... .......... 73% 317M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68250K .......... .......... .......... .......... .......... 73% 382M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68300K .......... .......... .......... .......... .......... 73% 361M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68350K .......... .......... .......... .......... .......... 73% 306M 0s 2024-02-23T06:42:57.919 INFO:teuthology.orchestra.run.smithi142.stderr: 68400K .......... .......... .......... .......... .......... 73% 386M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68450K .......... .......... .......... .......... .......... 73% 340M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68500K .......... .......... .......... .......... .......... 73% 387M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68550K .......... .......... .......... .......... .......... 73% 346M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68600K .......... .......... .......... .......... .......... 73% 365M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68650K .......... .......... .......... .......... .......... 73% 390M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68700K .......... .......... .......... .......... .......... 74% 353M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68750K .......... .......... .......... .......... .......... 74% 311M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68800K .......... .......... .......... .......... .......... 74% 358M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68850K .......... .......... .......... .......... .......... 74% 411M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68900K .......... .......... .......... .......... .......... 74% 444M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 68950K .......... .......... .......... .......... .......... 74% 301M 0s 2024-02-23T06:42:57.920 INFO:teuthology.orchestra.run.smithi142.stderr: 69000K .......... .......... .......... .......... .......... 74% 415M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69050K .......... .......... .......... .......... .......... 74% 349M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69100K .......... .......... .......... .......... .......... 74% 389M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69150K .......... .......... .......... .......... .......... 74% 296M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69200K .......... .......... .......... .......... .......... 74% 403M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69250K .......... .......... .......... .......... .......... 74% 402M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69300K .......... .......... .......... .......... .......... 74% 380M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69350K .......... .......... .......... .......... .......... 74% 334M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69400K .......... .......... .......... .......... .......... 74% 432M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69450K .......... .......... .......... .......... .......... 74% 358M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69500K .......... .......... .......... .......... .......... 74% 413M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69550K .......... .......... .......... .......... .......... 74% 364M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69600K .......... .......... .......... .......... .......... 74% 392M 0s 2024-02-23T06:42:57.921 INFO:teuthology.orchestra.run.smithi142.stderr: 69650K .......... .......... .......... .......... .......... 75% 421M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 69700K .......... .......... .......... .......... .......... 75% 397M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 69750K .......... .......... .......... .......... .......... 75% 327M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 69800K .......... .......... .......... .......... .......... 75% 405M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 69850K .......... .......... .......... .......... .......... 75% 306M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 69900K .......... .......... .......... .......... .......... 75% 396M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 69950K .......... .......... .......... .......... .......... 75% 345M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 70000K .......... .......... .......... .......... .......... 75% 156M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 70050K .......... .......... .......... .......... .......... 75% 376M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 70100K .......... .......... .......... .......... .......... 75% 441M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 70150K .......... .......... .......... .......... .......... 75% 301M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 70200K .......... .......... .......... .......... .......... 75% 422M 0s 2024-02-23T06:42:57.922 INFO:teuthology.orchestra.run.smithi142.stderr: 70250K .......... .......... .......... .......... .......... 75% 428M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70300K .......... .......... .......... .......... .......... 75% 376M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70350K .......... .......... .......... .......... .......... 75% 402M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70400K .......... .......... .......... .......... .......... 75% 428M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70450K .......... .......... .......... .......... .......... 75% 437M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70500K .......... .......... .......... .......... .......... 75% 422M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70550K .......... .......... .......... .......... .......... 75% 332M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70600K .......... .......... .......... .......... .......... 76% 429M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70650K .......... .......... .......... .......... .......... 76% 418M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70700K .......... .......... .......... .......... .......... 76% 6.26M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70750K .......... .......... .......... .......... .......... 76% 22.9M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70800K .......... .......... .......... .......... .......... 76% 42.5M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70850K .......... .......... .......... .......... .......... 76% 130M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70900K .......... .......... .......... .......... .......... 76% 37.3M 0s 2024-02-23T06:42:57.923 INFO:teuthology.orchestra.run.smithi142.stderr: 70950K .......... .......... .......... .......... .......... 76% 39.0M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71000K .......... .......... .......... .......... .......... 76% 37.2M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71050K .......... .......... .......... .......... .......... 76% 93.5M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71100K .......... .......... .......... .......... .......... 76% 47.2M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71150K .......... .......... .......... .......... .......... 76% 109M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71200K .......... .......... .......... .......... .......... 76% 32.1M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71250K .......... .......... .......... .......... .......... 76% 45.9M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71300K .......... .......... .......... .......... .......... 76% 26.8M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71350K .......... .......... .......... .......... .......... 76% 47.1M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71400K .......... .......... .......... .......... .......... 76% 124M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71450K .......... .......... .......... .......... .......... 76% 68.8M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71500K .......... .......... .......... .......... .......... 77% 136M 0s 2024-02-23T06:42:57.924 INFO:teuthology.orchestra.run.smithi142.stderr: 71550K .......... .......... .......... .......... .......... 77% 73.6M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71600K .......... .......... .......... .......... .......... 77% 134M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71650K .......... .......... .......... .......... .......... 77% 36.6M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71700K .......... .......... .......... .......... .......... 77% 48.5M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71750K .......... .......... .......... .......... .......... 77% 62.2M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71800K .......... .......... .......... .......... .......... 77% 33.5M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71850K .......... .......... .......... .......... .......... 77% 120M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71900K .......... .......... .......... .......... .......... 77% 31.4M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 71950K .......... .......... .......... .......... .......... 77% 38.5M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 72000K .......... .......... .......... .......... .......... 77% 47.3M 0s 2024-02-23T06:42:57.925 INFO:teuthology.orchestra.run.smithi142.stderr: 72050K .......... .......... .......... .......... .......... 77% 86.4M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72100K .......... .......... .......... .......... .......... 77% 88.4M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72150K .......... .......... .......... .......... .......... 77% 34.9M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72200K .......... .......... .......... .......... .......... 77% 36.8M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72250K .......... .......... .......... .......... .......... 77% 84.1M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72300K .......... .......... .......... .......... .......... 77% 115M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72350K .......... .......... .......... .......... .......... 77% 83.9M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72400K .......... .......... .......... .......... .......... 77% 57.2M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72450K .......... .......... .......... .......... .......... 78% 85.8M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72500K .......... .......... .......... .......... .......... 78% 50.0M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72550K .......... .......... .......... .......... .......... 78% 118M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72600K .......... .......... .......... .......... .......... 78% 108M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72650K .......... .......... .......... .......... .......... 78% 89.7M 0s 2024-02-23T06:42:57.926 INFO:teuthology.orchestra.run.smithi142.stderr: 72700K .......... .......... .......... .......... .......... 78% 83.9M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 72750K .......... .......... .......... .......... .......... 78% 58.6M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 72800K .......... .......... .......... .......... .......... 78% 18.4M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 72850K .......... .......... .......... .......... .......... 78% 111M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 72900K .......... .......... .......... .......... .......... 78% 70.6M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 72950K .......... .......... .......... .......... .......... 78% 42.3M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 73000K .......... .......... .......... .......... .......... 78% 106M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 73050K .......... .......... .......... .......... .......... 78% 47.1M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 73100K .......... .......... .......... .......... .......... 78% 121M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 73150K .......... .......... .......... .......... .......... 78% 56.4M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 73200K .......... .......... .......... .......... .......... 78% 121M 0s 2024-02-23T06:42:57.927 INFO:teuthology.orchestra.run.smithi142.stderr: 73250K .......... .......... .......... .......... .......... 78% 61.8M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73300K .......... .......... .......... .......... .......... 78% 90.2M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73350K .......... .......... .......... .......... .......... 79% 74.2M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73400K .......... .......... .......... .......... .......... 79% 97.3M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73450K .......... .......... .......... .......... .......... 79% 119M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73500K .......... .......... .......... .......... .......... 79% 76.1M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73550K .......... .......... .......... .......... .......... 79% 12.8M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73600K .......... .......... .......... .......... .......... 79% 159M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73650K .......... .......... .......... .......... .......... 79% 361M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73700K .......... .......... .......... .......... .......... 79% 328M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73750K .......... .......... .......... .......... .......... 79% 415M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73800K .......... .......... .......... .......... .......... 79% 423M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73850K .......... .......... .......... .......... .......... 79% 160M 0s 2024-02-23T06:42:57.928 INFO:teuthology.orchestra.run.smithi142.stderr: 73900K .......... .......... .......... .......... .......... 79% 130M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 73950K .......... .......... .......... .......... .......... 79% 177M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74000K .......... .......... .......... .......... .......... 79% 71.0M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74050K .......... .......... .......... .......... .......... 79% 227M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74100K .......... .......... .......... .......... .......... 79% 148M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74150K .......... .......... .......... .......... .......... 79% 118M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74200K .......... .......... .......... .......... .......... 79% 109M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74250K .......... .......... .......... .......... .......... 79% 64.9M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74300K .......... .......... .......... .......... .......... 80% 97.1M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74350K .......... .......... .......... .......... .......... 80% 108M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74400K .......... .......... .......... .......... .......... 80% 91.1M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74450K .......... .......... .......... .......... .......... 80% 72.5M 0s 2024-02-23T06:42:57.929 INFO:teuthology.orchestra.run.smithi142.stderr: 74500K .......... .......... .......... .......... .......... 80% 201M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74550K .......... .......... .......... .......... .......... 80% 85.1M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74600K .......... .......... .......... .......... .......... 80% 102M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74650K .......... .......... .......... .......... .......... 80% 117M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74700K .......... .......... .......... .......... .......... 80% 49.3M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74750K .......... .......... .......... .......... .......... 80% 41.1M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74800K .......... .......... .......... .......... .......... 80% 41.5M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74850K .......... .......... .......... .......... .......... 80% 31.8M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74900K .......... .......... .......... .......... .......... 80% 103M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 74950K .......... .......... .......... .......... .......... 80% 30.2M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 75000K .......... .......... .......... .......... .......... 80% 36.2M 0s 2024-02-23T06:42:57.930 INFO:teuthology.orchestra.run.smithi142.stderr: 75050K .......... .......... .......... .......... .......... 80% 71.6M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75100K .......... .......... .......... .......... .......... 80% 108M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75150K .......... .......... .......... .......... .......... 80% 25.0M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75200K .......... .......... .......... .......... .......... 81% 20.0M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75250K .......... .......... .......... .......... .......... 81% 55.4M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75300K .......... .......... .......... .......... .......... 81% 42.9M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75350K .......... .......... .......... .......... .......... 81% 118M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75400K .......... .......... .......... .......... .......... 81% 94.1M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75450K .......... .......... .......... .......... .......... 81% 75.0M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75500K .......... .......... .......... .......... .......... 81% 72.3M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75550K .......... .......... .......... .......... .......... 81% 110M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75600K .......... .......... .......... .......... .......... 81% 74.8M 0s 2024-02-23T06:42:57.931 INFO:teuthology.orchestra.run.smithi142.stderr: 75650K .......... .......... .......... .......... .......... 81% 150M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 75700K .......... .......... .......... .......... .......... 81% 65.5M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 75750K .......... .......... .......... .......... .......... 81% 34.1M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 75800K .......... .......... .......... .......... .......... 81% 51.8M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 75850K .......... .......... .......... .......... .......... 81% 30.2M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 75900K .......... .......... .......... .......... .......... 81% 41.6M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 75950K .......... .......... .......... .......... .......... 81% 67.0M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 76000K .......... .......... .......... .......... .......... 81% 33.5M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 76050K .......... .......... .......... .......... .......... 81% 183M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 76100K .......... .......... .......... .......... .......... 81% 60.0M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 76150K .......... .......... .......... .......... .......... 82% 109M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 76200K .......... .......... .......... .......... .......... 82% 106M 0s 2024-02-23T06:42:57.932 INFO:teuthology.orchestra.run.smithi142.stderr: 76250K .......... .......... .......... .......... .......... 82% 92.1M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76300K .......... .......... .......... .......... .......... 82% 61.4M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76350K .......... .......... .......... .......... .......... 82% 68.4M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76400K .......... .......... .......... .......... .......... 82% 79.5M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76450K .......... .......... .......... .......... .......... 82% 32.3M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76500K .......... .......... .......... .......... .......... 82% 69.5M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76550K .......... .......... .......... .......... .......... 82% 110M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76600K .......... .......... .......... .......... .......... 82% 79.0M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76650K .......... .......... .......... .......... .......... 82% 93.0M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76700K .......... .......... .......... .......... .......... 82% 131M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76750K .......... .......... .......... .......... .......... 82% 56.4M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76800K .......... .......... .......... .......... .......... 82% 50.1M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76850K .......... .......... .......... .......... .......... 82% 39.7M 0s 2024-02-23T06:42:57.933 INFO:teuthology.orchestra.run.smithi142.stderr: 76900K .......... .......... .......... .......... .......... 82% 57.2M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 76950K .......... .......... .......... .......... .......... 82% 133M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77000K .......... .......... .......... .......... .......... 82% 81.9M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77050K .......... .......... .......... .......... .......... 82% 98.7M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77100K .......... .......... .......... .......... .......... 83% 59.7M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77150K .......... .......... .......... .......... .......... 83% 84.5M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77200K .......... .......... .......... .......... .......... 83% 100M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77250K .......... .......... .......... .......... .......... 83% 77.3M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77300K .......... .......... .......... .......... .......... 83% 93.4M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77350K .......... .......... .......... .......... .......... 83% 65.7M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77400K .......... .......... .......... .......... .......... 83% 141M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77450K .......... .......... .......... .......... .......... 83% 232M 0s 2024-02-23T06:42:57.934 INFO:teuthology.orchestra.run.smithi142.stderr: 77500K .......... .......... .......... .......... .......... 83% 36.7M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77550K .......... .......... .......... .......... .......... 83% 100M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77600K .......... .......... .......... .......... .......... 83% 39.7M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77650K .......... .......... .......... .......... .......... 83% 69.4M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77700K .......... .......... .......... .......... .......... 83% 126M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77750K .......... .......... .......... .......... .......... 83% 78.7M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77800K .......... .......... .......... .......... .......... 83% 28.0M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77850K .......... .......... .......... .......... .......... 83% 29.6M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77900K .......... .......... .......... .......... .......... 83% 112M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 77950K .......... .......... .......... .......... .......... 83% 37.0M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 78000K .......... .......... .......... .......... .......... 84% 26.0M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 78050K .......... .......... .......... .......... .......... 84% 50.9M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 78100K .......... .......... .......... .......... .......... 84% 29.0M 0s 2024-02-23T06:42:57.935 INFO:teuthology.orchestra.run.smithi142.stderr: 78150K .......... .......... .......... .......... .......... 84% 97.3M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78200K .......... .......... .......... .......... .......... 84% 35.9M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78250K .......... .......... .......... .......... .......... 84% 46.2M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78300K .......... .......... .......... .......... .......... 84% 56.5M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78350K .......... .......... .......... .......... .......... 84% 116M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78400K .......... .......... .......... .......... .......... 84% 95.9M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78450K .......... .......... .......... .......... .......... 84% 46.6M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78500K .......... .......... .......... .......... .......... 84% 90.6M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78550K .......... .......... .......... .......... .......... 84% 71.3M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78600K .......... .......... .......... .......... .......... 84% 94.5M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78650K .......... .......... .......... .......... .......... 84% 70.2M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78700K .......... .......... .......... .......... .......... 84% 96.4M 0s 2024-02-23T06:42:57.936 INFO:teuthology.orchestra.run.smithi142.stderr: 78750K .......... .......... .......... .......... .......... 84% 48.3M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 78800K .......... .......... .......... .......... .......... 84% 132M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 78850K .......... .......... .......... .......... .......... 84% 28.5M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 78900K .......... .......... .......... .......... .......... 84% 45.4M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 78950K .......... .......... .......... .......... .......... 85% 52.3M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79000K .......... .......... .......... .......... .......... 85% 44.4M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79050K .......... .......... .......... .......... .......... 85% 52.1M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79100K .......... .......... .......... .......... .......... 85% 145M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79150K .......... .......... .......... .......... .......... 85% 59.8M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79200K .......... .......... .......... .......... .......... 85% 52.5M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79250K .......... .......... .......... .......... .......... 85% 103M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79300K .......... .......... .......... .......... .......... 85% 106M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79350K .......... .......... .......... .......... .......... 85% 115M 0s 2024-02-23T06:42:57.937 INFO:teuthology.orchestra.run.smithi142.stderr: 79400K .......... .......... .......... .......... .......... 85% 104M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79450K .......... .......... .......... .......... .......... 85% 91.3M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79500K .......... .......... .......... .......... .......... 85% 111M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79550K .......... .......... .......... .......... .......... 85% 65.6M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79600K .......... .......... .......... .......... .......... 85% 49.2M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79650K .......... .......... .......... .......... .......... 85% 131M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79700K .......... .......... .......... .......... .......... 85% 75.2M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79750K .......... .......... .......... .......... .......... 85% 112M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79800K .......... .......... .......... .......... .......... 85% 87.8M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79850K .......... .......... .......... .......... .......... 86% 86.2M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79900K .......... .......... .......... .......... .......... 86% 53.7M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 79950K .......... .......... .......... .......... .......... 86% 58.0M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 80000K .......... .......... .......... .......... .......... 86% 133M 0s 2024-02-23T06:42:57.938 INFO:teuthology.orchestra.run.smithi142.stderr: 80050K .......... .......... .......... .......... .......... 86% 45.1M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80100K .......... .......... .......... .......... .......... 86% 82.0M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80150K .......... .......... .......... .......... .......... 86% 66.7M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80200K .......... .......... .......... .......... .......... 86% 117M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80250K .......... .......... .......... .......... .......... 86% 46.2M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80300K .......... .......... .......... .......... .......... 86% 106M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80350K .......... .......... .......... .......... .......... 86% 76.6M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80400K .......... .......... .......... .......... .......... 86% 111M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80450K .......... .......... .......... .......... .......... 86% 114M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80500K .......... .......... .......... .......... .......... 86% 48.4M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80550K .......... .......... .......... .......... .......... 86% 53.4M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80600K .......... .......... .......... .......... .......... 86% 45.5M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80650K .......... .......... .......... .......... .......... 86% 35.2M 0s 2024-02-23T06:42:57.939 INFO:teuthology.orchestra.run.smithi142.stderr: 80700K .......... .......... .......... .......... .......... 86% 87.1M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 80750K .......... .......... .......... .......... .......... 86% 81.4M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 80800K .......... .......... .......... .......... .......... 87% 27.0M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 80850K .......... .......... .......... .......... .......... 87% 18.2M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 80900K .......... .......... .......... .......... .......... 87% 53.9M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 80950K .......... .......... .......... .......... .......... 87% 71.6M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81000K .......... .......... .......... .......... .......... 87% 56.7M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81050K .......... .......... .......... .......... .......... 87% 49.1M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81100K .......... .......... .......... .......... .......... 87% 49.0M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81150K .......... .......... .......... .......... .......... 87% 119M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81200K .......... .......... .......... .......... .......... 87% 34.0M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81250K .......... .......... .......... .......... .......... 87% 41.3M 0s 2024-02-23T06:42:57.940 INFO:teuthology.orchestra.run.smithi142.stderr: 81300K .......... .......... .......... .......... .......... 87% 49.8M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81350K .......... .......... .......... .......... .......... 87% 57.7M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81400K .......... .......... .......... .......... .......... 87% 86.2M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81450K .......... .......... .......... .......... .......... 87% 67.8M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81500K .......... .......... .......... .......... .......... 87% 75.6M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81550K .......... .......... .......... .......... .......... 87% 45.4M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81600K .......... .......... .......... .......... .......... 87% 143M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81650K .......... .......... .......... .......... .......... 87% 56.6M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81700K .......... .......... .......... .......... .......... 87% 118M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81750K .......... .......... .......... .......... .......... 88% 83.9M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81800K .......... .......... .......... .......... .......... 88% 77.5M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81850K .......... .......... .......... .......... .......... 88% 108M 0s 2024-02-23T06:42:57.941 INFO:teuthology.orchestra.run.smithi142.stderr: 81900K .......... .......... .......... .......... .......... 88% 33.6M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 81950K .......... .......... .......... .......... .......... 88% 49.2M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82000K .......... .......... .......... .......... .......... 88% 42.1M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82050K .......... .......... .......... .......... .......... 88% 54.1M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82100K .......... .......... .......... .......... .......... 88% 120M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82150K .......... .......... .......... .......... .......... 88% 53.9M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82200K .......... .......... .......... .......... .......... 88% 27.2M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82250K .......... .......... .......... .......... .......... 88% 80.4M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82300K .......... .......... .......... .......... .......... 88% 116M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82350K .......... .......... .......... .......... .......... 88% 74.7M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82400K .......... .......... .......... .......... .......... 88% 78.4M 0s 2024-02-23T06:42:57.942 INFO:teuthology.orchestra.run.smithi142.stderr: 82450K .......... .......... .......... .......... .......... 88% 82.3M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82500K .......... .......... .......... .......... .......... 88% 73.2M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82550K .......... .......... .......... .......... .......... 88% 89.7M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82600K .......... .......... .......... .......... .......... 88% 75.6M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82650K .......... .......... .......... .......... .......... 89% 84.3M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82700K .......... .......... .......... .......... .......... 89% 49.4M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82750K .......... .......... .......... .......... .......... 89% 156M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82800K .......... .......... .......... .......... .......... 89% 118M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82850K .......... .......... .......... .......... .......... 89% 63.4M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82900K .......... .......... .......... .......... .......... 89% 55.5M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 82950K .......... .......... .......... .......... .......... 89% 37.3M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 83000K .......... .......... .......... .......... .......... 89% 111M 0s 2024-02-23T06:42:57.943 INFO:teuthology.orchestra.run.smithi142.stderr: 83050K .......... .......... .......... .......... .......... 89% 54.2M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83100K .......... .......... .......... .......... .......... 89% 45.0M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83150K .......... .......... .......... .......... .......... 89% 117M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83200K .......... .......... .......... .......... .......... 89% 36.9M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83250K .......... .......... .......... .......... .......... 89% 93.5M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83300K .......... .......... .......... .......... .......... 89% 60.3M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83350K .......... .......... .......... .......... .......... 89% 73.0M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83400K .......... .......... .......... .......... .......... 89% 63.0M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83450K .......... .......... .......... .......... .......... 89% 50.5M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83500K .......... .......... .......... .......... .......... 89% 49.1M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83550K .......... .......... .......... .......... .......... 89% 116M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83600K .......... .......... .......... .......... .......... 90% 33.8M 0s 2024-02-23T06:42:57.944 INFO:teuthology.orchestra.run.smithi142.stderr: 83650K .......... .......... .......... .......... .......... 90% 63.0M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 83700K .......... .......... .......... .......... .......... 90% 86.5M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 83750K .......... .......... .......... .......... .......... 90% 117M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 83800K .......... .......... .......... .......... .......... 90% 81.9M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 83850K .......... .......... .......... .......... .......... 90% 38.3M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 83900K .......... .......... .......... .......... .......... 90% 55.3M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 83950K .......... .......... .......... .......... .......... 90% 43.4M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 84000K .......... .......... .......... .......... .......... 90% 113M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 84050K .......... .......... .......... .......... .......... 90% 43.3M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 84100K .......... .......... .......... .......... .......... 90% 55.3M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 84150K .......... .......... .......... .......... .......... 90% 40.8M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 84200K .......... .......... .......... .......... .......... 90% 121M 0s 2024-02-23T06:42:57.945 INFO:teuthology.orchestra.run.smithi142.stderr: 84250K .......... .......... .......... .......... .......... 90% 43.6M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84300K .......... .......... .......... .......... .......... 90% 31.2M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84350K .......... .......... .......... .......... .......... 90% 81.5M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84400K .......... .......... .......... .......... .......... 90% 43.4M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84450K .......... .......... .......... .......... .......... 90% 117M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84500K .......... .......... .......... .......... .......... 91% 43.7M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84550K .......... .......... .......... .......... .......... 91% 81.0M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84600K .......... .......... .......... .......... .......... 91% 86.9M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84650K .......... .......... .......... .......... .......... 91% 48.9M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84700K .......... .......... .......... .......... .......... 91% 106M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84750K .......... .......... .......... .......... .......... 91% 94.8M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84800K .......... .......... .......... .......... .......... 91% 82.7M 0s 2024-02-23T06:42:57.946 INFO:teuthology.orchestra.run.smithi142.stderr: 84850K .......... .......... .......... .......... .......... 91% 76.5M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 84900K .......... .......... .......... .......... .......... 91% 94.7M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 84950K .......... .......... .......... .......... .......... 91% 64.7M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85000K .......... .......... .......... .......... .......... 91% 33.0M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85050K .......... .......... .......... .......... .......... 91% 40.8M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85100K .......... .......... .......... .......... .......... 91% 58.0M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85150K .......... .......... .......... .......... .......... 91% 115M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85200K .......... .......... .......... .......... .......... 91% 36.8M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85250K .......... .......... .......... .......... .......... 91% 50.1M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85300K .......... .......... .......... .......... .......... 91% 86.0M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85350K .......... .......... .......... .......... .......... 91% 117M 0s 2024-02-23T06:42:57.947 INFO:teuthology.orchestra.run.smithi142.stderr: 85400K .......... .......... .......... .......... .......... 91% 63.8M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85450K .......... .......... .......... .......... .......... 92% 76.8M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85500K .......... .......... .......... .......... .......... 92% 64.0M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85550K .......... .......... .......... .......... .......... 92% 95.8M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85600K .......... .......... .......... .......... .......... 92% 118M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85650K .......... .......... .......... .......... .......... 92% 56.6M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85700K .......... .......... .......... .......... .......... 92% 50.4M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85750K .......... .......... .......... .......... .......... 92% 69.9M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85800K .......... .......... .......... .......... .......... 92% 71.0M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85850K .......... .......... .......... .......... .......... 92% 131M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85900K .......... .......... .......... .......... .......... 92% 66.0M 0s 2024-02-23T06:42:57.948 INFO:teuthology.orchestra.run.smithi142.stderr: 85950K .......... .......... .......... .......... .......... 92% 43.7M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86000K .......... .......... .......... .......... .......... 92% 57.8M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86050K .......... .......... .......... .......... .......... 92% 114M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86100K .......... .......... .......... .......... .......... 92% 103M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86150K .......... .......... .......... .......... .......... 92% 57.9M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86200K .......... .......... .......... .......... .......... 92% 53.9M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86250K .......... .......... .......... .......... .......... 92% 81.6M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86300K .......... .......... .......... .......... .......... 92% 120M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86350K .......... .......... .......... .......... .......... 93% 66.2M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86400K .......... .......... .......... .......... .......... 93% 77.7M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86450K .......... .......... .......... .......... .......... 93% 106M 0s 2024-02-23T06:42:57.949 INFO:teuthology.orchestra.run.smithi142.stderr: 86500K .......... .......... .......... .......... .......... 93% 118M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86550K .......... .......... .......... .......... .......... 93% 86.4M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86600K .......... .......... .......... .......... .......... 93% 58.6M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86650K .......... .......... .......... .......... .......... 93% 86.5M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86700K .......... .......... .......... .......... .......... 93% 63.3M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86750K .......... .......... .......... .......... .......... 93% 115M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86800K .......... .......... .......... .......... .......... 93% 63.9M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86850K .......... .......... .......... .......... .......... 93% 54.4M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86900K .......... .......... .......... .......... .......... 93% 51.8M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 86950K .......... .......... .......... .......... .......... 93% 52.2M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 87000K .......... .......... .......... .......... .......... 93% 123M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 87050K .......... .......... .......... .......... .......... 93% 38.5M 0s 2024-02-23T06:42:57.950 INFO:teuthology.orchestra.run.smithi142.stderr: 87100K .......... .......... .......... .......... .......... 93% 90.4M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87150K .......... .......... .......... .......... .......... 93% 31.5M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87200K .......... .......... .......... .......... .......... 93% 50.1M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87250K .......... .......... .......... .......... .......... 93% 96.5M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87300K .......... .......... .......... .......... .......... 94% 63.1M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87350K .......... .......... .......... .......... .......... 94% 47.7M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87400K .......... .......... .......... .......... .......... 94% 31.8M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87450K .......... .......... .......... .......... .......... 94% 72.3M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87500K .......... .......... .......... .......... .......... 94% 99.1M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87550K .......... .......... .......... .......... .......... 94% 47.4M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87600K .......... .......... .......... .......... .......... 94% 67.4M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87650K .......... .......... .......... .......... .......... 94% 98.8M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87700K .......... .......... .......... .......... .......... 94% 46.9M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87750K .......... .......... .......... .......... .......... 94% 77.6M 0s 2024-02-23T06:42:57.951 INFO:teuthology.orchestra.run.smithi142.stderr: 87800K .......... .......... .......... .......... .......... 94% 82.4M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 87850K .......... .......... .......... .......... .......... 94% 56.0M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 87900K .......... .......... .......... .......... .......... 94% 81.0M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 87950K .......... .......... .......... .......... .......... 94% 87.8M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88000K .......... .......... .......... .......... .......... 94% 69.0M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88050K .......... .......... .......... .......... .......... 94% 38.9M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88100K .......... .......... .......... .......... .......... 94% 47.8M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88150K .......... .......... .......... .......... .......... 94% 52.7M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88200K .......... .......... .......... .......... .......... 94% 89.7M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88250K .......... .......... .......... .......... .......... 95% 46.7M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88300K .......... .......... .......... .......... .......... 95% 53.6M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88350K .......... .......... .......... .......... .......... 95% 53.6M 0s 2024-02-23T06:42:57.952 INFO:teuthology.orchestra.run.smithi142.stderr: 88400K .......... .......... .......... .......... .......... 95% 90.2M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88450K .......... .......... .......... .......... .......... 95% 79.0M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88500K .......... .......... .......... .......... .......... 95% 65.1M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88550K .......... .......... .......... .......... .......... 95% 72.1M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88600K .......... .......... .......... .......... .......... 95% 75.0M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88650K .......... .......... .......... .......... .......... 95% 73.3M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88700K .......... .......... .......... .......... .......... 95% 130M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88750K .......... .......... .......... .......... .......... 95% 108M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88800K .......... .......... .......... .......... .......... 95% 86.6M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88850K .......... .......... .......... .......... .......... 95% 114M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88900K .......... .......... .......... .......... .......... 95% 54.9M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 88950K .......... .......... .......... .......... .......... 95% 63.4M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 89000K .......... .......... .......... .......... .......... 95% 141M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 89050K .......... .......... .......... .......... .......... 95% 113M 0s 2024-02-23T06:42:57.953 INFO:teuthology.orchestra.run.smithi142.stderr: 89100K .......... .......... .......... .......... .......... 95% 108M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89150K .......... .......... .......... .......... .......... 96% 31.4M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89200K .......... .......... .......... .......... .......... 96% 41.6M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89250K .......... .......... .......... .......... .......... 96% 156M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89300K .......... .......... .......... .......... .......... 96% 140M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89350K .......... .......... .......... .......... .......... 96% 253M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89400K .......... .......... .......... .......... .......... 96% 61.2M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89450K .......... .......... .......... .......... .......... 96% 256M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89500K .......... .......... .......... .......... .......... 96% 270M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89550K .......... .......... .......... .......... .......... 96% 84.0M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89600K .......... .......... .......... .......... .......... 96% 156M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89650K .......... .......... .......... .......... .......... 96% 102M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89700K .......... .......... .......... .......... .......... 96% 110M 0s 2024-02-23T06:42:57.954 INFO:teuthology.orchestra.run.smithi142.stderr: 89750K .......... .......... .......... .......... .......... 96% 54.8M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 89800K .......... .......... .......... .......... .......... 96% 76.6M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 89850K .......... .......... .......... .......... .......... 96% 62.0M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 89900K .......... .......... .......... .......... .......... 96% 58.8M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 89950K .......... .......... .......... .......... .......... 96% 90.6M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90000K .......... .......... .......... .......... .......... 96% 66.5M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90050K .......... .......... .......... .......... .......... 96% 89.3M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90100K .......... .......... .......... .......... .......... 97% 41.4M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90150K .......... .......... .......... .......... .......... 97% 123M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90200K .......... .......... .......... .......... .......... 97% 51.9M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90250K .......... .......... .......... .......... .......... 97% 127M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90300K .......... .......... .......... .......... .......... 97% 36.0M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90350K .......... .......... .......... .......... .......... 97% 46.9M 0s 2024-02-23T06:42:57.955 INFO:teuthology.orchestra.run.smithi142.stderr: 90400K .......... .......... .......... .......... .......... 97% 86.1M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90450K .......... .......... .......... .......... .......... 97% 39.8M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90500K .......... .......... .......... .......... .......... 97% 81.6M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90550K .......... .......... .......... .......... .......... 97% 49.4M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90600K .......... .......... .......... .......... .......... 97% 75.9M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90650K .......... .......... .......... .......... .......... 97% 78.2M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90700K .......... .......... .......... .......... .......... 97% 37.6M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90750K .......... .......... .......... .......... .......... 97% 110M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90800K .......... .......... .......... .......... .......... 97% 89.8M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90850K .......... .......... .......... .......... .......... 97% 45.6M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90900K .......... .......... .......... .......... .......... 97% 46.6M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 90950K .......... .......... .......... .......... .......... 97% 126M 0s 2024-02-23T06:42:57.956 INFO:teuthology.orchestra.run.smithi142.stderr: 91000K .......... .......... .......... .......... .......... 98% 82.3M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91050K .......... .......... .......... .......... .......... 98% 45.5M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91100K .......... .......... .......... .......... .......... 98% 77.8M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91150K .......... .......... .......... .......... .......... 98% 50.0M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91200K .......... .......... .......... .......... .......... 98% 76.9M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91250K .......... .......... .......... .......... .......... 98% 55.1M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91300K .......... .......... .......... .......... .......... 98% 78.1M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91350K .......... .......... .......... .......... .......... 98% 41.5M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91400K .......... .......... .......... .......... .......... 98% 36.5M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91450K .......... .......... .......... .......... .......... 98% 118M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91500K .......... .......... .......... .......... .......... 98% 68.2M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91550K .......... .......... .......... .......... .......... 98% 63.3M 0s 2024-02-23T06:42:57.957 INFO:teuthology.orchestra.run.smithi142.stderr: 91600K .......... .......... .......... .......... .......... 98% 94.1M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91650K .......... .......... .......... .......... .......... 98% 119M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91700K .......... .......... .......... .......... .......... 98% 74.1M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91750K .......... .......... .......... .......... .......... 98% 87.3M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91800K .......... .......... .......... .......... .......... 98% 78.0M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91850K .......... .......... .......... .......... .......... 98% 95.5M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91900K .......... .......... .......... .......... .......... 98% 117M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 91950K .......... .......... .......... .......... .......... 99% 94.7M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 92000K .......... .......... .......... .......... .......... 99% 88.1M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 92050K .......... .......... .......... .......... .......... 99% 109M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 92100K .......... .......... .......... .......... .......... 99% 87.2M 0s 2024-02-23T06:42:57.958 INFO:teuthology.orchestra.run.smithi142.stderr: 92150K .......... .......... .......... .......... .......... 99% 76.0M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92200K .......... .......... .......... .......... .......... 99% 101M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92250K .......... .......... .......... .......... .......... 99% 110M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92300K .......... .......... .......... .......... .......... 99% 93.7M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92350K .......... .......... .......... .......... .......... 99% 110M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92400K .......... .......... .......... .......... .......... 99% 87.9M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92450K .......... .......... .......... .......... .......... 99% 110M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92500K .......... .......... .......... .......... .......... 99% 79.9M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92550K .......... .......... .......... .......... .......... 99% 58.3M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92600K .......... .......... .......... .......... .......... 99% 115M 0s 2024-02-23T06:42:57.959 INFO:teuthology.orchestra.run.smithi142.stderr: 92650K .......... .......... .......... .......... .......... 99% 92.4M 0s 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 92700K .......... .......... .......... .......... .......... 99% 93.7M 0s 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 92750K .......... .......... .......... .......... .......... 99% 68.4M 0s 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 92800K .......... .......... .......... .......... .......... 99% 108M 0s 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 92850K .......... .......... .......... .......... .......... 99% 91.3M 0s 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 92900K 100% 134G=1.2s 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23 06:42:57 (72.8 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-02-23T06:42:57.960 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:42:57.974 INFO:teuthology.orchestra.run.smithi142.stdout:Archive: gradle-6.0.1-bin.zip 2024-02-23T06:42:57.974 INFO:teuthology.orchestra.run.smithi142.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-02-23T06:42:57.974 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-02-23T06:42:57.974 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-02-23T06:42:57.975 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-02-23T06:42:57.976 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-02-23T06:42:57.977 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-02-23T06:42:57.978 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-02-23T06:42:57.979 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-02-23T06:42:57.980 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-02-23T06:42:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-02-23T06:42:57.986 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-02-23T06:42:57.986 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-02-23T06:42:57.986 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-02-23T06:42:57.987 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-02-23T06:42:57.988 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-02-23T06:42:57.989 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-02-23T06:42:57.989 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-02-23T06:42:57.989 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-02-23T06:42:57.990 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-02-23T06:42:57.991 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-02-23T06:42:57.991 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-02-23T06:42:57.993 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-02-23T06:42:57.993 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-02-23T06:42:57.996 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-02-23T06:42:57.997 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-02-23T06:42:57.997 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-02-23T06:42:57.998 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-02-23T06:42:57.999 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-02-23T06:42:57.999 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-02-23T06:42:58.000 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-02-23T06:42:58.002 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-02-23T06:42:58.003 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-02-23T06:42:58.005 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-02-23T06:42:58.006 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-02-23T06:42:58.006 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-02-23T06:42:58.007 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-02-23T06:42:58.007 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-02-23T06:42:58.007 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-02-23T06:42:58.008 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-02-23T06:42:58.010 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-02-23T06:42:58.010 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-02-23T06:42:58.011 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-02-23T06:42:58.014 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-02-23T06:42:58.016 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-02-23T06:42:58.017 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-02-23T06:42:58.018 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-02-23T06:42:58.020 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-02-23T06:42:58.020 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-02-23T06:42:58.026 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-02-23T06:42:58.027 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-02-23T06:42:58.041 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-02-23T06:42:58.043 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-02-23T06:42:58.043 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-02-23T06:42:58.043 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-02-23T06:42:58.043 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-02-23T06:42:58.043 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-02-23T06:42:58.044 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-02-23T06:42:58.044 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-02-23T06:42:58.044 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-02-23T06:42:58.044 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-02-23T06:42:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-02-23T06:42:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-02-23T06:42:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-02-23T06:42:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-02-23T06:42:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-02-23T06:42:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-02-23T06:42:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-02-23T06:42:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-02-23T06:42:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-02-23T06:42:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-02-23T06:42:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-02-23T06:42:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-02-23T06:42:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-02-23T06:42:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-02-23T06:42:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-02-23T06:42:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-02-23T06:42:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-02-23T06:42:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-02-23T06:42:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-02-23T06:42:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-02-23T06:42:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-02-23T06:42:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-02-23T06:42:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-02-23T06:42:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-02-23T06:42:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-02-23T06:42:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-02-23T06:42:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-02-23T06:42:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-02-23T06:42:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-02-23T06:42:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-02-23T06:42:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-02-23T06:42:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-02-23T06:42:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-02-23T06:42:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-02-23T06:42:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-02-23T06:42:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-02-23T06:42:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-02-23T06:42:58.151 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-02-23T06:42:58.151 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-02-23T06:42:58.159 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-02-23T06:42:58.162 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-02-23T06:42:58.162 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-02-23T06:42:58.167 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-02-23T06:42:58.172 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-02-23T06:42:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-02-23T06:42:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-02-23T06:42:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-02-23T06:42:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-02-23T06:42:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-02-23T06:42:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-02-23T06:42:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-02-23T06:42:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-02-23T06:42:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-02-23T06:42:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-02-23T06:42:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-02-23T06:42:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-02-23T06:42:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-02-23T06:42:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-02-23T06:42:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-02-23T06:42:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-02-23T06:42:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-02-23T06:42:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-02-23T06:42:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-02-23T06:42:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-02-23T06:42:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-02-23T06:42:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-02-23T06:42:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-02-23T06:42:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-02-23T06:42:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-02-23T06:42:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-02-23T06:42:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-02-23T06:42:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-02-23T06:42:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-02-23T06:42:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-02-23T06:42:58.262 INFO:teuthology.orchestra.run.smithi142.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-02-23T06:42:58.622 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.622 INFO:teuthology.orchestra.run.smithi142.stdout:Welcome to Gradle 6.0.1! 2024-02-23T06:42:58.622 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.622 INFO:teuthology.orchestra.run.smithi142.stdout:Here are the highlights of this release: 2024-02-23T06:42:58.622 INFO:teuthology.orchestra.run.smithi142.stdout: - Substantial improvements in dependency management, including 2024-02-23T06:42:58.622 INFO:teuthology.orchestra.run.smithi142.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - Advanced control of transitive versions 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - Support for optional features and dependencies 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - Rules to tweak published metadata 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - Support for Java 13 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - Faster incremental Java and Groovy compilation 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - New Zinc compiler for Scala 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - VS2019 support 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: - Support for Gradle Enterprise plugin 3.0 2024-02-23T06:42:58.623 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:------------------------------------------------------------ 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:Gradle 6.0.1 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:------------------------------------------------------------ 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-02-23T06:42:58.626 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.627 INFO:teuthology.orchestra.run.smithi142.stdout:Kotlin: 1.3.50 2024-02-23T06:42:58.627 INFO:teuthology.orchestra.run.smithi142.stdout:Groovy: 2.5.8 2024-02-23T06:42:58.627 INFO:teuthology.orchestra.run.smithi142.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-02-23T06:42:58.627 INFO:teuthology.orchestra.run.smithi142.stdout:JVM: 11.0.18 (Red Hat, Inc. 11.0.18+10-LTS) 2024-02-23T06:42:58.627 INFO:teuthology.orchestra.run.smithi142.stdout:OS: Linux 5.14.0-419.el9.x86_64 amd64 2024-02-23T06:42:58.627 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:58.639 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-02-23T06:42:58.639 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-02-23T06:42:58.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T06:42:58.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-02-23T06:42:58.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T06:42:58.640 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-02-23T06:42:58.960 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-02-23T06:42:58.960 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-02-23T06:42:58.960 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'XHSJMMJONQCZYWEJGYUM', 'access_secret': 'uGaxkkERZWz+SATJI9/3Zg0bN3qJosVV1lkO6UL7OCbfXpa6435w1Q==', 'region': 'mexico', 'endpoint': 'smithi142.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi142.front.sepia.ceph.com'} 2024-02-23T06:42:58.960 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-02-23T06:42:58.961 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'XHSJMMJONQCZYWEJGYUM', '--secret', 'uGaxkkERZWz+SATJI9/3Zg0bN3qJosVV1lkO6UL7OCbfXpa6435w1Q==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-02-23T06:42:58.961 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key XHSJMMJONQCZYWEJGYUM --secret uGaxkkERZWz+SATJI9/3Zg0bN3qJosVV1lkO6UL7OCbfXpa6435w1Q== --email tester.client.0_test@test.test --cluster ceph 2024-02-23T06:42:59.022 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:59.022 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:59.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.052+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 realm 2024-02-23T06:42:59.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.054+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.055+0000 7f3ee6f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:59.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.055+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.056+0000 7f3ee6f33800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:59.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.056+0000 7f3ee6f33800 20 searching for the correct realm 2024-02-23T06:42:59.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.057+0000 7f3ee2a4b640 0 -- 172.21.15.142:0/173729000 >> [v2:172.21.15.142:6800/3021220351,v1:172.21.15.142:6801/3021220351] conn(0x7f3edc02f070 msgr2=0x7f3edc00a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:59.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.262+0000 7f3ee324c640 0 -- 172.21.15.142:0/173729000 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f3ecc06d040 msgr2=0x7f3ecc056350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:59.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.268+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:59.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 zone default found 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 4 Realm: () 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:59.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 zonegroup default 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.269+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.270+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.270+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.270+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.270+0000 7f3ee6f33800 20 started sync module instance, tier type = 2024-02-23T06:42:59.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.270+0000 7f3ee6f33800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=0 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=1 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=2 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=3 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=4 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=5 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.279+0000 7f3ee6f33800 20 add_watcher() i=6 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.280+0000 7f3ee6f33800 20 add_watcher() i=7 2024-02-23T06:42:59.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.280+0000 7f3ee6f33800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3d997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 5 note: GC not initialized 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3d13fff640 20 reqs_thread_entry: start 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 20 Filter name: none 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3d11ffb640 20 reqs_thread_entry: start 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-02-23T06:42:59.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.282+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache get: name=default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM : miss 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache put: name=default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM info.flags=0x0 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 adding default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM to cache LRU end 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache get: name=default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM : hit (negative entry) 2024-02-23T06:42:59.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.283+0000 7f3ee6f33800 10 cache get: name=default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM : hit (negative entry) 2024-02-23T06:42:59.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.285+0000 7f3ee6f33800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-02-23T06:42:59.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.285+0000 7f3ee6f33800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-02-23T06:42:59.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.285+0000 7f3ee6f33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-02-23T06:42:59.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.285+0000 7f3dc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693277 cookie 94773736420144 notifier 7395 bl.length()=637 2024-02-23T06:42:59.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.285+0000 7f3dc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-02-23T06:42:59.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.285+0000 7f3dc67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-02-23T06:42:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.287+0000 7f3ee6f33800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-02-23T06:42:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.287+0000 7f3ee6f33800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-02-23T06:42:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.287+0000 7f3ee6f33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-02-23T06:42:59.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.287+0000 7f3dc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693214 cookie 94773736411536 notifier 7395 bl.length()=200 2024-02-23T06:42:59.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.287+0000 7f3dc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-02-23T06:42:59.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.287+0000 7f3dc67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-02-23T06:42:59.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.288+0000 7f3ee6f33800 10 cache put: name=default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM info.flags=0x7 2024-02-23T06:42:59.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.288+0000 7f3ee6f33800 10 moving default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM to cache LRU end 2024-02-23T06:42:59.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.288+0000 7f3ee6f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:XHSJMMJONQCZYWEJGYUM, ofs0, ns] 2024-02-23T06:42:59.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.289+0000 7f3dc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693278 cookie 94773736417872 notifier 7395 bl.length()=189 2024-02-23T06:42:59.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.289+0000 7f3dc5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM info.flags=0x7 2024-02-23T06:42:59.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.289+0000 7f3dc5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XHSJMMJONQCZYWEJGYUM to cache LRU end 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "user_id": "tester.client.0", 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "display_name": "Ms. tester.client.0", 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "email": "tester.client.0_test@test.test", 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "suspended": 0, 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "max_buckets": 1000, 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "subusers": [], 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "keys": [ 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "user": "tester.client.0", 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "access_key": "XHSJMMJONQCZYWEJGYUM", 2024-02-23T06:42:59.290 INFO:teuthology.orchestra.run.smithi142.stdout: "secret_key": "uGaxkkERZWz+SATJI9/3Zg0bN3qJosVV1lkO6UL7OCbfXpa6435w1Q==", 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "active": true 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "swift_keys": [], 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": [], 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "op_mask": "read, write, delete", 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "default_placement": "", 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "default_storage_class": "", 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "placement_tags": [], 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "bucket_quota": { 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": false, 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size": -1, 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:42:59.291 INFO:teuthology.orchestra.run.smithi142.stdout: "max_objects": -1 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "user_quota": { 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": false, 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "check_on_raw": false, 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size": -1, 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "max_size_kb": 0, 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "max_objects": -1 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "temp_url_keys": [], 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "rgw", 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: "mfa_ids": [] 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-02-23T06:42:59.292 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:42:59.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.290+0000 7f3d997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:59.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.292+0000 7f3ee6f33800 20 remove_watcher() i=0 2024-02-23T06:42:59.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.292+0000 7f3ee6f33800 2 removed watcher, disabling cache 2024-02-23T06:42:59.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.293+0000 7f3ee6f33800 20 remove_watcher() i=1 2024-02-23T06:42:59.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.295+0000 7f3ee6f33800 20 remove_watcher() i=2 2024-02-23T06:42:59.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.296+0000 7f3ee6f33800 20 remove_watcher() i=3 2024-02-23T06:42:59.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.297+0000 7f3ee6f33800 20 remove_watcher() i=4 2024-02-23T06:42:59.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.298+0000 7f3ee6f33800 20 remove_watcher() i=5 2024-02-23T06:42:59.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.298+0000 7f3ee6f33800 20 remove_watcher() i=6 2024-02-23T06:42:59.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.299+0000 7f3ee6f33800 20 remove_watcher() i=7 2024-02-23T06:42:59.311 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-23T06:42:59.311 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-02-23T06:42:59.344 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-02-23T06:42:59.344 DEBUG:teuthology.orchestra.run.smithi142:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-02-23T06:42:59.404 DEBUG:teuthology.orchestra.run.smithi142:> radosgw-admin gc process --include-all 2024-02-23T06:42:59.493 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:42:59.493 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:42:59.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.527+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.528+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.528+0000 7f6af53a2800 20 realm 2024-02-23T06:42:59.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.528+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.528+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.528+0000 7f6af53a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:42:59.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.528+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.529+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.529+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.530+0000 7f6af53a2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:59.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.530+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.530+0000 7f6af53a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:42:59.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.530+0000 7f6af53a2800 20 searching for the correct realm 2024-02-23T06:42:59.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.532+0000 7f6aea44a640 0 -- 172.21.15.142:0/4106929265 >> [v2:172.21.15.152:6801/3198084750,v1:172.21.15.152:6803/3198084750] conn(0x7f6ae403a070 msgr2=0x7f6ae403a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:59.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.537+0000 7f6af2c4b640 0 -- 172.21.15.142:0/4106929265 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f6adc0640b0 msgr2=0x7f6adc087610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:42:59.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:42:59.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:42:59.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.743+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:42:59.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:42:59.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 zone default found 2024-02-23T06:42:59.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 4 Realm: () 2024-02-23T06:42:59.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.744+0000 7f6af53a2800 20 zonegroup default 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 rados->read ofs=0 len=0 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 started sync module instance, tier type = 2024-02-23T06:42:59.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.745+0000 7f6af53a2800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:42:59.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=0 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=1 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=2 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=3 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=4 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=5 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.755+0000 7f6af53a2800 20 add_watcher() i=6 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.756+0000 7f6af53a2800 20 add_watcher() i=7 2024-02-23T06:42:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.756+0000 7f6af53a2800 2 all 8 watchers are set, enabling cache 2024-02-23T06:42:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.758+0000 7f69a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:42:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.758+0000 7f6af53a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:42:59.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.758+0000 7f6af53a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:42:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.795+0000 7f6923fff640 20 reqs_thread_entry: start 2024-02-23T06:42:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.795+0000 7f6af53a2800 20 init_complete bucket index max shards: 11 2024-02-23T06:42:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.795+0000 7f6af53a2800 20 Filter name: none 2024-02-23T06:42:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.795+0000 7f6921ffb640 20 reqs_thread_entry: start 2024-02-23T06:42:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.795+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-23T06:42:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.797+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-02-23T06:42:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_93F-_Zc_7beN_pptry41J-5jEOln9Le', time=2024-02-23T08:38:33.099901+0000, chain.objs.size()=1 2024-02-23T06:42:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.4hWm-Yn4O2qUimsuDdxgo4DlGSwsu3W_0 2024-02-23T06:42:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8514073884555048727', time=2024-02-23T08:40:04.392948+0000, chain.objs.size()=1 2024-02-23T06:42:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.hIMMnPMeTJYbH0UuCedPDSH7RmWRs6c_0 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11756744393054523107', time=2024-02-23T08:40:04.399931+0000, chain.objs.size()=1 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.t0GrmW3Y63FXCyQ5hFNmQyuu5AMIbFo_0 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10297047021447300373', time=2024-02-23T08:40:36.469655+0000, chain.objs.size()=1 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.M-haeNXoSEBVO6M550na9asoiU2Zobd_0 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8911022912790434300', time=2024-02-23T08:41:11.869531+0000, chain.objs.size()=1 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.3Cq9KBnRMYtrAo7EkL1xAltRysyA3Gk_0 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10893159968354620961', time=2024-02-23T08:41:44.147957+0000, chain.objs.size()=1 2024-02-23T06:42:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.798+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.PHHZBWoNdvUhV3js0KAusbtwOyUwICY_0 2024-02-23T06:42:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.799+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14071660648591509080', time=2024-02-23T08:41:44.160162+0000, chain.objs.size()=1 2024-02-23T06:42:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.799+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.JlIhYCapbTXiIt5zaQyyJ9MFwkBGjiT_0 2024-02-23T06:42:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.800+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1145744062556771296', time=2024-02-23T08:41:46.112764+0000, chain.objs.size()=1 2024-02-23T06:42:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.800+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.6hSfL8RLvuegPzt0b47Z0sBzcN58XhU_0 2024-02-23T06:42:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.803+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.806+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-23T06:42:59.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.808+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.808+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_z5QTebImEdS1yM7UWwCTUaRN-kUb6_F', time=2024-02-23T08:38:33.013047+0000, chain.objs.size()=1 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.VebeH0ywJEvG41SKrRR7IY7xwuQ3xQ8_0 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13872071060969765411', time=2024-02-23T08:40:03.339646+0000, chain.objs.size()=1 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.wwUU7emBDoJ-l5UOnsNNw6J6qRffYSg_0 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9739656696748128942', time=2024-02-23T08:40:03.344866+0000, chain.objs.size()=1 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.ZpT3rO5T5qylpbmMnM2ZcWHJSkHg3mM_0 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2711672760356743289', time=2024-02-23T08:40:36.470831+0000, chain.objs.size()=1 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.hwOWAd9mRzZxSQZi6aXiNd9yl7dTrmc_0 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3849930726528905043', time=2024-02-23T08:40:37.516211+0000, chain.objs.size()=1 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.0lSfSXOhJ90rH63PkvezrrkVGwwk1XE_0 2024-02-23T06:42:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15492494554173372652', time=2024-02-23T08:40:37.822743+0000, chain.objs.size()=1 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.55l0FhnYWiAJgW0nibOskq-CuKwXkKd_0 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15686719077920558002', time=2024-02-23T08:41:10.513669+0000, chain.objs.size()=1 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.XqwAQkMi0GchjySTm3P0LxoSRqlPlLb_0 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1908960679121161491', time=2024-02-23T08:41:10.515345+0000, chain.objs.size()=1 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.q8KYOjw00uWKQSXIfi-HH9NjdAFf_Q6_0 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3344675573127971625', time=2024-02-23T08:41:10.518893+0000, chain.objs.size()=1 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.5IOPmdUQsYedtNO3tSZcoQMYQjCxUWm_0 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2087637632450239114', time=2024-02-23T08:41:11.872472+0000, chain.objs.size()=1 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.4luWzPPa507H2JjCSg0KYrdiD6R0Pxc_0 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16532455153904385098', time=2024-02-23T08:42:18.321377+0000, chain.objs.size()=1 2024-02-23T06:42:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.809+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.irOxGDQ41KXVJc8nuLT7LpEAYWTX1xv_0 2024-02-23T06:42:59.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.813+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.815+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-23T06:42:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.816+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7440375449257695044', time=2024-02-23T08:38:32.879477+0000, chain.objs.size()=1 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.ytAZNt40_89knic5AYbxRyhH59FJ_wC_0 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3905039273267040397', time=2024-02-23T08:38:33.017119+0000, chain.objs.size()=1 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_0 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.817+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_1_6831f058432f212db9b7b96b44594d7f', time=2024-02-23T08:38:33.033843+0000, chain.objs.size()=1 2024-02-23T06:42:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_0 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10643437094324557156', time=2024-02-23T08:38:33.158902+0000, chain.objs.size()=2 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.3cFScttGFHGLnrzeYUGUh7lQTd30dn7_0 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.3cFScttGFHGLnrzeYUGUh7lQTd30dn7_1 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4582797099296760953', time=2024-02-23T08:40:03.341511+0000, chain.objs.size()=1 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.HH0zgwPGLJlXb4C40XiNRbtZZ7mG-Kh_0 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5245588837901100723', time=2024-02-23T08:40:04.397957+0000, chain.objs.size()=1 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_._7tEWwTvDU-cjqFtwbONARe1d6Yk1we_0 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2358157302451016886', time=2024-02-23T08:40:04.404326+0000, chain.objs.size()=1 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.LrAEVRzoVIZ9bTft1waWEH1uwYCZjGL_0 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7671790534029751267', time=2024-02-23T08:40:37.822789+0000, chain.objs.size()=1 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.Cq69rdIGFbjySAN781Y1hbOTWFfK-Cw_0 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15309668466758812511', time=2024-02-23T08:41:44.148965+0000, chain.objs.size()=1 2024-02-23T06:42:59.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.818+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.3AP6JlQIiwmWzTWFHbFU65mzs98JrOY_0 2024-02-23T06:42:59.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.824+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.826+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-23T06:42:59.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.827+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-02-23T06:42:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_2eLEl0wTwkTY7B0aKeDhXQfkdrbzaIG', time=2024-02-23T08:38:33.064798+0000, chain.objs.size()=2 2024-02-23T06:42:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.SFmVqo0KO8XmirrrYC3q7RBbeMtyaAh_0 2024-02-23T06:42:59.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.SFmVqo0KO8XmirrrYC3q7RBbeMtyaAh_1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17272941412335072450', time=2024-02-23T08:40:36.467136+0000, chain.objs.size()=1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.AGMJqg6Ile9---Ddl2s5_qN_UsmWURv_0 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.176383216685095687', time=2024-02-23T08:40:36.477059+0000, chain.objs.size()=1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.S-TvQmxHyaBIFpObs8eIN7sOb8EqizT_0 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18442324487712254467', time=2024-02-23T08:40:37.825297+0000, chain.objs.size()=1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.vRxK-ePGhPYSSy1BaUxS1KHGZr0L2WO_0 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9028202065295722166', time=2024-02-23T08:41:11.862727+0000, chain.objs.size()=1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.i2CGKc8N7vmc2ihn6LstD2-WyCz_dDE_0 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8994209894808230780', time=2024-02-23T08:41:11.869323+0000, chain.objs.size()=1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.ngiNBFdMNyrznx_LkPL3_7FGbUNXWh7_0 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17284375885872782646', time=2024-02-23T08:41:46.118211+0000, chain.objs.size()=1 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.o1ha60VoMj9tyxEMthIKsHiMl1j7XWU_0 2024-02-23T06:42:59.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10107863621868823751', time=2024-02-23T08:42:18.307511+0000, chain.objs.size()=1 2024-02-23T06:42:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.yohOkgVpz1JiW0nOBYxIe4JZXg7KpLI_0 2024-02-23T06:42:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12198490130417213154', time=2024-02-23T08:42:18.840584+0000, chain.objs.size()=1 2024-02-23T06:42:59.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.828+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.muQdxNM-OvAMyubQLkS_TXNLXXvboN2_0 2024-02-23T06:42:59.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.832+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.835+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-23T06:42:59.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.836+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.836+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_62wvrZD6VPfE57W2oTm_1mtkUfN26R-', time=2024-02-23T08:38:33.021227+0000, chain.objs.size()=1 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.qD4vNcXjo1mUjD_DUJtgmADbfZzx6yI_0 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2967397210953166866', time=2024-02-23T08:38:33.205945+0000, chain.objs.size()=1 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.fA9YMBB_5C3S7jGthheqIHPbTN7NFVQ_0 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6132608103963345068', time=2024-02-23T08:40:03.345920+0000, chain.objs.size()=1 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.DmToWLzHw3wzPFIipH9QrdksBx5ClA8_0 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5308721797109916388', time=2024-02-23T08:40:04.396263+0000, chain.objs.size()=1 2024-02-23T06:42:59.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.P6nLrE86QWiS5c2OpalzqzC9CGUtYhR_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6303763744047901208', time=2024-02-23T08:40:05.623893+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.05jj7NhwMwAtnyqX_lwnnzwtQoFY0uN_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18203187676363400989', time=2024-02-23T08:40:36.465977+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.zJK_Ntbv3Mzib7lxRgNVCet3SKfMiJy_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5643425365796265283', time=2024-02-23T08:41:10.510044+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.VV-5NuWC6pKvPFKHURHyZXJFbs722BC_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12941055899436676168', time=2024-02-23T08:41:11.864515+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.Bj7pfeEBk3UVlVbuDSTEkne-PyMSi0Y_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11132064911932063576', time=2024-02-23T08:41:12.917808+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.POI9Rw96_gH2nbbtUYVFLg2M_cut4HR_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1052620750562371416', time=2024-02-23T08:41:12.931417+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.Bdv9eSROU7B_8y-ASdb7LAnIE8VG0aX_0 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10881872521287924957', time=2024-02-23T08:41:46.117640+0000, chain.objs.size()=1 2024-02-23T06:42:59.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.XOIaGKWiFPcoCQ2jiIsfhQtOBMfnlUH_0 2024-02-23T06:42:59.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16827079404086332144', time=2024-02-23T08:42:18.308130+0000, chain.objs.size()=1 2024-02-23T06:42:59.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.837+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.04YaGPORGFJvsyh1pGvh6XBfnng6LNN_0 2024-02-23T06:42:59.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.842+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8112200783810645644', time=2024-02-23T08:42:31.419591+0000, chain.objs.size()=1 2024-02-23T06:42:59.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.842+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:6bJagE3Cz1KvHyBaGE4n6y33cX0QsJX_.vCzqVGyAg_DR85xzeeqWUSeHm4ma5Zy_0 2024-02-23T06:42:59.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.845+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.847+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-23T06:42:59.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.849+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2446792188173346160', time=2024-02-23T08:40:36.478189+0000, chain.objs.size()=1 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.8EZutWw8mru6rECjNui2Z8eitM-WJGw_0 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1770904336818184344', time=2024-02-23T08:40:37.821495+0000, chain.objs.size()=1 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.O7U1vM2sYU81hkjeYjr_1bw0gZrNOme_0 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1254960160974321967', time=2024-02-23T08:40:37.828226+0000, chain.objs.size()=1 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.1EOA4ykzwQtsfhHtsptvP2Zn2K1RAkS_0 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2652214363403268966', time=2024-02-23T08:41:11.867553+0000, chain.objs.size()=1 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.CXHUUdwjaDJGcxyDOCc-ueXuE4aKes0_0 2024-02-23T06:42:59.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17687021414612674358', time=2024-02-23T08:41:12.929484+0000, chain.objs.size()=1 2024-02-23T06:42:59.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.GK8QAkw27O-iiZ-9AAmFWRdpHCMf4xV_0 2024-02-23T06:42:59.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4163864160462663966', time=2024-02-23T08:42:18.310484+0000, chain.objs.size()=1 2024-02-23T06:42:59.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.850+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.wfmUOxr8chOiBHbw81_1Txzp3vxaOAn_0 2024-02-23T06:42:59.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.853+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.855+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-23T06:42:59.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-02-23T06:42:59.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1231158447077056995', time=2024-02-23T08:41:44.146657+0000, chain.objs.size()=1 2024-02-23T06:42:59.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.NoWm1eRull6BdXzDJZ0Um1JaGdT0C3-_0 2024-02-23T06:42:59.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6425627505581659848', time=2024-02-23T08:41:44.152051+0000, chain.objs.size()=1 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.1UzTcLokCc6Ja0TIfRUlLrWx3y22DpX_0 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18436268877886996762', time=2024-02-23T08:41:46.118529+0000, chain.objs.size()=1 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.cOIqzKiV0f9nmRP5GbEgk2D_ABjmT7O_0 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2222876716153750661', time=2024-02-23T08:42:18.310564+0000, chain.objs.size()=1 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.b_MSS61LiIjaxXSzEL9MT3KFTYeCpbx_0 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18208110690154678364', time=2024-02-23T08:42:18.318391+0000, chain.objs.size()=1 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.1mbJa3cG8zs6y-7D48GEqZeJsRPcxI4_0 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1834519710528795541', time=2024-02-23T08:42:18.840914+0000, chain.objs.size()=1 2024-02-23T06:42:59.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.857+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.NbFs7pJ-muyqtgjHVRL4DnP1DBWmkvY_0 2024-02-23T06:42:59.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.860+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.862+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-23T06:42:59.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.863+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.864+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.864+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.864+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.232369318008395379', time=2024-02-23T08:38:32.883523+0000, chain.objs.size()=1 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.864+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.85GlJmzs3QMi8JUvuaEcgV8g_obZKjP_0 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6904461898630207753', time=2024-02-23T08:38:33.244075+0000, chain.objs.size()=1 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.PFa5M7gnOocp9Y63-k8Cyx0XAFPfdoR_0 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12940868134882068566', time=2024-02-23T08:38:33.247665+0000, chain.objs.size()=1 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.JCKnQy68Fcoa9DPtOe44B31bSJE65Z1_0 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14239241454194260745', time=2024-02-23T08:40:03.350890+0000, chain.objs.size()=1 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.cDK6V9d4v1SNOixSGLR6Cw9CEqclRyN_0 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10465253690287107064', time=2024-02-23T08:41:10.508101+0000, chain.objs.size()=1 2024-02-23T06:42:59.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.9_IdGgbFMBSHOOpVXScdxUE2f9Bar-i_0 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4639141193240627070', time=2024-02-23T08:41:11.864724+0000, chain.objs.size()=1 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.NKsI4EY6_XIdNpQwYySbbwrcdMxbqFJ_0 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5566235158533798861', time=2024-02-23T08:41:11.867735+0000, chain.objs.size()=1 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.y6i2MMRliAZq-hV8ZdGWNKnf8waXi-C_0 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11723809078407535194', time=2024-02-23T08:41:11.868506+0000, chain.objs.size()=1 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.kvWFmJo8OM-2wMDT_OJE4zKyafzX68K_0 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13179099566482388185', time=2024-02-23T08:41:44.151894+0000, chain.objs.size()=1 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.shG06mPERVzkm2voWjgRZMA4S1Wsx5W_0 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14563605085226334449', time=2024-02-23T08:42:18.842012+0000, chain.objs.size()=1 2024-02-23T06:42:59.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.865+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.7pXr5OeyzhvfCqXuSgh10TKcg2ab442_0 2024-02-23T06:42:59.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.869+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.871+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-23T06:42:59.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-02-23T06:42:59.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_FEVVPPnDYq4AEJu4xF25Hj4_6lDOIxW', time=2024-02-23T08:38:33.076398+0000, chain.objs.size()=2 2024-02-23T06:42:59.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.PbHiy5XlxZM5Ix8B4bRIdKUrLA30k6O_0 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.PbHiy5XlxZM5Ix8B4bRIdKUrLA30k6O_1 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.540927255510412115', time=2024-02-23T08:41:11.863851+0000, chain.objs.size()=1 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.jcDqMWeHbCUhLAmUJRIu9Yd4esciM0T_0 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12107875315849614281', time=2024-02-23T08:41:46.114601+0000, chain.objs.size()=1 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.873+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.GJN6QJbq3_l8Z8N2QhfbX20hSnUen3S_0 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.874+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3119952183520401219', time=2024-02-23T08:41:46.123410+0000, chain.objs.size()=1 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.874+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_._qHEE3vbnd-OIZx35-27DCAr9k5FUCM_0 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.874+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1524996941875704094', time=2024-02-23T08:42:18.309316+0000, chain.objs.size()=1 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.874+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.eMqo-80lq_rRRLVAnkJvELnsYjX9d_C_0 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.874+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1139221128715401290', time=2024-02-23T08:42:31.419437+0000, chain.objs.size()=1 2024-02-23T06:42:59.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.874+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:wxkI0X6epdv2qodvAILAGgHy6FLf.gI_.WOyjE_JRfMF2UjBbcFPinqOZEqwuUYj_0 2024-02-23T06:42:59.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.877+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.879+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-23T06:42:59.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.880+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.880+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4285450810685467939', time=2024-02-23T08:38:33.127006+0000, chain.objs.size()=3 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-STANDARD.2~gvthoWONe8h9KQfOJA5TKQDPnspHIfg.1 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-STANDARD.2~gvthoWONe8h9KQfOJA5TKQDPnspHIfg.2 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-STANDARD.2~gvthoWONe8h9KQfOJA5TKQDPnspHIfg.3 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6208998373749519931', time=2024-02-23T08:40:03.348236+0000, chain.objs.size()=1 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.oUnM4Kr-Hgai3-Z8xH1Wmk4gNU9ZvzB_0 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11016089525773268913', time=2024-02-23T08:40:36.470082+0000, chain.objs.size()=1 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.3_4i27AnU7z0E68-XB89lz3xGSauvar_0 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5019065492871224836', time=2024-02-23T08:40:37.820822+0000, chain.objs.size()=1 2024-02-23T06:42:59.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.dj8o1FQ5wPnLW5Q2TV_BcPJvcWyQfnh_0 2024-02-23T06:42:59.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16268718615342380977', time=2024-02-23T08:41:46.113386+0000, chain.objs.size()=1 2024-02-23T06:42:59.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.rj_jWuHj5EyS6UnLz7zBFnuG87I0Z0n_0 2024-02-23T06:42:59.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13214824677493031928', time=2024-02-23T08:41:46.115004+0000, chain.objs.size()=1 2024-02-23T06:42:59.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.NRADAS4osQCCrIjlv5lcyz8h9Tyc7XN_0 2024-02-23T06:42:59.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9626175288765572553', time=2024-02-23T08:42:26.903218+0000, chain.objs.size()=1 2024-02-23T06:42:59.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.881+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:C4Vcd5VHrQt4X71YKa8CBm5LrtE9RZg_.S9RIS8KnLx0ENAVgBVGuh-vL7fODIPW_0 2024-02-23T06:42:59.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.884+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.886+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-23T06:42:59.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_zi_eTFATVU7lb0XKPzsPH1WfY-fYj33', time=2024-02-23T08:38:33.009259+0000, chain.objs.size()=1 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.Zjt9Xc-3wfFdciaDOR_OLfXRvk94-BC_0 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2_4b795c6a04bb88ccd48506283e84253f', time=2024-02-23T08:38:33.096254+0000, chain.objs.size()=3 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.1 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.3 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2_50e80a6da848a48dfa3a8d30955e8ca0', time=2024-02-23T08:38:33.103700+0000, chain.objs.size()=3 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.1 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.888+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.3 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18168974416409255541', time=2024-02-23T08:40:36.468643+0000, chain.objs.size()=1 2024-02-23T06:42:59.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.XEhk2SGvySivnJvAKYpzSH4hRfAkvew_0 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13740920186763867965', time=2024-02-23T08:40:36.470680+0000, chain.objs.size()=1 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.G9V4rf4NaQsiIT4X1nbLMj_6kqUwV3F_0 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2535982853455446805', time=2024-02-23T08:40:37.821231+0000, chain.objs.size()=1 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.NHY6rRszc4I5pr4133d-58UbxYf9Bw-_0 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16026299845623503164', time=2024-02-23T08:41:11.864196+0000, chain.objs.size()=1 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.2ZNG6-iW9kV4FocP_1g7xZQlCHbWIaT_0 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13216403077441085046', time=2024-02-23T08:41:11.867944+0000, chain.objs.size()=1 2024-02-23T06:42:59.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.889+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.2V1HcDByFHlhW9zqjxAQvCdUhja0bvm_0 2024-02-23T06:42:59.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.891+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8683225324744198656', time=2024-02-23T08:42:18.315161+0000, chain.objs.size()=1 2024-02-23T06:42:59.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.891+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.edMv09oH-B3fKda2IbPWKmSlTseI1G8_0 2024-02-23T06:42:59.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.893+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.897+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-23T06:42:59.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.898+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.898+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3477438124948925070', time=2024-02-23T08:38:33.068973+0000, chain.objs.size()=3 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.1 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.2 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-FROZEN.2~aEJw5S_lvUNDXRGlUH9nao5SSifG_oI.3 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6722760564577973586', time=2024-02-23T08:40:36.467833+0000, chain.objs.size()=1 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.rYj4X_2I1ZgIbp9Oln8ECXZkwSzSAP2_0 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3553207601746597634', time=2024-02-23T08:40:36.470929+0000, chain.objs.size()=1 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.CP9myPSU8fzMu5qFEAVJkAs8jBw45Iv_0 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7799222218773359965', time=2024-02-23T08:40:37.819361+0000, chain.objs.size()=1 2024-02-23T06:42:59.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.6XNPa8KXrEMcV5ayIoOIlrTGrmdmB_O_0 2024-02-23T06:42:59.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11350217998133271702', time=2024-02-23T08:40:37.820104+0000, chain.objs.size()=1 2024-02-23T06:42:59.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.fIKzy1tck0D98r9pmUaQOvasNO--5g5_0 2024-02-23T06:42:59.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13357574388478810830', time=2024-02-23T08:40:37.821087+0000, chain.objs.size()=1 2024-02-23T06:42:59.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.IH1VA-qNEdHPYscyivcnqaNmcOA0PFe_0 2024-02-23T06:42:59.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13673010696917191314', time=2024-02-23T08:41:12.922818+0000, chain.objs.size()=1 2024-02-23T06:42:59.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.899+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.Y037hZqQH7xo3PzaWN5fJROr_ue_OOP_0 2024-02-23T06:42:59.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.902+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.904+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-23T06:42:59.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.905+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-02-23T06:42:59.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7516980728936741526', time=2024-02-23T08:38:32.932279+0000, chain.objs.size()=4 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.1 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.2 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.3 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12__multipart_foo.2~2iLAXYgY8KQ8_L4Quq-Axy6lg5RvX65.4 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12672564331011346497', time=2024-02-23T08:38:33.005393+0000, chain.objs.size()=1 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_0 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13264420476750456153', time=2024-02-23T08:38:33.080483+0000, chain.objs.size()=3 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.1 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.3 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2344351711385468193', time=2024-02-23T08:38:33.123295+0000, chain.objs.size()=3 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-FROZEN.2~3nENm3ybA8wavTgSbGcxBQ4Yw7IkfOx.1 2024-02-23T06:42:59.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-FROZEN.2~3nENm3ybA8wavTgSbGcxBQ4Yw7IkfOx.2 2024-02-23T06:42:59.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-FROZEN.2~3nENm3ybA8wavTgSbGcxBQ4Yw7IkfOx.3 2024-02-23T06:42:59.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17244006734264725752', time=2024-02-23T08:40:04.391880+0000, chain.objs.size()=1 2024-02-23T06:42:59.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.906+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.ziNd0kXXEvxh_ZBVMaT8QE9B0pRsOzz_0 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16621529628674476178', time=2024-02-23T08:40:37.818760+0000, chain.objs.size()=1 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.p_pgEanycqMojj7TxdHdVOOYciGppLP_0 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18335956967040775948', time=2024-02-23T08:41:10.516654+0000, chain.objs.size()=1 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.4YXR3BqxxuDmdhuRxjkHSDav3txuwl6_0 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3834326786371406519', time=2024-02-23T08:41:44.159688+0000, chain.objs.size()=1 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.3DcUTbElAYv50G8YKx_HQ3shRwluR2Q_0 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13120137272198596816', time=2024-02-23T08:41:46.118783+0000, chain.objs.size()=1 2024-02-23T06:42:59.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.909+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.cLTI_8KR5sE9Y-iPWTmgk4qI376DUTw_0 2024-02-23T06:42:59.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.913+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.915+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-23T06:42:59.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.916+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.916+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8540883754809531022', time=2024-02-23T08:38:33.154888+0000, chain.objs.size()=2 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.jSnlRAK5v2wxQWh44BQ7vlgtPY6NgkQ_0 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.jSnlRAK5v2wxQWh44BQ7vlgtPY6NgkQ_1 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1394552528746396830', time=2024-02-23T08:40:37.823644+0000, chain.objs.size()=1 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.sTxSSTrJ8X41JMjE2_7O4JuAoUmVWmj_0 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8067614353632714830', time=2024-02-23T08:42:17.376927+0000, chain.objs.size()=1 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.LmNBkM3SVLmYE657ZE49HtfTgp7ZLbG_0 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.136636153008297445', time=2024-02-23T08:42:18.311418+0000, chain.objs.size()=1 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.meU3S5NlrK5SSCjxujmOnyM9RDbKBJ4_0 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2762139499897936612', time=2024-02-23T08:42:18.316114+0000, chain.objs.size()=1 2024-02-23T06:42:59.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.917+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.QDHE6-s104wofmUz6zUZxVsHleX5gy__0 2024-02-23T06:42:59.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.920+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.922+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-23T06:42:59.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.923+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.923+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-02-23T06:42:59.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_g4_PDrqelXMREOH5wE4h-Lnz3hevzRz', time=2024-02-23T08:38:33.001578+0000, chain.objs.size()=1 2024-02-23T06:42:59.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.n1fLNEN-JAwzQGIqxf0L8Gx0OQuu347_0 2024-02-23T06:42:59.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5186421195328975782', time=2024-02-23T08:40:04.393396+0000, chain.objs.size()=1 2024-02-23T06:42:59.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.JSsDj_k-zpx3tJQbEHtj87h7UpOQH-j_0 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17789554863137647248', time=2024-02-23T08:40:04.397756+0000, chain.objs.size()=1 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.QzjMdlm4ii4reOVPddu-xzRQnxkzflJ_0 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10745978102051141412', time=2024-02-23T08:40:37.819233+0000, chain.objs.size()=1 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.uTeV7NXGsqsp8JfS6ymEdPYm_AeEMuH_0 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10403201033328740726', time=2024-02-23T08:40:37.829631+0000, chain.objs.size()=1 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.FlAOrFaUgZeznd4mYXck015fY4fmOdv_0 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10419248065107239899', time=2024-02-23T08:41:10.507469+0000, chain.objs.size()=1 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.IZyjG_HhKkdIl_QJKeFNsJBGXzRdvv-_0 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10926933557655987389', time=2024-02-23T08:41:10.511726+0000, chain.objs.size()=1 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.A-PssWBLDS5Iv-UuugM-TJOe9DUTdF9_0 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4559973211075828601', time=2024-02-23T08:41:10.518073+0000, chain.objs.size()=1 2024-02-23T06:42:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.zvaIFS1_7jsOzDh2pZv4RtFdzeLBudM_0 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12125941554256668423', time=2024-02-23T08:41:44.149658+0000, chain.objs.size()=1 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.rG9Ax-RdhuKAGi9cWHlXgwwCMaXwo4w_0 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13253376609922658480', time=2024-02-23T08:41:44.151673+0000, chain.objs.size()=1 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.2ym7i6nH2n0cZjRmJZ-Ghkyza9FvD0Z_0 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15449899172598073877', time=2024-02-23T08:42:18.321788+0000, chain.objs.size()=1 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.FoH9ue9IjNsXHOEWcB6wPW74aqVUVjq_0 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12633853700445743698', time=2024-02-23T08:42:18.840256+0000, chain.objs.size()=1 2024-02-23T06:42:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.924+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.5BiVf_spIzcJNntigg9lywOR7cv5mqS_0 2024-02-23T06:42:59.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.929+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.931+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-23T06:42:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-02-23T06:42:59.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8912383105217441282', time=2024-02-23T08:38:33.213751+0000, chain.objs.size()=1 2024-02-23T06:42:59.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.qj4rHMNsSgq0bWTmGWB9wU9DupIfPHy_0 2024-02-23T06:42:59.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18313536701530001752', time=2024-02-23T08:40:03.338447+0000, chain.objs.size()=1 2024-02-23T06:42:59.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.7E0ndQe31w88kBsqgTkOm7PHnsTxzmr_0 2024-02-23T06:42:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12940004519722344651', time=2024-02-23T08:40:04.394739+0000, chain.objs.size()=1 2024-02-23T06:42:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.bnqLXFO6Rqi6LK3y1z8j-5nbVAeL0kW_0 2024-02-23T06:42:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12459503640552145668', time=2024-02-23T08:41:10.508908+0000, chain.objs.size()=1 2024-02-23T06:42:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.-ljtOCHZL9oSb8mvv8c8WaonVVYaMH9_0 2024-02-23T06:42:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1388510806806568676', time=2024-02-23T08:41:10.515487+0000, chain.objs.size()=1 2024-02-23T06:42:59.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.933+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.6ZgIZ6yqU4mf4uyjvo13dqnX3dU46CQ_0 2024-02-23T06:42:59.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.936+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.938+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-23T06:42:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.939+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.939+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6657006185926036815', time=2024-02-23T08:38:32.857857+0000, chain.objs.size()=1 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.cMF-Jb_03_yGpfY5CXX17bITqEqwsa9_0 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6602948198557076738', time=2024-02-23T08:38:32.875581+0000, chain.objs.size()=1 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.AmmueiEjBZE_A-W0JG9-oVY0ydEy3fq_0 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3538922961312480066', time=2024-02-23T08:38:33.131216+0000, chain.objs.size()=3 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-LUKEWARM.2~JGUYkRvBXpJMIqYr2Psg6Cz5W4rTsqK.1 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-LUKEWARM.2~JGUYkRvBXpJMIqYr2Psg6Cz5W4rTsqK.2 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14__multipart_foo-LUKEWARM.2~JGUYkRvBXpJMIqYr2Psg6Cz5W4rTsqK.3 2024-02-23T06:42:59.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9509206690089716331', time=2024-02-23T08:40:04.394887+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.FHbBxJHTYCJVCzRqkeS_QnpZBx_uwrw_0 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15340130099256343453', time=2024-02-23T08:41:10.512027+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.IydfjLImBzGicuIfi66lHaDDty3DHEu_0 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15490260337651946064', time=2024-02-23T08:41:10.515688+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.yf7rnyWG-q6vKOCTLZzq3Tzcs8xe1fr_0 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17536567833516331284', time=2024-02-23T08:41:12.922168+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.Hdkrorc2hvr05iSdpxecGfg6zXzceVD_0 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11478711868813508219', time=2024-02-23T08:41:12.930162+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.Jrjl47eOuYL2YCwYA8qAbJnjYddssYD_0 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8312693021707847409', time=2024-02-23T08:41:44.152228+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.YS-Co_2-2pXXP1O3sUuxa-U8FgFUFRe_0 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10494065784736578810', time=2024-02-23T08:42:18.313138+0000, chain.objs.size()=1 2024-02-23T06:42:59.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.940+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.DtcRA4OeCTgy6jzttdmb_hujz3XgzK1_0 2024-02-23T06:42:59.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.942+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2832175464020812388', time=2024-02-23T08:42:18.842011+0000, chain.objs.size()=1 2024-02-23T06:42:59.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.942+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.-ZQ7fiayPKjSyjMr4E-Jd6YhlFZqE8U_0 2024-02-23T06:42:59.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.945+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.947+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-23T06:42:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.948+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8805735857579422730', time=2024-02-23T08:38:32.887540+0000, chain.objs.size()=1 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.jmMkelkTVoY_8P4usmzwCmK5C_3Txeq_0 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_XU4mGUJNa97bIvisseAXVo3JxbLRCVN', time=2024-02-23T08:38:32.997523+0000, chain.objs.size()=1 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.oMgPJamIc5TSWYyrG9Eger3KYGUBUxe_0 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14224477852439076069', time=2024-02-23T08:40:37.822718+0000, chain.objs.size()=1 2024-02-23T06:42:59.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.GFqFxamCu1Xgu4WOGpy0bxDf-34lUMh_0 2024-02-23T06:42:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10605694599913226235', time=2024-02-23T08:41:11.866123+0000, chain.objs.size()=1 2024-02-23T06:42:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.IouVZ1HVJqJvQVkysOBaIVkaOam8Aae_0 2024-02-23T06:42:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4337343095387453940', time=2024-02-23T08:41:12.931692+0000, chain.objs.size()=1 2024-02-23T06:42:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.949+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.-6V8fMhsntNEluRH8rr9M4O54p_SPj4_0 2024-02-23T06:42:59.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.951+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.953+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-23T06:42:59.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-02-23T06:42:59.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12273871392820477837', time=2024-02-23T08:38:32.955632+0000, chain.objs.size()=4 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.1 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.2 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.3 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10__multipart_foo.2~ObrW58gVwTBLdBS0qTWOSsqrT_y_wk6.4 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1610976608645282495', time=2024-02-23T08:38:32.978113+0000, chain.objs.size()=4 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.1 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.2 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.3 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9__multipart_foo.2~culyx064Km8O5JKe5l02XerWGtHzyQJ.4 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5878414035204845529', time=2024-02-23T08:38:33.150821+0000, chain.objs.size()=2 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.vEcqMg52L898ox-UMR579nytUAlQPq4_0 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13__shadow_.vEcqMg52L898ox-UMR579nytUAlQPq4_1 2024-02-23T06:42:59.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9814975692375758890', time=2024-02-23T08:40:03.346980+0000, chain.objs.size()=1 2024-02-23T06:42:59.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.8RF2IlmL9CQLCc0Vq9xpvvxhx_bTA3H_0 2024-02-23T06:42:59.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9825792411638124588', time=2024-02-23T08:40:37.820690+0000, chain.objs.size()=1 2024-02-23T06:42:59.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.955+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.URLz4tmGzdjPZvCtG268EOKft4w8KMG_0 2024-02-23T06:42:59.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.959+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17591396178690343298', time=2024-02-23T08:40:37.821745+0000, chain.objs.size()=1 2024-02-23T06:42:59.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.959+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.o9Ni_nhUzRAsBHoDRJqjSqDcTsxgvHr_0 2024-02-23T06:42:59.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.959+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17158487624737349055', time=2024-02-23T08:41:11.359826+0000, chain.objs.size()=1 2024-02-23T06:42:59.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.959+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.aMD3-7SPXpwOu_zlqO2d5hISjT4Bbro_0 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1233755971282654376', time=2024-02-23T08:41:11.866091+0000, chain.objs.size()=1 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.Df3M8ei4bYCNXBStGoIzE-zIf0OOu1I_0 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12945833027079679894', time=2024-02-23T08:41:11.873574+0000, chain.objs.size()=1 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.EWdYhbRjatssf_fYWGZXaUM4-cKinZM_0 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2561148408382971600', time=2024-02-23T08:41:12.922213+0000, chain.objs.size()=1 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.ElRquAskzEB2Zb2a4BG5OjMXCUQJZac_0 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12704948167541970398', time=2024-02-23T08:41:12.922885+0000, chain.objs.size()=1 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.m4FXdw0sKX0JG_qFPyTNa191G53xf_Q_0 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1622105510048517609', time=2024-02-23T08:41:12.926482+0000, chain.objs.size()=1 2024-02-23T06:42:59.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.961+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.f3scmGAIWvStoUByfTbrn8lIPOE6EfO_0 2024-02-23T06:42:59.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.964+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.968+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-23T06:42:59.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.969+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.969+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.969+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.969+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1230334010915597612', time=2024-02-23T08:38:32.892200+0000, chain.objs.size()=1 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.CkQbi4Ea8g04K2wIzjD_B1d2sYC81FH_0 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_1_d023ea62a1fa31314d8e7f97bd237367', time=2024-02-23T08:38:33.041775+0000, chain.objs.size()=1 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.l50KCT1v69kevku_sfzYzD5c947VI_a_0 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1492666801446407005', time=2024-02-23T08:40:36.471960+0000, chain.objs.size()=1 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.bCppHbb1FT3127zglggCBiV_UFfNZGO_0 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7991832384824907165', time=2024-02-23T08:40:36.475372+0000, chain.objs.size()=1 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.L2QFuMxdCitoUIDECNHe5FguEQvZNVk_0 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9418973643120165433', time=2024-02-23T08:41:11.867566+0000, chain.objs.size()=1 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.O-V7hq6pfc5GMNcUR7Ck9mdqCA_qiQx_0 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16005067055520802519', time=2024-02-23T08:41:44.151766+0000, chain.objs.size()=1 2024-02-23T06:42:59.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.IQYn1YCK7HbWVHDRzKrkvLMyYSlqxSh_0 2024-02-23T06:42:59.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11855990417820852389', time=2024-02-23T08:42:18.312153+0000, chain.objs.size()=1 2024-02-23T06:42:59.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.DbRHFrE1bHBqVr5ZxFpSGoHd8c5ibod_0 2024-02-23T06:42:59.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16738319772210171747', time=2024-02-23T08:42:18.320461+0000, chain.objs.size()=1 2024-02-23T06:42:59.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.970+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.rercJ6_Piydc3q3MvdVTuQ83d7sRvRp_0 2024-02-23T06:42:59.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.973+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.975+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-23T06:42:59.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.976+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10634783006803500938', time=2024-02-23T08:38:32.862468+0000, chain.objs.size()=1 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.jMismdTMrQ5WSCXcxXHe90-0L4QLbbk_0 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2993556332735344771', time=2024-02-23T08:38:32.870885+0000, chain.objs.size()=1 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.FP8DAXpPnxvQ1z2hQzgkt3tuhaaaHJm_0 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11495236592740289971', time=2024-02-23T08:38:33.025725+0000, chain.objs.size()=1 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.hR2JzjH5eYeLW65cwlnlYx_JmdFlhAM_0 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10078487170742771352', time=2024-02-23T08:41:44.145687+0000, chain.objs.size()=1 2024-02-23T06:42:59.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.fGX0ao27pWFILv23JRHbaZe8iO3jdaE_0 2024-02-23T06:42:59.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9050506808167127680', time=2024-02-23T08:41:44.147191+0000, chain.objs.size()=1 2024-02-23T06:42:59.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.977+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.BhkbidKuBwv6cvBPWE-GhjNsKC21brz_0 2024-02-23T06:42:59.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.979+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.981+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-23T06:42:59.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.982+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7821273395528760698', time=2024-02-23T08:40:02.837479+0000, chain.objs.size()=1 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.ZAJb5xEL-qs3jIJCtorxjh2OoKDTiqM_0 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6241465498937712984', time=2024-02-23T08:40:04.397297+0000, chain.objs.size()=1 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.-KWE6wtXvNFEDqijMj6FUfqb0zapKBz_0 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9633161605959723605', time=2024-02-23T08:40:04.402019+0000, chain.objs.size()=1 2024-02-23T06:42:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.rW9sftjqPJadcfK-GBM6WpVvQUP6xS1_0 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2962275954952554896', time=2024-02-23T08:40:36.469139+0000, chain.objs.size()=1 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.IbzoVOGo9vjQpix8h1hzIY7kRVZMXLX_0 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13161980652802732704', time=2024-02-23T08:40:37.830022+0000, chain.objs.size()=1 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.hMb6ORRfrv0pRMw_4-8MfOYsmG69V49_0 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1535387504705658307', time=2024-02-23T08:41:46.118419+0000, chain.objs.size()=1 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.Y4o09F5Or3U31ezxHrnpUfuaZZstp4g_0 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15068944012619939397', time=2024-02-23T08:41:46.121354+0000, chain.objs.size()=1 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.ff-2TPZacRQ8pNI_5yhXo6lNowvDacN_0 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6448834961006036595', time=2024-02-23T08:42:18.841118+0000, chain.objs.size()=1 2024-02-23T06:42:59.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.983+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.YbsJYs1eEiBj46JgmOJV5UBnwnjJJoS_0 2024-02-23T06:42:59.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.986+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.989+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-23T06:42:59.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.990+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.990+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:42:59.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.990+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-02-23T06:42:59.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5004891223222906009', time=2024-02-23T08:41:12.916900+0000, chain.objs.size()=1 2024-02-23T06:42:59.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.-mQpE57VteQg9f7aRE5B4gbV1T-OdzK_0 2024-02-23T06:42:59.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13818546351650813364', time=2024-02-23T08:41:12.918941+0000, chain.objs.size()=1 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.BNistpd1fGeNu9MvdbTf1F8oEBgnQ6v_0 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5360366032624561365', time=2024-02-23T08:41:12.921630+0000, chain.objs.size()=1 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.rYXfQmq5HNPXMWmbW9_JP8RaoQRUlhe_0 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5636336436735468985', time=2024-02-23T08:41:44.145559+0000, chain.objs.size()=1 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.Vf1sXIFKG_rUvrIKFbBDWBIs_C-Xo91_0 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4831808678226765293', time=2024-02-23T08:41:46.115238+0000, chain.objs.size()=1 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.mgQL_NzUNYMIvyuE2ucVFyn_UUMDot6_0 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14521729077647816132', time=2024-02-23T08:41:46.118216+0000, chain.objs.size()=1 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_._CI7UCs23JZbYd74WjOKk0uVOrTTk1a_0 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13878598719312132017', time=2024-02-23T08:42:18.840261+0000, chain.objs.size()=1 2024-02-23T06:42:59.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.991+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_.D2wOpnzSZ-LDEge6JmYEF7VbH_-a-Bi_0 2024-02-23T06:42:59.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.993+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:42:59.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.997+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-23T06:42:59.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.999+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:42:59.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:42:59.999+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13593846432075693795', time=2024-02-23T08:40:03.343930+0000, chain.objs.size()=1 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.remxPPLEoKPzhmqOehPIIOhiGn9QMqG_0 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7077711042416508109', time=2024-02-23T08:40:04.394875+0000, chain.objs.size()=1 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.gHFXzak-w-lwtwHBjJVnq8Lks8CbA5L_0 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4932308370807614139', time=2024-02-23T08:40:36.471314+0000, chain.objs.size()=1 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.6CzLmpozkPg-55yiXxy7_GmbVNUdQvC_0 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12671336156174687690', time=2024-02-23T08:41:10.519886+0000, chain.objs.size()=1 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.l0osYlvKj__nBX3FBylrcepVnwO6dkk_0 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10528812531048293036', time=2024-02-23T08:41:12.925133+0000, chain.objs.size()=1 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.UpptqE57K54_UhAkoQTS3yuCFvnshj8_0 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15414200928965597617', time=2024-02-23T08:41:43.620744+0000, chain.objs.size()=1 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.YlEHOKN1MDm-mT4NvTSdo2ElXzxbjAk_0 2024-02-23T06:43:00.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12052584484978010575', time=2024-02-23T08:41:45.406353+0000, chain.objs.size()=1 2024-02-23T06:43:00.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.000+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.wKE9myjtDLnW_8S9EPfHsdryA5-8jyn_0 2024-02-23T06:43:00.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.002+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.004+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-23T06:43:00.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.006+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.006+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12337579225015592496', time=2024-02-23T08:38:33.088153+0000, chain.objs.size()=3 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.1 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.2 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-LUKEWARM.2~lCEyX7tDvR3Xxw5qset-8G0oas-P167.3 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4467208422134573424', time=2024-02-23T08:38:33.218120+0000, chain.objs.size()=1 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.Gcl8Izkku0XMqhTAYRT4oFJvBeEuhsX_0 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6341120178007761801', time=2024-02-23T08:38:33.240145+0000, chain.objs.size()=1 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.Iywk2CYI7mi_-6jh6A7sqGSkf4qvQpu_0 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17421441809556770781', time=2024-02-23T08:40:03.339373+0000, chain.objs.size()=1 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.w7_EcUfvqeFbq8gpXhv_9djgnn4GUvn_0 2024-02-23T06:43:00.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7321339986623230877', time=2024-02-23T08:40:03.341360+0000, chain.objs.size()=1 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.rf0sVWjT661QqSZqgyKoxuTBYFQKcg4_0 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13718073925883216259', time=2024-02-23T08:40:04.394975+0000, chain.objs.size()=1 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.6It9ewAsk-s9hZ0zzBo_ZuhHjXDX4Ow_0 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10113156546908148088', time=2024-02-23T08:40:36.474729+0000, chain.objs.size()=1 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_._Z2BLYs3DurohSYzueH5SLIP-R3qR84_0 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3929994005927593729', time=2024-02-23T08:41:12.917855+0000, chain.objs.size()=1 2024-02-23T06:43:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.007+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.tnwPLmXR7G2avMkAdU7oc8iNg6Du1xH_0 2024-02-23T06:43:00.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.011+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.013+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-23T06:43:00.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.014+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.014+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2120083563956461510', time=2024-02-23T08:38:33.209927+0000, chain.objs.size()=1 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7__shadow_.LQoeFSrZ9Kxxb_vXVe9VNgFTjnbGyHA_0 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14341559467621272322', time=2024-02-23T08:40:03.343608+0000, chain.objs.size()=1 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.UvujnE_UyfriYz3-Si6e4gdsNNgSyvl_0 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10462843241288505484', time=2024-02-23T08:40:03.346607+0000, chain.objs.size()=1 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.g0fuEKMAqJxQKCDK7NTIqtqejj87kw1_0 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11429271722536434693', time=2024-02-23T08:40:04.404463+0000, chain.objs.size()=1 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.C8TWG6qUmRC7iSaWd9TPKXZJXFuvhzn_0 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14704491319873908583', time=2024-02-23T08:40:36.476621+0000, chain.objs.size()=1 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.ijCqOBdprMMWg9qR1Iulvr9s0EOEq2A_0 2024-02-23T06:43:00.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4301331226493787042', time=2024-02-23T08:40:39.255504+0000, chain.objs.size()=1 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.2LSRWfrkElfKwraIVXWyOqSJt_PODxM_0 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7742638891131546002', time=2024-02-23T08:41:10.512966+0000, chain.objs.size()=1 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.nJ4prfJ6glMNq5OxiwGoesk62VAir_N_0 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10350040868654237207', time=2024-02-23T08:41:11.863712+0000, chain.objs.size()=1 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_._ksCfBD5p6A4EAFUUuiCB2uArf6KF6L_0 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7443475074101740608', time=2024-02-23T08:41:46.118278+0000, chain.objs.size()=1 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.dfKeQu8uKL5IaH_m88V_wTI02WuNSKK_0 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11739497559215366969', time=2024-02-23T08:42:18.305329+0000, chain.objs.size()=1 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.ge6oXlXBElnxZ0m44z6BPukqLJVf7UG_0 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5531269721513453380', time=2024-02-23T08:42:18.310357+0000, chain.objs.size()=1 2024-02-23T06:43:00.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.015+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.ROue0pdDhjcal0Hmb88yG_706y_EpFU_0 2024-02-23T06:43:00.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.019+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.021+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-23T06:43:00.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.022+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-02-23T06:43:00.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.3583166006167942568', time=2024-02-23T08:40:03.341114+0000, chain.objs.size()=1 2024-02-23T06:43:00.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.bAXWctzuhIb7ZdSus5p00bxuCM0Gg_v_0 2024-02-23T06:43:00.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8125683904060637792', time=2024-02-23T08:40:03.341868+0000, chain.objs.size()=1 2024-02-23T06:43:00.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.0vo49D-mUD1NoVt1iD7fclWX4J_mJjU_0 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11020246195437841008', time=2024-02-23T08:40:03.343651+0000, chain.objs.size()=1 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.CDR1v7gac1BB24CEpFMaTTgbLH7iiXV_0 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.14890264334112786917', time=2024-02-23T08:40:03.350438+0000, chain.objs.size()=1 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.yJN26qOHjJTF9IAqnKV-bLmwi9NUsMo_0 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6876867937305276586', time=2024-02-23T08:41:10.516296+0000, chain.objs.size()=1 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.iqgeKkQgUbrwX6faLrAAxEe0H9jWrxm_0 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18315478248099674882', time=2024-02-23T08:41:11.870482+0000, chain.objs.size()=1 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.bbe1Txy-fcX2CDOJZBOexUlRVWbBeoC_0 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5933105348374934807', time=2024-02-23T08:41:44.146422+0000, chain.objs.size()=1 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.9AJv2PpUJGNyYhfuD8ShLdReu0QKjAb_0 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10938792671490806058', time=2024-02-23T08:41:46.114451+0000, chain.objs.size()=1 2024-02-23T06:43:00.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.023+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.zRr2eJKG7ieR_DoBRAkFbSnXcklpNuP_0 2024-02-23T06:43:00.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.026+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.029+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-23T06:43:00.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.030+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-02-23T06:43:00.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16787921910888933228', time=2024-02-23T08:38:32.866895+0000, chain.objs.size()=1 2024-02-23T06:43:00.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4__shadow_.GtOW_8Ymjm-AjMz7GVpM8xytue3zrqW_0 2024-02-23T06:43:00.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17856747914620662692', time=2024-02-23T08:38:32.912217+0000, chain.objs.size()=4 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.1 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.2 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.3 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11__multipart_foo.2~lv7o8GM1yQJYoKofw0EiHKKareWD8N6.4 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_lLF75WAI7JsKibIxwZJQNeQ65HgwxYC', time=2024-02-23T08:38:33.084275+0000, chain.objs.size()=2 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.NfENy_rTMzWfXqJAZaa50ab5J1HQ4oH_0 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.NfENy_rTMzWfXqJAZaa50ab5J1HQ4oH_1 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5149995593293018004', time=2024-02-23T08:40:04.393658+0000, chain.objs.size()=1 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.-vnJfL5wACX2Qj6ku-QVDYYgDJ14zA4_0 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.10304924748899538519', time=2024-02-23T08:41:44.159179+0000, chain.objs.size()=1 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.OJHhw8J2_9d9qL-XbSZKjir21HA5627_0 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11027016759703963703', time=2024-02-23T08:41:46.124119+0000, chain.objs.size()=1 2024-02-23T06:43:00.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.031+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.otIwtlIzMtokZVLTaKGKlriZ5CCZsH1_0 2024-02-23T06:43:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.036+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.038+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-23T06:43:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.039+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-02-23T06:43:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18096647876763064645', time=2024-02-23T08:40:04.392373+0000, chain.objs.size()=1 2024-02-23T06:43:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.831zJCXoc-e8SazY4xnHMFMkF5r3I2w_0 2024-02-23T06:43:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.867986566551288471', time=2024-02-23T08:41:10.510127+0000, chain.objs.size()=1 2024-02-23T06:43:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.UidaN3GMIhOWsxVxjHBiwV3j5OncHyJ_0 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.6024896716163303273', time=2024-02-23T08:41:10.513607+0000, chain.objs.size()=1 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.Z10_2L5Fa4xa5suM27H5Wa-IiS3bVkJ_0 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17272809577282245974', time=2024-02-23T08:41:11.874422+0000, chain.objs.size()=1 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.24__shadow_.KRaJ5LeSPfqjMPKvqeKeV9N4Aeux619_0 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.11681996615367437953', time=2024-02-23T08:41:44.148838+0000, chain.objs.size()=1 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.iJuLldgFRID15gAe3_F0tKcLSNw9a-n_0 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8319015550806926649', time=2024-02-23T08:41:46.124734+0000, chain.objs.size()=1 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.YglQRyb54qGuAjA5Isn29RORe6Wdzbq_0 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4524197071159420672', time=2024-02-23T08:42:18.842817+0000, chain.objs.size()=1 2024-02-23T06:43:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.040+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17__shadow_._ULghaLT2CH0dTJ9bxSfjXZ2LWANfwo_0 2024-02-23T06:43:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.043+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.046+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-23T06:43:00.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.047+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.047+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17024249465225025790', time=2024-02-23T08:40:04.390571+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.w3g4k6oJ6VWCbzGvtZGfYXRoyFOl7xI_0 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4084926119761420438', time=2024-02-23T08:40:36.470083+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.ixQLH1QWKSCXQ3-5yPSGo2alo9DFPjr_0 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.1558373018105701151', time=2024-02-23T08:40:37.825791+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.22__shadow_.3sva0m9hG024sNlDICZvSuGaBJpfujd_0 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17775022310956217648', time=2024-02-23T08:41:10.508229+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.23__shadow_.NQHkFNh9m1UEUTIkZxLVjo01F0CmnqA_0 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18303977238555412581', time=2024-02-23T08:41:12.920334+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.FT-l_OJH5WTmzk9R0Qvd-VInWPW_SgJ_0 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.4375643508268990614', time=2024-02-23T08:41:12.925680+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.nSWBghqzixT8np4i2yPa-MGhVXQYweF_0 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17820147413705311235', time=2024-02-23T08:42:18.312271+0000, chain.objs.size()=1 2024-02-23T06:43:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.048+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.UmTF8ysZZpQ88_zSExWtF_UG7Qtx28G_0 2024-02-23T06:43:00.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.051+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.053+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-23T06:43:00.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.054+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-02-23T06:43:00.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_Dm26SRyD8bJyaEcCYyzJJaHnXplptwV', time=2024-02-23T08:38:33.060464+0000, chain.objs.size()=1 2024-02-23T06:43:00.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.31ARpUfE0R15wmWGc6Y1zG_Mf0tdAiH_0 2024-02-23T06:43:00.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_vob4BX82C6G1QnDqmUSnLwEvjMtsOuL', time=2024-02-23T08:38:33.072731+0000, chain.objs.size()=2 2024-02-23T06:43:00.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.XGIwL3kvxyj97K57BUF6f98KB1-OOQh_0 2024-02-23T06:43:00.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__shadow_.XGIwL3kvxyj97K57BUF6f98KB1-OOQh_1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2573206275532232678', time=2024-02-23T08:38:33.236203+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.8__shadow_.B9jV02ucQN3avaE5aXz042gVWceYr9Z_0 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.9631746420341116199', time=2024-02-23T08:40:03.344079+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.RVQFe8agCEpjMHg1mxuhcUr2imivZlG_0 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.17647645451899174040', time=2024-02-23T08:40:04.397298+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.flsANf6c1DAgad0-dvVXIoEjM4t8S5U_0 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.13726430919601585839', time=2024-02-23T08:40:36.472663+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.21__shadow_.XhkXAd442Fy5vPFw455l8JkXEmfoq6z_0 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16303724633678786799', time=2024-02-23T08:41:12.920270+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.L3ygGTdm6YOtZzZlkqoC9TBev-_HnLl_0 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.12995800794890585055', time=2024-02-23T08:41:12.922453+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.veH9dkvuYhugVbCDJwGlzVwb17pg6M3_0 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15114672238723791193', time=2024-02-23T08:41:12.923507+0000, chain.objs.size()=1 2024-02-23T06:43:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.25__shadow_.gURFBX64RVOvgHqtj3jnYuhByGohW-f_0 2024-02-23T06:43:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.837324847141533807', time=2024-02-23T08:41:44.152498+0000, chain.objs.size()=1 2024-02-23T06:43:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.b8oRhpJ-fx5i8NR58afxyiHmKbH4-0D_0 2024-02-23T06:43:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5508412950765584692', time=2024-02-23T08:42:18.309442+0000, chain.objs.size()=1 2024-02-23T06:43:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.055+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.EqNTGYGAZmwey7NAUJCL6oOutCs4lgo_0 2024-02-23T06:43:00.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.059+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.063+0000 7f6af53a2800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-23T06:43:00.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.064+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.064+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_1_4e473e926fc6451890b2ad9bed6fbbcf', time=2024-02-23T08:38:33.029957+0000, chain.objs.size()=1 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.joozGazRa_nWxqs5UuSFzpTTO_GtABh_0 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='_F9GdTqnD1bWq7BC7_DyILKixADQHNvE', time=2024-02-23T08:38:33.038173+0000, chain.objs.size()=1 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15__shadow_.ONtuVYkeWCS6HqyJBENV6VI14gbvr9y_0 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2_58735bfaa27f1d39e76828e5f9966ee4', time=2024-02-23T08:38:33.092362+0000, chain.objs.size()=3 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.1 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.2 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16__multipart_foo-STANDARD.2~44N8ln1HaSXxihTAlF2ZCEg17DlsJ0g.3 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2721585272405822466', time=2024-02-23T08:40:03.345077+0000, chain.objs.size()=1 2024-02-23T06:43:00.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.19__shadow_.llqbRBwRA_i30_lr3MUUrVXD96eSmsn_0 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.7335130742755633440', time=2024-02-23T08:40:04.402132+0000, chain.objs.size()=1 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.20__shadow_.1SeQXyhJD9T0quUcUq0E8yjFnND6OeO_0 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.2600940200199204926', time=2024-02-23T08:41:44.148100+0000, chain.objs.size()=1 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.26__shadow_.C1BmnDKEn_1ji1ZxaQWFMvUI53ObtGI_0 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.15337723492136035484', time=2024-02-23T08:41:46.113327+0000, chain.objs.size()=1 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.HncLuPlOs1asCB_SaGTqgONcMIiLI4Z_0 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.16942332126277635547', time=2024-02-23T08:41:46.116981+0000, chain.objs.size()=1 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.27__shadow_.CAzvDg63GdzvhRIpzpLNSq11euH3PtV_0 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5924117837786045356', time=2024-02-23T08:42:18.315232+0000, chain.objs.size()=1 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.28__shadow_.KTP9rEHDNom7gUKcFcNzbEmBRbROgok_0 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 20 garbage collection: RGWGC::process iterating over entry tag='7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.5614409950298887597', time=2024-02-23T08:42:31.420326+0000, chain.objs.size()=1 2024-02-23T06:43:00.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.065+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7548481d-b1fb-47f2-93fa-498ec3ee60c4.4568.18__shadow:ZPlwVHhkPugpjdERTBia1rwhLGIu79A_.3TUyQ41B-SAwydpbaQuDdY4tgXBqszf_0 2024-02-23T06:43:00.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.070+0000 7f6af53a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-23T06:43:00.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.075+0000 7f69a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:43:00.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.077+0000 7f6af53a2800 20 remove_watcher() i=0 2024-02-23T06:43:00.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.077+0000 7f6af53a2800 2 removed watcher, disabling cache 2024-02-23T06:43:00.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.078+0000 7f6af53a2800 20 remove_watcher() i=1 2024-02-23T06:43:00.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.079+0000 7f6af53a2800 20 remove_watcher() i=2 2024-02-23T06:43:00.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.080+0000 7f6af53a2800 20 remove_watcher() i=3 2024-02-23T06:43:00.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.081+0000 7f6af53a2800 20 remove_watcher() i=4 2024-02-23T06:43:00.082 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.082+0000 7f6af53a2800 20 remove_watcher() i=5 2024-02-23T06:43:00.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.083+0000 7f6af53a2800 20 remove_watcher() i=6 2024-02-23T06:43:00.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.084+0000 7f6af53a2800 20 remove_watcher() i=7 2024-02-23T06:43:00.094 DEBUG:teuthology.orchestra.run.smithi142:> radosgw-admin gc process --include-all 2024-02-23T06:43:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:43:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T06:43:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.176+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.177+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.177+0000 7f1b7351f800 20 realm 2024-02-23T06:43:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.177+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.178+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.178+0000 7f1b7351f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-23T06:43:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.178+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.178+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.178+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.178+0000 7f1b7351f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:43:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.179+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.179+0000 7f1b7351f800 20 rados_obj.operate() r=0 bl.length=1021 2024-02-23T06:43:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.179+0000 7f1b7351f800 20 searching for the correct realm 2024-02-23T06:43:00.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.182+0000 7f1b6f84c640 0 -- 172.21.15.142:0/1890171962 >> [v2:172.21.15.152:6816/1410246671,v1:172.21.15.152:6817/1410246671] conn(0x7f1b64028040 msgr2=0x7f1b64053b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:43:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.185+0000 7f1b6f04b640 0 -- 172.21.15.142:0/1890171962 >> [v2:172.21.15.142:6824/1577595781,v1:172.21.15.142:6825/1577595781] conn(0x7f1b64034700 msgr2=0x7f1b6403fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-02-23T06:43:00.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 RGWRados::pool_iterate: got zonegroup_info.e4ce483b-3bcb-472f-a6d0-970b11a98973 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 RGWRados::pool_iterate: got zone_info.7548481d-b1fb-47f2-93fa-498ec3ee60c4 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 RGWRados::pool_iterate: got default.zone. 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 RGWRados::pool_iterate: got zone_names.default 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 rados_obj.operate() r=0 bl.length=46 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.391+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados_obj.operate() r=0 bl.length=432 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 zone default found 2024-02-23T06:43:00.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 4 Realm: () 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 4 ZoneGroup: default (e4ce483b-3bcb-472f-a6d0-970b11a98973) 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 4 Zone: default (7548481d-b1fb-47f2-93fa-498ec3ee60c4) 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 zonegroup default 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados->read ofs=0 len=0 2024-02-23T06:43:00.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.392+0000 7f1b7351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-02-23T06:43:00.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.393+0000 7f1b7351f800 20 started sync module instance, tier type = 2024-02-23T06:43:00.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.393+0000 7f1b7351f800 20 started zone id=7548481d-b1fb-47f2-93fa-498ec3ee60c4 (name=default) with tier type = 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=0 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=1 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=2 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=3 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=4 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=5 2024-02-23T06:43:00.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=6 2024-02-23T06:43:00.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 20 add_watcher() i=7 2024-02-23T06:43:00.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.402+0000 7f1b7351f800 2 all 8 watchers are set, enabling cache 2024-02-23T06:43:00.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.404+0000 7f1a25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:43:00.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.404+0000 7f1b7351f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-23T06:43:00.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.404+0000 7f1b7351f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-23T06:43:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.444+0000 7f1a24fe1640 20 reqs_thread_entry: start 2024-02-23T06:43:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.444+0000 7f1b7351f800 20 init_complete bucket index max shards: 11 2024-02-23T06:43:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.444+0000 7f1b7351f800 20 Filter name: none 2024-02-23T06:43:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.444+0000 7f199e7fc640 20 reqs_thread_entry: start 2024-02-23T06:43:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.444+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-23T06:43:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.446+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.446+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.446+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.447+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-23T06:43:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.449+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.449+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.449+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.451+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-23T06:43:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.452+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.452+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.453+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.454+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-23T06:43:00.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.455+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.456+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.456+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.457+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-23T06:43:00.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.458+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.459+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.459+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.460+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-23T06:43:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.461+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.462+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.462+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.463+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-23T06:43:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.465+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.465+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.465+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.466+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-23T06:43:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.468+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.468+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.468+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.469+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-23T06:43:00.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.471+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.471+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.472+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.472+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-23T06:43:00.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.474+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.474+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.474+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.475+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-23T06:43:00.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.477+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.477+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.478+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.479+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-23T06:43:00.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.480+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.480+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.480+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.481+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-23T06:43:00.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.483+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.483+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.483+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.484+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-23T06:43:00.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.485+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.486+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.486+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.487+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-23T06:43:00.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.488+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.489+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.489+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.490+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-23T06:43:00.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.491+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.492+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.492+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.493+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-23T06:43:00.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.495+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.495+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.495+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.496+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-23T06:43:00.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.498+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.498+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.498+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.499+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-23T06:43:00.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.500+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.501+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.501+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.502+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-23T06:43:00.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.503+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.504+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.504+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.505+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-23T06:43:00.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.506+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.507+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.507+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.508+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-23T06:43:00.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.509+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.509+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.510+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.511+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-23T06:43:00.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.512+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.512+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.513+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.514+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-23T06:43:00.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.515+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.515+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.515+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.516+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-23T06:43:00.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.518+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.519+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.519+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.520+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-23T06:43:00.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.521+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.522+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.522+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.523+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.524+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.525+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.525+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.526+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.527+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.527+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.527+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.528+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-23T06:43:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.530+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.530+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.530+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.531+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-23T06:43:00.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.532+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.533+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.533+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.534+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-23T06:43:00.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.535+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.536+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.536+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.537+0000 7f1b7351f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-23T06:43:00.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.538+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.539+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-23T06:43:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.539+0000 7f1b7351f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-23T06:43:00.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.541+0000 7f1a25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-23T06:43:00.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.543+0000 7f1b7351f800 20 remove_watcher() i=0 2024-02-23T06:43:00.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.543+0000 7f1b7351f800 2 removed watcher, disabling cache 2024-02-23T06:43:00.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.544+0000 7f1b7351f800 20 remove_watcher() i=1 2024-02-23T06:43:00.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.545+0000 7f1b7351f800 20 remove_watcher() i=2 2024-02-23T06:43:00.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.546+0000 7f1b7351f800 20 remove_watcher() i=3 2024-02-23T06:43:00.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.547+0000 7f1b7351f800 20 remove_watcher() i=4 2024-02-23T06:43:00.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.548+0000 7f1b7351f800 20 remove_watcher() i=5 2024-02-23T06:43:00.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.549+0000 7f1b7351f800 20 remove_watcher() i=6 2024-02-23T06:43:00.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T06:43:00.549+0000 7f1b7351f800 20 remove_watcher() i=7 2024-02-23T06:43:00.560 DEBUG:teuthology.orchestra.run.smithi142:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-02-23T06:43:01.086 INFO:teuthology.orchestra.run.smithi142.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-02-23T06:43:04.686 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :clean UP-TO-DATE 2024-02-23T06:43:26.886 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :compileJava 2024-02-23T06:43:26.886 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :processResources 2024-02-23T06:43:26.886 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :classes 2024-02-23T06:43:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:27.585 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :compileTestJava 2024-02-23T06:43:27.586 INFO:teuthology.orchestra.run.smithi142.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-02-23T06:43:27.586 INFO:teuthology.orchestra.run.smithi142.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-02-23T06:43:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:27.587 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :processTestResources NO-SOURCE 2024-02-23T06:43:27.587 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :testClasses 2024-02-23T06:43:33.385 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:33.385 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :test 2024-02-23T06:43:33.385 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:33.385 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-02-23T06:43:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:33.885 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-02-23T06:43:34.085 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.085 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-02-23T06:43:34.085 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.085 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-02-23T06:43:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.288 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-02-23T06:43:34.684 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.685 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-02-23T06:43:34.985 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.985 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-02-23T06:43:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.986 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-02-23T06:43:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:34.986 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-02-23T06:43:35.085 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:35.085 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-02-23T06:43:35.284 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:35.285 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-02-23T06:43:35.585 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:35.585 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-02-23T06:43:35.984 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:35.985 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-02-23T06:43:36.085 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:36.085 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-02-23T06:43:36.085 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23 06:43:36,065 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-02-23T06:43:39.184 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:39.185 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-02-23T06:43:39.485 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:39.485 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-02-23T06:43:39.485 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:39.485 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-02-23T06:43:39.684 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:39.685 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-02-23T06:43:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:39.785 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-02-23T06:43:40.084 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:40.085 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-02-23T06:43:40.584 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:40.585 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-02-23T06:43:40.785 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:40.785 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-02-23T06:43:40.785 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:40.785 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-02-23T06:43:40.884 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:40.885 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-02-23T06:43:43.385 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:43.385 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-02-23T06:43:43.584 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:43.585 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-02-23T06:43:43.985 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:43.985 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-02-23T06:43:44.184 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:44.185 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-02-23T06:43:44.385 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:44.385 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-02-23T06:43:44.584 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:44.585 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-02-23T06:43:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:49.285 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-02-23T06:43:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:49.485 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-02-23T06:43:50.985 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:50.985 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-02-23T06:43:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:51.085 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-02-23T06:43:51.584 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:51.585 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-02-23T06:43:51.784 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:51.784 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-02-23T06:43:52.045 INFO:tasks.rgw.client.0.smithi142.stdout:terminate called after throwing an instance of 'std::system_error' 2024-02-23T06:43:52.045 INFO:tasks.rgw.client.0.smithi142.stdout: what(): No such file or directory 2024-02-23T06:43:52.045 INFO:tasks.rgw.client.0.smithi142.stdout:*** Caught signal (Aborted) ** 2024-02-23T06:43:52.046 INFO:tasks.rgw.client.0.smithi142.stdout: in thread 7f13e44d3640 thread_name:io_context_pool 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f147cc54db0] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x7f147cca154c] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 3: raise() 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 4: abort() 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7f147d0a1a01] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x7f147d0ad37c] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 7: /lib64/libstdc++.so.6(+0xad3e7) [0x7f147d0ad3e7] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 8: /lib64/libstdc++.so.6(+0xad36f) [0x7f147d0ad36f] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 9: radosgw(+0xd72fe6) [0x560774b14fe6] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 10: radosgw(+0x3da231) [0x56077417c231] 2024-02-23T06:43:52.047 INFO:tasks.rgw.client.0.smithi142.stdout: 11: /lib64/libstdc++.so.6(+0xdb924) [0x7f147d0db924] 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: 12: /lib64/libc.so.6(+0x9f802) [0x7f147cc9f802] 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: 13: /lib64/libc.so.6(+0x3f450) [0x7f147cc3f450] 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout:2024-02-23T06:43:52.047+0000 7f13e44d3640 -1 *** Caught signal (Aborted) ** 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: in thread 7f13e44d3640 thread_name:io_context_pool 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f147cc54db0] 2024-02-23T06:43:52.048 INFO:tasks.rgw.client.0.smithi142.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x7f147cca154c] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 3: raise() 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 4: abort() 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7f147d0a1a01] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x7f147d0ad37c] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 7: /lib64/libstdc++.so.6(+0xad3e7) [0x7f147d0ad3e7] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 8: /lib64/libstdc++.so.6(+0xad36f) [0x7f147d0ad36f] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 9: radosgw(+0xd72fe6) [0x560774b14fe6] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 10: radosgw(+0x3da231) [0x56077417c231] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 11: /lib64/libstdc++.so.6(+0xdb924) [0x7f147d0db924] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 12: /lib64/libc.so.6(+0x9f802) [0x7f147cc9f802] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 13: /lib64/libc.so.6(+0x3f450) [0x7f147cc3f450] 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:43:52.049 INFO:tasks.rgw.client.0.smithi142.stdout: 2024-02-23T06:43:52.062 INFO:tasks.rgw.client.0.smithi142.stdout: 0> 2024-02-23T06:43:52.047+0000 7f13e44d3640 -1 *** Caught signal (Aborted) ** 2024-02-23T06:43:52.062 INFO:tasks.rgw.client.0.smithi142.stdout: in thread 7f13e44d3640 thread_name:io_context_pool 2024-02-23T06:43:52.062 INFO:tasks.rgw.client.0.smithi142.stdout: 2024-02-23T06:43:52.062 INFO:tasks.rgw.client.0.smithi142.stdout: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:43:52.062 INFO:tasks.rgw.client.0.smithi142.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f147cc54db0] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x7f147cca154c] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 3: raise() 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 4: abort() 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7f147d0a1a01] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x7f147d0ad37c] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 7: /lib64/libstdc++.so.6(+0xad3e7) [0x7f147d0ad3e7] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 8: /lib64/libstdc++.so.6(+0xad36f) [0x7f147d0ad36f] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 9: radosgw(+0xd72fe6) [0x560774b14fe6] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 10: radosgw(+0x3da231) [0x56077417c231] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 11: /lib64/libstdc++.so.6(+0xdb924) [0x7f147d0db924] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 12: /lib64/libc.so.6(+0x9f802) [0x7f147cc9f802] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 13: /lib64/libc.so.6(+0x3f450) [0x7f147cc3f450] 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:43:52.063 INFO:tasks.rgw.client.0.smithi142.stdout: 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: -50> 2024-02-23T06:43:52.047+0000 7f13e44d3640 -1 *** Caught signal (Aborted) ** 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: in thread 7f13e44d3640 thread_name:io_context_pool 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: ceph version 19.0.0-1668-g1fb7413e (1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4) squid (dev) 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f147cc54db0] 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x7f147cca154c] 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: 3: raise() 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: 4: abort() 2024-02-23T06:43:52.074 INFO:tasks.rgw.client.0.smithi142.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7f147d0a1a01] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x7f147d0ad37c] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 7: /lib64/libstdc++.so.6(+0xad3e7) [0x7f147d0ad3e7] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 8: /lib64/libstdc++.so.6(+0xad36f) [0x7f147d0ad36f] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 9: radosgw(+0xd72fe6) [0x560774b14fe6] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 10: radosgw(+0x3da231) [0x56077417c231] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 11: /lib64/libstdc++.so.6(+0xdb924) [0x7f147d0db924] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 12: /lib64/libc.so.6(+0x9f802) [0x7f147cc9f802] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 13: /lib64/libc.so.6(+0x3f450) [0x7f147cc3f450] 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-02-23T06:43:52.075 INFO:tasks.rgw.client.0.smithi142.stdout: 2024-02-23T06:43:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:43:52.185 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-02-23T06:43:52.278 INFO:tasks.rgw.client.0.smithi142.stderr:daemon-helper: command crashed with signal 6 2024-02-23T06:43:52.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-02-23T06:43:58.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2024-02-23T06:44:05.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~13s 2024-02-23T06:44:11.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~19s 2024-02-23T06:44:17.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~25s 2024-02-23T06:44:24.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~32s 2024-02-23T06:44:30.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~38s 2024-02-23T06:44:36.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~44s 2024-02-23T06:44:43.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~50s 2024-02-23T06:44:49.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~57s 2024-02-23T06:44:55.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~63s 2024-02-23T06:45:01.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~69s 2024-02-23T06:45:08.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~76s 2024-02-23T06:45:14.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~82s 2024-02-23T06:45:20.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~88s 2024-02-23T06:45:27.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~95s 2024-02-23T06:45:33.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~101s 2024-02-23T06:45:39.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~107s 2024-02-23T06:45:46.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~114s 2024-02-23T06:45:52.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~120s 2024-02-23T06:45:58.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~126s 2024-02-23T06:46:05.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~133s 2024-02-23T06:46:11.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~139s 2024-02-23T06:46:17.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~145s 2024-02-23T06:46:23.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~151s 2024-02-23T06:46:30.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~158s 2024-02-23T06:46:36.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~164s 2024-02-23T06:46:42.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~170s 2024-02-23T06:46:49.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~177s 2024-02-23T06:46:55.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~183s 2024-02-23T06:47:01.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~189s 2024-02-23T06:47:08.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~196s 2024-02-23T06:47:14.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~202s 2024-02-23T06:47:20.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~208s 2024-02-23T06:47:27.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~215s 2024-02-23T06:47:33.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~221s 2024-02-23T06:47:39.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~227s 2024-02-23T06:47:46.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~233s 2024-02-23T06:47:52.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~240s 2024-02-23T06:47:58.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~246s 2024-02-23T06:48:04.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~252s 2024-02-23T06:48:11.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~259s 2024-02-23T06:48:17.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~265s 2024-02-23T06:48:23.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~271s 2024-02-23T06:48:30.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~278s 2024-02-23T06:48:36.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~284s 2024-02-23T06:48:42.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~290s 2024-02-23T06:48:49.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~297s 2024-02-23T06:48:55.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~303s 2024-02-23T06:48:55.437 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-02-23T06:48:56.748 INFO:tasks.ceph.osd.0:Sent signal 15 2024-02-23T06:48:56.749 INFO:tasks.ceph.osd.1:Sent signal 15 2024-02-23T06:48:56.750 INFO:tasks.ceph.osd.2:Sent signal 15 2024-02-23T06:48:56.750 INFO:tasks.ceph.osd.3:Sent signal 15 2024-02-23T06:48:56.750 INFO:tasks.ceph.osd.4:Sent signal 15 2024-02-23T06:48:56.750 INFO:tasks.ceph.osd.5:Sent signal 15 2024-02-23T06:48:56.750 INFO:tasks.ceph.osd.6:Sent signal 15 2024-02-23T06:48:56.751 INFO:tasks.ceph.osd.7:Sent signal 15 2024-02-23T06:48:56.751 INFO:tasks.ceph.mon.a:Sent signal 15 2024-02-23T06:48:56.751 INFO:tasks.ceph.mon.c:Sent signal 15 2024-02-23T06:48:56.751 INFO:tasks.ceph.mon.b:Sent signal 15 2024-02-23T06:48:56.751 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-02-23T06:48:56.751 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-02-23T06:48:56.753 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f7d533e1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34118) UID: 0 2024-02-23T06:48:56.753 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f7d533e1640 -1 osd.4 254 *** Got signal Terminated *** 2024-02-23T06:48:56.753 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f7d533e1640 -1 osd.4 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.753 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:48:56.749+0000 7fa42d5f8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 34267) UID: 0 2024-02-23T06:48:56.753 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:48:56.749+0000 7fa42d5f8640 -1 osd.0 254 *** Got signal Terminated *** 2024-02-23T06:48:56.753 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-02-23T06:48:56.749+0000 7fa42d5f8640 -1 osd.0 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.754 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f7a3dde1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 34122) UID: 0 2024-02-23T06:48:56.754 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f7a3dde1640 -1 osd.5 254 *** Got signal Terminated *** 2024-02-23T06:48:56.754 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f7a3dde1640 -1 osd.5 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.754 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f9258bf8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 34117) UID: 0 2024-02-23T06:48:56.755 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f9258bf8640 -1 osd.6 254 *** Got signal Terminated *** 2024-02-23T06:48:56.755 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f9258bf8640 -1 osd.6 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.755 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:48:56.750+0000 7ff2673e1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 34269) UID: 0 2024-02-23T06:48:56.755 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:48:56.750+0000 7ff2673e1640 -1 osd.1 254 *** Got signal Terminated *** 2024-02-23T06:48:56.755 INFO:tasks.ceph.osd.1.smithi142.stderr:2024-02-23T06:48:56.750+0000 7ff2673e1640 -1 osd.1 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.755 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f4a633f8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 34124) UID: 0 2024-02-23T06:48:56.756 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f4a633f8640 -1 osd.7 254 *** Got signal Terminated *** 2024-02-23T06:48:56.756 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-23T06:48:56.751+0000 7f4a633f8640 -1 osd.7 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.756 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:48:56.750+0000 7f59711f8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 34273) UID: 0 2024-02-23T06:48:56.756 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:48:56.750+0000 7f59711f8640 -1 osd.2 254 *** Got signal Terminated *** 2024-02-23T06:48:56.756 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-02-23T06:48:56.750+0000 7f59711f8640 -1 osd.2 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.757 INFO:tasks.ceph.mon.b.smithi152.stderr:2024-02-23T06:48:56.752+0000 7f5f80295640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 33526) UID: 0 2024-02-23T06:48:56.757 INFO:tasks.ceph.mon.b.smithi152.stderr:2024-02-23T06:48:56.752+0000 7f5f80295640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-02-23T06:48:56.757 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:48:56.751+0000 7f172f7f8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 34271) UID: 0 2024-02-23T06:48:56.757 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:48:56.751+0000 7f172f7f8640 -1 osd.3 254 *** Got signal Terminated *** 2024-02-23T06:48:56.757 INFO:tasks.ceph.osd.3.smithi142.stderr:2024-02-23T06:48:56.751+0000 7f172f7f8640 -1 osd.3 254 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-23T06:48:56.758 INFO:tasks.ceph.mon.a.smithi142.stderr:2024-02-23T06:48:56.751+0000 7f3e9f695640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 33904) UID: 0 2024-02-23T06:48:56.758 INFO:tasks.ceph.mon.a.smithi142.stderr:2024-02-23T06:48:56.751+0000 7f3e9f695640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-23T06:48:56.758 INFO:tasks.ceph.mon.c.smithi142.stderr:2024-02-23T06:48:56.752+0000 7f3a55895640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 33906) UID: 0 2024-02-23T06:48:56.758 INFO:tasks.ceph.mon.c.smithi142.stderr:2024-02-23T06:48:56.752+0000 7f3a55895640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-02-23T06:48:56.759 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:48:56.752+0000 7f85b5ff7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 33952) UID: 0 2024-02-23T06:48:56.759 INFO:tasks.ceph.mgr.y.smithi142.stderr:2024-02-23T06:48:56.752+0000 7f85b5ff7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-23T06:48:56.953 INFO:tasks.ceph.mgr.x.smithi152.stderr:daemon-helper: command crashed with signal 15 2024-02-23T06:51:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:51:43.887 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-02-23T06:51:43.986 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:51:43.987 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 FAILED 2024-02-23T06:51:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:212 2024-02-23T06:51:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:212 2024-02-23T06:51:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:212 2024-02-23T06:52:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:52:33.887 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-02-23T06:52:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:52:33.888 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 FAILED 2024-02-23T06:52:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:168 2024-02-23T06:52:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:168 2024-02-23T06:52:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:168 2024-02-23T06:53:23.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:53:23.987 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-02-23T06:53:23.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:53:23.987 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 FAILED 2024-02-23T06:53:23.987 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:258 2024-02-23T06:53:23.987 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:258 2024-02-23T06:53:23.988 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:258 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 FAILED 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:398 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:398 2024-02-23T06:54:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:398 2024-02-23T06:55:03.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:55:03.987 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-02-23T06:55:03.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:55:03.987 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 FAILED 2024-02-23T06:55:03.987 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:442 2024-02-23T06:55:03.988 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:442 2024-02-23T06:55:03.988 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:442 2024-02-23T06:55:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:55:53.987 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-02-23T06:55:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:55:53.988 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 FAILED 2024-02-23T06:55:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:304 2024-02-23T06:55:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:304 2024-02-23T06:55:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:304 2024-02-23T06:56:44.086 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:56:44.087 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-02-23T06:56:44.087 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:56:44.087 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 FAILED 2024-02-23T06:56:44.087 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:586 2024-02-23T06:56:44.087 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:586 2024-02-23T06:56:44.087 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:586 2024-02-23T06:57:34.087 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:57:34.088 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-02-23T06:57:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:57:34.088 INFO:teuthology.orchestra.run.smithi142.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 FAILED 2024-02-23T06:57:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: com.amazonaws.SdkClientException at AWS4Test.java:825 2024-02-23T06:57:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: org.apache.http.conn.HttpHostConnectException at AWS4Test.java:825 2024-02-23T06:57:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: Caused by: java.net.ConnectException at AWS4Test.java:825 2024-02-23T06:58:24.186 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:58:24.186 INFO:teuthology.orchestra.run.smithi142.stdout:---------------------------------------------------------------------- 2024-02-23T06:58:24.186 INFO:teuthology.orchestra.run.smithi142.stdout:| Results: FAILURE (26 tests, 18 successes, 8 failures, 0 skipped) | 2024-02-23T06:58:24.187 INFO:teuthology.orchestra.run.smithi142.stdout:---------------------------------------------------------------------- 2024-02-23T06:58:24.187 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:58:24.187 INFO:teuthology.orchestra.run.smithi142.stderr:26 tests completed, 8 failed 2024-02-23T06:58:24.188 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:58:24.188 INFO:teuthology.orchestra.run.smithi142.stdout:> Task :test FAILED 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr:FAILURE: Build failed with an exception. 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr:* What went wrong: 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr:Execution failed for task ':test'. 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr:> There were failing tests. See the report at: file:///home/ubuntu/cephtest/s3-tests-java/build/reports/tests/test/index.html 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr:* Try: 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr:Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. 2024-02-23T06:58:24.190 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:58:24.191 INFO:teuthology.orchestra.run.smithi142.stderr:* Get more help at https://help.gradle.org 2024-02-23T06:58:24.191 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-23T06:58:24.191 INFO:teuthology.orchestra.run.smithi142.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-02-23T06:58:24.192 INFO:teuthology.orchestra.run.smithi142.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-02-23T06:58:24.192 INFO:teuthology.orchestra.run.smithi142.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-02-23T06:58:24.192 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T06:58:24.193 INFO:teuthology.orchestra.run.smithi142.stderr:BUILD FAILED in 15m 23s 2024-02-23T06:58:24.193 INFO:teuthology.orchestra.run.smithi142.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-02-23T06:58:24.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T06:58:24.533 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 94, in begin self.run_tests() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 323, in run_tests self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test' 2024-02-23T06:58:24.770 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=485287faf22048aaa9bf01676a9b3b22 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 94, in begin self.run_tests() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 323, in run_tests self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test' 2024-02-23T06:58:24.773 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-02-23T06:58:24.783 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-02-23T06:58:24.783 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-02-23T06:58:24.784 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-02-23T06:58:24.849 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-02-23T06:58:24.850 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-02-23T06:58:24.904 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T06:58:24.905 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T07:03:24.907 INFO:teuthology.orchestra.run.smithi142.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-02-23T07:03:24.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:03:24.910 ERROR:teuthology.run_tasks:Manager failed: s3tests-java Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2024-02-23T07:03:24.917 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-02-23T07:03:24.933 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-02-23T07:03:24.949 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-02-23T07:03:25.014 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-23T07:03:25.027 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/rgw.py", line 500, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2024-02-23T07:03:25.029 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-23T07:03:25.030 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:03:25.030 INFO:tasks.rgw.client.0:Stopped 2024-02-23T07:03:25.030 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-23T07:03:25.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/vault-root-token 2024-02-23T07:03:25.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-02-23T07:03:25.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-23T07:03:25.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-23T07:03:25.227 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-23T07:03:25.321 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-02-23T07:03:25.322 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-02-23T07:08:25.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-23T07:08:25.322+0000 7f6f5bc8a800 0 monclient(hunting): authenticate timed out after 300 2024-02-23T07:08:25.324 INFO:teuthology.orchestra.run.smithi142.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-02-23T07:08:25.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:08:25.326 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/rgw.py", line 252, in start_rgw yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/rgw.py", line 500, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/rgw.py", line 500, in task yield File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/rgw.py", line 327, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2024-02-23T07:08:25.346 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-02-23T07:08:25.357 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-23T07:08:25.371 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-23T07:08:25.371 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-23T07:10:25.432 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-02-23T07:10:25.434 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-02-23T07:10:25.453 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-23T07:10:25.453 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-23T07:10:25.454 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-23T07:10:25.454 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.459 INFO:tasks.ceph.osd.0:Stopped 2024-02-23T07:10:25.459 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-23T07:10:25.459 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.459 INFO:tasks.ceph.osd.1:Stopped 2024-02-23T07:10:25.460 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-23T07:10:25.460 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.460 INFO:tasks.ceph.osd.2:Stopped 2024-02-23T07:10:25.460 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-23T07:10:25.460 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.460 INFO:tasks.ceph.osd.3:Stopped 2024-02-23T07:10:25.461 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-23T07:10:25.461 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.461 INFO:tasks.ceph.osd.4:Stopped 2024-02-23T07:10:25.461 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-23T07:10:25.461 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.461 INFO:tasks.ceph.osd.5:Stopped 2024-02-23T07:10:25.462 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-23T07:10:25.462 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.462 INFO:tasks.ceph.osd.6:Stopped 2024-02-23T07:10:25.462 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-23T07:10:25.463 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.463 INFO:tasks.ceph.osd.7:Stopped 2024-02-23T07:10:25.463 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-23T07:10:25.463 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-23T07:10:25.464 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.464 INFO:tasks.ceph.mgr.y:Stopped 2024-02-23T07:10:25.464 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-23T07:10:25.464 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:10:25.464 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-02-23T07:10:25.483 INFO:tasks.ceph.mgr.x:Stopped 2024-02-23T07:10:25.483 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-23T07:10:25.484 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-23T07:10:25.484 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.484 INFO:tasks.ceph.mon.a:Stopped 2024-02-23T07:10:25.484 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-23T07:10:25.484 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.485 INFO:tasks.ceph.mon.c:Stopped 2024-02-23T07:10:25.485 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-23T07:10:25.485 INFO:teuthology.orchestra.run:waiting for 300 2024-02-23T07:10:25.485 INFO:tasks.ceph.mon.b:Stopped 2024-02-23T07:10:25.485 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-23T07:10:25.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-02-23T07:10:25.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T07:10:25.638 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-23T07:10:25.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T07:10:25.743 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-23T07:10:25.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T07:10:25.844 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-23T07:10:25.922 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T07:10:25.923 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-23T07:10:26.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T07:10:26.043 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-23T07:10:26.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T07:10:26.376 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-23T07:10:26.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T07:10:26.462 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-23T07:10:26.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T07:10:26.536 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-23T07:10:26.610 INFO:tasks.ceph:Archiving mon data... 2024-02-23T07:10:26.612 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/data/mon.a.tgz 2024-02-23T07:10:26.612 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-23T07:10:26.640 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.a59FAwMHwb 2024-02-23T07:10:26.641 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.a59FAwMHwb 2024-02-23T07:10:26.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.a59FAwMHwb 2024-02-23T07:10:26.930 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.a59FAwMHwb is 348KB 2024-02-23T07:10:27.030 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.a59FAwMHwb 2024-02-23T07:10:27.056 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/data/mon.c.tgz 2024-02-23T07:10:27.056 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-23T07:10:27.122 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.aLLYJ61Qt3 2024-02-23T07:10:27.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aLLYJ61Qt3 2024-02-23T07:10:27.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.aLLYJ61Qt3 2024-02-23T07:10:27.402 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.aLLYJ61Qt3 is 354KB 2024-02-23T07:10:27.499 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.aLLYJ61Qt3 2024-02-23T07:10:27.526 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/data/mon.b.tgz 2024-02-23T07:10:27.526 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-02-23T07:10:27.560 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.18nXbTvJwz 2024-02-23T07:10:27.561 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.18nXbTvJwz 2024-02-23T07:10:27.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.18nXbTvJwz 2024-02-23T07:10:27.863 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.18nXbTvJwz is 354KB 2024-02-23T07:10:27.960 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.18nXbTvJwz 2024-02-23T07:10:27.987 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-23T07:10:27.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-23T07:10:27.990 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-23T07:10:28.097 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-23T07:10:28.134 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-23T07:10:28.134 INFO:tasks.ceph:Archiving crash dumps... 2024-02-23T07:10:28.136 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/remote/smithi142/crash 2024-02-23T07:10:28.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-23T07:10:28.215 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/remote/smithi152/crash 2024-02-23T07:10:28.215 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-23T07:10:28.254 INFO:tasks.ceph:Compressing logs... 2024-02-23T07:10:28.254 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-23T07:10:28.257 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-23T07:10:28.352 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-23T07:10:28.352 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33967.log 2024-02-23T07:10:28.352 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33747.log 2024-02-23T07:10:28.352 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.33967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33923.log 2024-02-23T07:10:28.352 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33967.log.gz 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33703.log 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33747.log: /var/log/ceph/ceph-client.admin.33703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34011.log 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33923.log.gz 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr: 26.9% -- replaced with /var/log/ceph/ceph-client.admin.33703.log.gz 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.34011.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-23T07:10:28.353 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33835.log 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33835.log.gz 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-23T07:10:28.354 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph.log: -- /var/log/ceph/ceph-client.admin.33879.log 2024-02-23T07:10:28.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33791.log 2024-02-23T07:10:28.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-02-23T07:10:28.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33791.log.gz 2024-02-23T07:10:28.355 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-23T07:10:28.364 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-23T07:10:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120496.log 2024-02-23T07:10:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41079.log 2024-02-23T07:10:28.380 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.120496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112793.log 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120496.log.gz 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93945.log 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41079.log.gz 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.112793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127943.log 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.112793.log.gz 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.93945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70844.log 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.93945.log.gz 2024-02-23T07:10:28.381 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.127943.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127943.log.gz 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79806.log 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.70844.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76197.log 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.79806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61614.log 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.79806.log.gz 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.76197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41717.log 2024-02-23T07:10:28.382 INFO:teuthology.orchestra.run.smithi142.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.76197.log.gz 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71461.log 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.61614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61614.log.gz 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61638.log 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41717.log.gz 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.70844.log.gz 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.71461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40169.log 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.61638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96301.log 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.61638.log.gz 2024-02-23T07:10:28.383 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40169.log.gz 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40383.log 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.96301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127218.log 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.71461.log.gz 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40383.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96301.log.gz 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40383.log.gz 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42627.log 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44442.log 2024-02-23T07:10:28.384 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.127218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127218.log.gz 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.42627.log.gz 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.44442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52070.log 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.44442.log.gz 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83340.log 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.52070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89230.log 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.83340.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.52070.log.gz 2024-02-23T07:10:28.385 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66525.log 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.83340.log.gz 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.89230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63989.log 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.89230.log.gz 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.66525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111026.log 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.63989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88641.log 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr: 58.1% -- replaced with /var/log/ceph/ceph-client.admin.63989.log.gz 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.66525.log.gz 2024-02-23T07:10:28.386 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.111026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63715.log 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111026.log.gz 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93356.log 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88641.log: /var/log/ceph/ceph-client.admin.63715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46860.log 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.88641.log.gz 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr: 58.8% -- replaced with /var/log/ceph/ceph-client.admin.63715.log.gz 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.93356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123513.log 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93356.log.gz 2024-02-23T07:10:28.387 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.46860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77566.log 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.46860.log.gz 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.123513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116916.log 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.123513.log.gz 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.77566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.77566.log.gz 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.116916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120520.log 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.116916.log.gz 2024-02-23T07:10:28.388 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.50892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72740.log 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.120520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124984.log 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.120520.log.gz 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.72740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50868.log 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.124984.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.72740.log.gz 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.124984.log.gz 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.50868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64494.log 2024-02-23T07:10:28.389 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50868.log.gz 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.53296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50844.log 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.64494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65205.log 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.50844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122287.log 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50844.log.gz 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.65205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.65205.log.gz 2024-02-23T07:10:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.122287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122287.log.gz 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85107.log 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.49666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72078.log 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.85107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34283.log 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55652.log 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85107.log.gz 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.72078.log: /var/log/ceph/ceph-client.admin.34283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-02-23T07:10:28.391 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34283.log.gz 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.55652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68376.log 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.55652.log.gz 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41807.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz -5 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose -- /var/log/ceph/ceph-client.crash.127206.log 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27846.log 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68376.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72078.log.gz 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83929.log 2024-02-23T07:10:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.crash.127206.log: 13.0% -- replaced with /var/log/ceph/ceph-client.crash.127206.log.gz 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.tmp-client.admin.27846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98068.log 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27846.log.gz 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.83929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110437.log 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83929.log.gz 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.98068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41466.log 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90409.log 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.110437.log: /var/log/ceph/ceph-client.admin.41466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41897.log 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41466.log.gz 2024-02-23T07:10:28.393 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110437.log.gz 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.90409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108670.log 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.90409.log.gz 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64562.log 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41897.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.98068.log.gz 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.108670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86285.log 2024-02-23T07:10:28.394 INFO:teuthology.orchestra.run.smithi142.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108670.log.gz 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59186.log 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.64562.log: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.64562.log.gz 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.86285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117527.log 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86285.log.gz 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.59186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59186.log.gz 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76788.log 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.117527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40734.log 2024-02-23T07:10:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.76788.log: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.76788.log.gz 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.117527.log.gz 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41103.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose -- /var/log/ceph/ceph-client.admin.121109.log 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40734.log.gz 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.121109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53248.log 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.68376.log.gz 2024-02-23T07:10:28.396 INFO:teuthology.orchestra.run.smithi142.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121109.log.gz 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.48488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121698.log 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122335.log 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gz 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.53248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53248.log.gz 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.121698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59210.log 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.121698.log.gz 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.122335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53885.log 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122335.log.gz 2024-02-23T07:10:28.397 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41092.log 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.59210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59210.log.gz 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.53885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55063.log 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45051.log 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41092.log.gz 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53885.log.gz 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.55063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59823.log 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.55063.log.gz 2024-02-23T07:10:28.398 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.45051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41671.log 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45051.log.gz 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.59823.log: /var/log/ceph/ceph-client.admin.41671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40273.log 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41671.log.gz 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59823.log.gz 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.51481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi142.127194.log 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40273.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-23T07:10:28.399 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40273.log.gz 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92765.log 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.crash.smithi142.127194.log: 65.7% -- replaced with /var/log/ceph/ceph-client.crash.smithi142.127194.log.gz 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127760.log 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.92765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43839.log 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.92765.log.gz 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.127760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87463.log 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr: 8.2% -- replaced with /var/log/ceph/ceph-client.0.127760.log.gz 2024-02-23T07:10:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.43839.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43839.log.gz 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40732.log 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5/var/log/ceph/ceph-client.admin.87463.log: --verbose -- /var/log/ceph/ceph-client.admin.41471.log 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40732.log.gz 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87463.log.gz 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41469.log 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102780.log 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41471.log.gz 2024-02-23T07:10:28.401 INFO:teuthology.orchestra.run.smithi142.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41469.log.gz 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112204.log 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64494.log.gz 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67142.log 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.102780.log: /var/log/ceph/ceph-client.admin.112204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74424.log 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102780.log.gz 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.67142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68993.log 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.74424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73835.log 2024-02-23T07:10:28.402 INFO:teuthology.orchestra.run.smithi142.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.74424.log.gz 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.68993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109259.log 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96890.log 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.73835.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.112204.log.gz 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.109259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106903.log 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.73835.log.gz 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.109259.log.gz 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-23T07:10:28.403 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.96890.log: /var/log/ceph/ceph-client.admin.106903.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.96890.log.gz 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84518.log 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68993.log.gz 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.106903.log.gz 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.84518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78276.log 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.84518.log.gz 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr:gzip/var/log/ceph/ceph-client.admin.49077.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41468.log 2024-02-23T07:10:28.404 INFO:teuthology.orchestra.run.smithi142.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.78276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45654.log 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.78276.log.gz 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70227.log 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41468.log.gz 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.45654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60412.log 43.5% -- replaced with /var/log/ceph/ceph-client.0.45654.log.gz 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.70227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122924.log 2024-02-23T07:10:28.405 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.60412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53272.log 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.60412.log.gz 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.122924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120472.log 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr: 86.9%/var/log/ceph/ceph-client.admin.53272.log: -- replaced with /var/log/ceph/ceph-client.admin.122924.log.gz 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53272.log.gz 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126242.log 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.67142.log.gz 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.120472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64107.log 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120472.log.gz 2024-02-23T07:10:28.406 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95123.log 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.126242.log: /var/log/ceph/ceph-client.admin.64107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69610.log 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr: 47.1% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.126242.log.gz 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64107.log.gz 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.95123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99246.log 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.95123.log.gz 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.69610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61590.log 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40475.log 2024-02-23T07:10:28.407 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.99246.log: /var/log/ceph/ceph-client.admin.61590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41099.log 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.99246.log.gz 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61590.log.gz 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41098.log 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40475.log.gz 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105136.log 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41099.log.gz 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41098.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41098.log.gz 2024-02-23T07:10:28.408 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69610.log.gz 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr: -- /var/log/ceph/ceph-client.0.46257.log 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.105136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95712.log 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105136.log.gz 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.46257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104547.log 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.46257.log.gz 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.95712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80395.log 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.104547.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95712.log.gz 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114560.log 2024-02-23T07:10:28.409 INFO:teuthology.orchestra.run.smithi142.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104547.log.gz 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.80395.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.80395.log.gz 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.114560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.114560.log.gz 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80984.log 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85696.log 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2024-02-23T07:10:28.410 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.80984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58008.log 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.80984.log.gz 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.85696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.85696.log.gz 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.58008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102191.log 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.58008.log.gz 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98657.log 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gz 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.102191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101602.log 2024-02-23T07:10:28.411 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102191.log.gz 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.98657.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98657.log.gz 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92176.log 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.101602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86874.log 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.92176.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.101602.log.gzgzip 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64335.log 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr: 81.8%/var/log/ceph/ceph-client.admin.86874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40729.log 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92176.log.gz 2024-02-23T07:10:28.412 INFO:teuthology.orchestra.run.smithi142.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.86874.log.gz 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57419.log 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.64335.log: /var/log/ceph/ceph-client.admin.40729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40429.log 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40729.log.gz 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr: 89.6%/var/log/ceph/ceph-client.admin.57419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75606.log 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64335.log.gz 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57419.log.gz 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40429.log: 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz 2024-02-23T07:10:28.413 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101013.log 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.75606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115738.log 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.75606.log.gz 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.101013.log: gzip -5 --verbose -- 81.9% /var/log/ceph/ceph-client.admin.82751.log 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101013.log.gz 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.115738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88052.log 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.115738.log.gz 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.82751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113382.log 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82751.log.gz 2024-02-23T07:10:28.414 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116327.log 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88052.log.gz 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.113382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81573.log 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.116327.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40733.log 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113382.log.gz 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.116327.log.gz 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.81573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.81573.log.gz 2024-02-23T07:10:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127891.log 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40733.log.gz 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59234.log 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.34430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.127891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr: 9.2% -- replaced with /var/log/ceph/ceph-client.0.127891.log.gz 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.59234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56830.log 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.59234.log.gz 2024-02-23T07:10:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117506.log 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.56830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54474.log 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.117506.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.56830.log.gz 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117506.log.gz 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.54474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106314.log 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62816.log 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.54474.log.gz 2024-02-23T07:10:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.admin.106314.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.62816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58597.log 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.y.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.62816.log.gz 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52659.log 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.58597.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106314.log.gz 84.1% -- replaced with /var/log/ceph/ceph-client.admin.58597.log.gz 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65908.log 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.70227.log.gz 2024-02-23T07:10:28.418 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.52659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.65908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43230.log 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.52659.log.gz 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119294.log 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115149.log 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.119294.log: /var/log/ceph/ceph-client.0.43230.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.43230.log.gz 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119294.log.gz 2024-02-23T07:10:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118705.log 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.115149.log: /var/log/ceph/ceph-client.admin.118705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61001.log 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr: 80.4%/var/log/ceph/ceph-client.admin.41941.log: -- replaced with /var/log/ceph/ceph-client.admin.118705.log.gz 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115149.log.gz 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56241.log 2024-02-23T07:10:28.420 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105725.log 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.61001.log: /var/log/ceph/ceph-client.admin.56241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103958.log 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.105725.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.61001.log.gz 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.56241.log.gz 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr: 82.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97479.log 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105725.log.gz 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94534.log 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.103958.log: /var/log/ceph/ceph-client.admin.97479.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-23T07:10:28.421 INFO:teuthology.orchestra.run.smithi142.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103958.log.gz 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.94534.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.97479.log.gz 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94534.log.gz 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67759.log 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.67759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33954.log 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.67759.log.gz 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.65908.log.gz 2024-02-23T07:10:28.422 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40521.log 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76957.log 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33954.log.gz 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40521.log.gz 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41467.log 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.76957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75016.log 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr: 84.0%/var/log/ceph/ceph-client.admin.41467.log: -- replaced with /var/log/ceph/ceph-client.0.76957.log.gz 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41467.log.gz 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-23T07:10:28.423 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.75016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41305.log 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75016.log.gz 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41305.log.gz 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89820.log 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.2.log: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103369.log 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.89820.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89820.log.gz 2024-02-23T07:10:28.424 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108081.log 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.103369.log: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103369.log.gz 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78941.log 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.108081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118116.log 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.78941.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108081.log.gz 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr: 80.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107492.log 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.0.78941.log.gz 2024-02-23T07:10:28.425 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.118116.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.118116.log.gz 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40730.log 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.107492.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40730.log: 87.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40730.log.gz 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107492.log.gz 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78332.log 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41470.log 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.0.78332.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.78332.log.gz 2024-02-23T07:10:28.426 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41091.log 2024-02-23T07:10:28.427 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41470.log.gz 2024-02-23T07:10:28.436 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64626.log 2024-02-23T07:10:28.436 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41091.log.gz 2024-02-23T07:10:28.436 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100424.log 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.64626.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.64626.log.gz 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125634.log 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.100424.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.100424.log.gz 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99835.log 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.125634.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125634.log.gz 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62227.log 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.99835.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99835.log.gz 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109848.log 2024-02-23T07:10:28.437 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.62227.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.62227.log.gz 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.109848.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.109848.log.gz 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41851.log 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113971.log 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41851.log.gz 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91587.log 2024-02-23T07:10:28.438 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.113971.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.113971.log.gz 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50255.log 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.91587.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.91587.log.gz 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.50255.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.50255.log.gz 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90998.log 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41465.log 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.90998.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90998.log.gz 2024-02-23T07:10:28.439 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119883.log 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.41465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41465.log.gz 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40735.log 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.119883.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119883.log.gz 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64418.log 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.40735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40735.log.gz 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65319.log 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.64418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64418.log.gz 2024-02-23T07:10:28.440 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111615.log 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.65319.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.65319.log.gz 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82162.log 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.111615.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.111615.log.gz 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42010.log 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.82162.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.82162.log.gz 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-23T07:10:28.441 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.0.42010.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.42010.log.gz 2024-02-23T07:10:28.442 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122311.log 2024-02-23T07:10:28.450 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.122311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122311.log.gz 2024-02-23T07:10:28.566 INFO:teuthology.orchestra.run.smithi142.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-23T07:10:28.833 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-23T07:10:28.881 INFO:teuthology.orchestra.run.smithi152.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-23T07:10:28.893 INFO:teuthology.orchestra.run.smithi142.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-23T07:10:29.286 INFO:teuthology.orchestra.run.smithi142.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-23T07:10:31.337 INFO:teuthology.orchestra.run.smithi142.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-23T07:10:31.347 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-23T07:10:31.762 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-23T07:10:32.058 INFO:teuthology.orchestra.run.smithi142.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-23T07:10:32.733 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-23T07:10:33.699 INFO:teuthology.orchestra.run.smithi142.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-23T07:10:35.318 INFO:teuthology.orchestra.run.smithi152.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-23T07:10:35.320 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-23T07:10:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m6.994s 2024-02-23T07:10:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m17.663s 2024-02-23T07:10:35.320 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m0.693s 2024-02-23T07:10:40.474 INFO:teuthology.orchestra.run.smithi142.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-23T07:10:40.475 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-23T07:10:40.475 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m12.194s 2024-02-23T07:10:40.476 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m25.540s 2024-02-23T07:10:40.476 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m1.055s 2024-02-23T07:10:40.478 INFO:tasks.ceph:Archiving logs... 2024-02-23T07:10:40.478 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/remote/smithi142/log 2024-02-23T07:10:40.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-23T07:10:44.304 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/remote/smithi152/log 2024-02-23T07:10:44.305 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-23T07:10:46.939 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-02-23T07:10:46.998 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-23T07:10:47.009 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb7413ec44552fe7422e97fed5ef3fe1d54b7c4/qa/tasks/s3tests_java.py", line 369, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2024-02-23T07:10:47.022 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-23T07:10:47.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-23T07:10:47.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-23T07:10:47.119 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-23T07:10:47.130 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-23T07:10:47.130 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-23T07:10:47.133 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-23T07:10:47.161 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-23T07:10:47.162 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-02-23T07:10:47.165 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-23T07:10:47.165 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-23T07:10:47.165 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +2006us[+2006us] +/- 105ms 2024-02-23T07:10:47.165 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -917us[ -917us] +/- 54ms 2024-02-23T07:10:47.165 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -265us[ -265us] +/- 66ms 2024-02-23T07:10:47.165 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T07:10:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-23T07:10:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-02-23T07:10:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 12 +2022us[+2022us] +/- 105ms 2024-02-23T07:10:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 7 377 13 -925us[ -927us] +/- 54ms 2024-02-23T07:10:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -258us[ -260us] +/- 66ms 2024-02-23T07:10:47.168 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-23T07:10:47.168 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-23T07:10:47.178 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-23T07:10:47.178 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-23T07:10:47.191 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-23T07:10:47.292 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-23T07:10:47.375 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-23T07:10:47.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:10:47.417 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-23T07:10:47.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:10:47.460 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-23T07:10:47.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-23T07:10:47.482 INFO:teuthology.task.internal:Duration was 3072.668250 seconds 2024-02-23T07:10:47.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-23T07:10:47.492 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-23T07:10:47.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-23T07:10:47.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-23T07:10:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-23T07:10:47.556 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-23T07:10:47.803 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-23T07:10:47.803 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-02-23T07:10:47.804 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-23T07:10:47.836 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-02-23T07:10:47.836 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-23T07:10:47.877 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-23T07:10:47.877 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-23T07:10:47.879 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-23T07:10:47.958 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-23T07:10:47.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-23T07:10:47.961 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-23T07:10:48.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-23T07:10:48.119 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-23T07:10:48.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-23T07:10:48.158 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-23T07:10:48.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-23T07:10:48.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-23T07:10:48.213 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-23T07:10:48.249 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-02-23T07:10:48.277 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-02-23T07:10:48.302 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-23T07:10:48.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:10:48.331 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-23T07:10:48.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-23T07:10:48.368 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-23T07:10:48.380 INFO:teuthology.task.internal:Transferring archived files... 2024-02-23T07:10:48.381 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/remote/smithi142 2024-02-23T07:10:48.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-23T07:10:48.431 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577/remote/smithi152 2024-02-23T07:10:48.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-23T07:10:48.479 INFO:teuthology.task.internal:Removing archive directory... 2024-02-23T07:10:48.480 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-23T07:10:48.487 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-23T07:10:48.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-23T07:10:48.557 INFO:teuthology.task.internal:Not uploading archives. 2024-02-23T07:10:48.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-23T07:10:48.570 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-23T07:10:48.570 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-23T07:10:48.572 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-23T07:10:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: 265807 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 07:10 /home/ubuntu/cephtest 2024-02-23T07:10:48.610 INFO:teuthology.orchestra.run.smithi152.stdout: 265293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 07:10 /home/ubuntu/cephtest 2024-02-23T07:10:48.611 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-23T07:10:48.624 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-23T07:10:48.635 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi142 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2024-02-23T07:10:48.636 INFO:teuthology.nuke:Checking targets against current locks 2024-02-23T07:10:48.663 DEBUG:teuthology.nuke:shortname: smithi142 2024-02-23T07:10:48.663 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-23T07:10:48.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-23 06:10:57.743114', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtw7yASYzEi18PB03+iYR3wW8O2k0vgRhFW47QLqh5Fe+UYojbO+UdVn3vtLVbVheAykvClTqOGdq99HciDkHo='} 2024-02-23T07:10:48.690 DEBUG:teuthology.nuke:shortname: smithi152 2024-02-23T07:10:48.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-23T07:10:48.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/7571577', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-23 06:10:57.741412', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOpcPMBWamP5QnJutz8FBXYnvE50hjNHuIdoXso9FT4S9wiSh/XUmvQROu75rXkeJdcx5znjykPgFtVnkEyXA9Q='} 2024-02-23T07:10:48.743 INFO:teuthology.orchestra.console.smithi142:Power off 2024-02-23T07:10:48.744 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-23T07:10:48.769 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-02-23T07:10:48.769 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:10:48.786 INFO:teuthology.orchestra.console.smithi152:Power off 2024-02-23T07:10:48.787 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-23T07:10:48.797 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-23T07:10:48.810 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-02-23T07:10:48.810 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:10:48.833 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-02-23T07:10:52.799 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:10:52.835 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:10:52.909 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-23T07:10:52.945 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-02-23T07:10:56.915 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:10:56.946 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:10:57.027 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-02-23T07:10:57.056 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-02-23T07:10:57.128 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-02-23T07:11:01.060 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-23T07:11:01.172 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-02-23T07:11:01.273 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-02-23T07:11:01.379 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3072.6682498455048 failure_reason: 'Command failed on smithi142 with status 1: ''cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test''' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=485287faf22048aaa9bf01676a9b3b22 status: fail success: false 2024-02-23T07:11:01.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-23T07:11:01.517 INFO:teuthology.run:FAIL